-- Logs begin at Mon 2022-07-11 15:09:10 UTC, end at Mon 2022-07-11 16:36:21 UTC. -- Jul 11 15:35:27.806902 dv-cinder-797608-53-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 11 15:35:27.816636 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 11 15:35:27.818603 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 15:35:27 2022] *** Jul 11 15:35:27.818603 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 15:35:27.818603 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 15:35:27.818603 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: nodename: dv-cinder-797608-53-iscsi Jul 11 15:35:27.818603 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: machine: x86_64 Jul 11 15:35:27.818603 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: clock source: unix Jul 11 15:35:27.818603 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: pcre jit disabled Jul 11 15:35:27.818603 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: detected number of CPU cores: 4 Jul 11 15:35:27.818603 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: current working directory: / Jul 11 15:35:27.818603 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: detected binary path: /usr/bin/uwsgi-core Jul 11 15:35:27.818603 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: your processes number limit is 47680 Jul 11 15:35:27.819261 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: your memory page size is 4096 bytes Jul 11 15:35:27.819261 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: detected max file descriptor number: 2048 Jul 11 15:35:27.819261 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: lock engine: pthread robust mutexes Jul 11 15:35:27.819261 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: thunder lock: enabled Jul 11 15:35:27.819261 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 11 15:35:27.819261 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 15:35:27.864702 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: Python main interpreter initialized at 0x560abb5729c0 Jul 11 15:35:27.864702 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: python threads support enabled Jul 11 15:35:27.864702 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: your server socket listen backlog is limited to 100 connections Jul 11 15:35:27.864702 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: your mercy for graceful operations on workers is 90 seconds Jul 11 15:35:27.865068 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 15:35:27.865150 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: *** Operational MODE: preforking *** Jul 11 15:35:27.865393 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: *** uWSGI is running in multiple interpreter mode *** Jul 11 15:35:27.865393 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: spawned uWSGI master process (pid: 86725) Jul 11 15:35:27.865598 dv-cinder-797608-53-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 11 15:35:27.867459 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: spawned uWSGI worker 1 (pid: 86734, cores: 1) Jul 11 15:35:27.867459 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: spawned uWSGI worker 2 (pid: 86735, cores: 1) Jul 11 15:35:27.867459 dv-cinder-797608-53-iscsi devstack@keystone.service[86725]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 15:35:33.261768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:35:33.261768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: from cryptography.utils import int_from_bytes Jul 11 15:35:33.262567 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:35:33.262567 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: from cryptography.utils import int_from_bytes Jul 11 15:35:33.262970 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:35:33.262970 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: from cryptography.utils import int_from_bytes Jul 11 15:35:33.263080 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 15:35:33.263080 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: from cryptography.utils import int_from_bytes Jul 11 15:35:33.310647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 15:35:33.310842 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 15:35:33.310925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 15:35:33.311006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] command line args: [] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 15:35:33.311073 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 15:35:33.311231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 15:35:33.311318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] command line args: [] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 15:35:33.311385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ================================================================================ {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 15:35:33.311514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 15:35:33.311670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] admin_token = **** {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.311806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ================================================================================ {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 15:35:33.311898 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] config_dir = [] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.311978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] admin_token = **** {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.312049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.312212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] config_dir = [] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.312340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] config_source = [] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.312425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] debug = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.312498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.312563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] config_source = [] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.312637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.312828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] debug = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.312903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.312990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.313939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.314154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.314154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.314284 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.314345 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.314402 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.314402 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] list_limit = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.314507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.314571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] log_config_append = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.314640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] list_limit = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.314704 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.314761 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] log_config_append = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.314817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] log_dir = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.314878 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.314937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] log_file = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.315001 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] log_dir = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.315065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.315123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] log_file = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.315186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.315249 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.315311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.315377 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.315435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.315495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.315557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.315728 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.315815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.315878 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.315943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.316099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.316193 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.316335 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.316438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.316605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.316727 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.316804 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.316886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.317021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.317120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.317280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.317400 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.317486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.317567 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.317731 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.317863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.317944 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.318221 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.318351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.318438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] publish_errors = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.318647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.318771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.318871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] publish_errors = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.318955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.319029 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.319153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.319234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.319312 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.319463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.319604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.319687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.319763 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] standard_threads = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.319904 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.320094 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.320177 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] standard_threads = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.320248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.320248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.320413 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.320485 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] use_journal = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.320565 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.320638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] use_json = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.320735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.320824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] use_stderr = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.320900 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] use_journal = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.320978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] use_syslog = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.321060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] use_json = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.321131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.321200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] use_stderr = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.321411 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] use_syslog = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.321530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.321609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 15:35:33.321694 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.321864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.321985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.322073 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.322152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.322340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.322475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.322556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.322626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.322803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.322924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.323010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.323095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.323263 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.323384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.323461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.323541 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.323702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.323794 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.323942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.324029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.324183 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.324262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.324445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.324539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.324684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.324820 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.324901 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.324973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.325145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.325307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.325382 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.325450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.325604 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.325695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.325852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.325945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.326082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.326167 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.326330 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.326411 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.326558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.326673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.326806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.326940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.327161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.327243 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.327400 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.327479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.327626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.327706 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.327837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.327913 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.328061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.328138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.328306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.328424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.328536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.328621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.328776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.328853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.329003 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.329080 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.329292 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.329377 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.329542 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.329619 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.329779 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.329858 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.330026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.330103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.330256 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.330335 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.330491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.330567 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.330725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.330801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.330947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.331021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.331167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.331245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.331394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.331469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.331618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.331703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.331842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.331924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.332069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.332171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.332318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.332423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.332549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.332650 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.332780 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.332882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.332995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.333095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.333226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.333313 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.333471 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.333591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.333699 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.333777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.333935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.334067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.334183 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.334331 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.334466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.334582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.334701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.334829 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.334943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.335080 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.335194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.335312 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.335428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.335546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.335546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.335791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.335791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.336023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.336141 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.336269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.336269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.336528 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.336649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.336785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.336785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.337017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.337454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.337584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.337584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.337811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.337930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.338053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.338171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.338292 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.338420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.338549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.338680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.338802 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.338923 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.339045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.339161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.339292 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.339414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.339535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.339663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.339785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.339906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.340039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.340167 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.340307 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.340437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.340556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.340677 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.340809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.340931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.341058 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.341187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.341309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.341433 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.341561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.341682 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.341804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.341925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.342058 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.342180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.342319 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.342444 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.342565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.342686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.342808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.342929 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.343124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.343248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.343365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.343495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.343617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.343738 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.343877 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.344012 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.344142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.344265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.344403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.344530 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.344651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.344797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.344955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.345117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.345244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.345373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.345496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.345625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.345759 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.345880 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.346009 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.346131 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.346252 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.346382 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.346504 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.346625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.346745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.346745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.346986 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.347117 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] auth.external = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.347239 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.347370 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.347491 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.347612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.347735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] auth.external = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.347863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.348010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.348146 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] auth.password = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.348269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.348475 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] auth.token = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.348600 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.348724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.348854 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] auth.password = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.348983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.349107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] auth.token = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.349240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.349363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.349485 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.349607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.349736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.349859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.349981 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.350103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.350225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.350347 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.350477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] credential.caching = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.350600 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.350722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.350854 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.350976 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.351098 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] credential.caching = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.351234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.351358 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.351481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.351603 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.351725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.351852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.351982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.352112 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.352234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.352381 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.352501 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.352637 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.352765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.352885 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.353010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.353135 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.353255 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.353375 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.353502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.353621 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.353740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.353859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.353978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.354096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.354221 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.354350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.354491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] federation.caching = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.354670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.354791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.354910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.355039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.355159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] federation.caching = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.355278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.355397 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.355517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.355636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.355762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.355887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.356017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.356135 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.356255 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.356432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.356558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.356682 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.356805 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.356930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.357047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.357176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.357300 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.357422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.357552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity.caching = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.357683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.357811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.358009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.358135 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.358257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity.caching = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.358379 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.358502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.358626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.358757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.358880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.359002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.359124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.359246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.359368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.359507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.359633 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.359756 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.359756 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.359985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.360107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.360237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.360237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.360545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.360669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.360876 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.361008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.361137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.361137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.361374 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.361493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.361613 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.361733 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.361860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.361980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.362099 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.362217 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.362336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.362455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.362581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.362702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.362822 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.362949 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.363069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.363187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.363312 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.363432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.363551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.363670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.363790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.363909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.364035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.364154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.364275 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.364414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.364537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.364670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.364807 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.364931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.365054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.365175 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.365296 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.365418 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.365548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.365677 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.365799 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.365921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.366049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.366171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.366310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.366433 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.366554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.366676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.366800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.366922 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.367056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.367178 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.367300 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.367421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.367542 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.367664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.367793 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.367926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.368058 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.368181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.368330 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.368450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.368578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.368699 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.368817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.368936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.369054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.369180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.369299 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.369418 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.369536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.369654 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.369803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.369931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.370053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.370172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.370296 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.370415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.370533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.370659 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.370779 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.370898 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.371015 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.371134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.371252 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.371390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.371510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.371629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.371747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.371865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.371983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.372109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.372229 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.372372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.372493 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.372615 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.372737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.372865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.372985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.373113 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.373232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.373351 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.373469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.373595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.373595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.373818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.373936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.374054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.374172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.374297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.374415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.374535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.374662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.374781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.374781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.375011 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.375011 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.375235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.375353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.375472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.375590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.375716 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.375835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.375953 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.376071 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.376190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.376361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.376494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.376617 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.376739 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.376861 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.376987 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.377103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.377232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.377355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.377479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.377600 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.377721 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.377843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.377977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.378110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.378233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.378354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.378477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.378599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.378733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.378855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.378978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.379100 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.379222 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.379343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.379475 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.379597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.379720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] resource.caching = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.379851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] resource.caching = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.379973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.380095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.380225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.380367 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.380487 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.380607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.380725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.380843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.380971 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.381090 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.381209 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.381327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.381455 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.381574 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.381766 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.381887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.382006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.382124 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.382243 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] role.caching = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.382361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] role.caching = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.382488 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] role.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.382608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] role.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.382728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.382846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.382965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.383094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.383227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.383347 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.383467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.383585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.383705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.383832 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.383951 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.384070 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.384189 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.384367 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.384488 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.384620 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.384745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.384877 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.384999 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.385120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.385242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.385372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.385495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.385618 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.385740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.385862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.385985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.386117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.386241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.386362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.386494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.386616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.386737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.386868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.386995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.387111 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.387233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.387355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.387355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.387594 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.387717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.387838 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.387961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.388092 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.388222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.388357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.388475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.388617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.388746 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.388865 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.388992 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.389116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.389238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.389359 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.389482 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.389603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.389733 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.389868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.389948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.390104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.390222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.390339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.390486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.390604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.390724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.390842 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.390960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] token.caching = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.391080 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] token.caching = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.391205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.391345 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.391345 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.391577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.391723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.391842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.391970 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.392091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.392360 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.392486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.392611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.392734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.392867 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.392991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.393114 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.393238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.393390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.393508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.393508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.393748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.393871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.393992 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.394114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.394236 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.394366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.394489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.394608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.394730 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.394853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.394974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.395113 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.395236 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.395360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.395482 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.395607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.connection = **** {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.395692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.connection = **** {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.395777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.395856 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.395929 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.396007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.396079 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.396149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.396220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.396306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.396380 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.396463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.396536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.396607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.396724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.396799 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.396870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.396949 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.397022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.397097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.397167 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.397238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.397309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.397388 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.397461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.397532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.397602 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.397673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.397744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.397823 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.397897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.397897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.398025 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.398096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.398166 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.398244 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.398356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.398434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 15:35:33.398550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 15:35:33.398550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 15:35:33.424420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.424617 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.424846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.424973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.425140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.425360 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.433308 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.433860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.461296 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.461438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.461522 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.461602 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.603931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.619880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.652106 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.652350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.653936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.654175 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.715607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.715759 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.715885 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.715989 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.716110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.716193 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.716256 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.716404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.716524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.716655 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.716744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.716810 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.741310 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.741546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.741688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.741829 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.741910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.742029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.742108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.742240 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.742320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.742382 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.742499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.742576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.742647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.742841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.753588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.753855 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.766331 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.766577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.766777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.766923 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.767014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.767087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.767151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.767224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.767288 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.767409 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.767486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.767620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.767707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86735) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.767833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86734) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 15:35:33.785161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.785367 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 15:35:33.785537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.785670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.785782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 15:35:33.785863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 15:35:33.786082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.786208 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.786291 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 15:35:33.786372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.786506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.786636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.786768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.786848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.787022 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.787272 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.797713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.798072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.798194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.798366 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.798477 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.798603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.798681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.798916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.806899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.807133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.810162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.810407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.810536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.810720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.810842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.810991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.811118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.811246 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.811325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.811457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.811547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.811668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.811787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.811905 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.812060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.812183 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.812336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.812468 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.812596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.812727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.812853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.812993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.839072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.839363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.840764 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.841000 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.841152 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.841240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.846223 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.846497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.846622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.846725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.846851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.847037 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.854066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.854339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.854460 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.854635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.858735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.859016 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.859136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.859275 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.859375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.859522 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.859604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.859822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.859946 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.860095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.860177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.860314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.860403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.860663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.860788 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.860941 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.879193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.879399 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.879510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.879638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.884049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.886996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.887645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.887929 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.893111 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.893311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.893504 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.896687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.900282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.900603 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.900877 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.901150 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.901430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.901706 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.901974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.907942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.914062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.914365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.914651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.914932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.915217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.915495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.920809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.921107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.921362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.921617 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.929566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.931252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.931521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.934698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.934975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.935217 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.935520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.935681 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.935826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.935953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.936085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.936395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.946750 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.948510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.948863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.949079 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.949348 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.949625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.949908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.950179 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.951872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.952156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.952722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.953106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.953382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.953655 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.953930 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.967536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.967763 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.968034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.968320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.968605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.968876 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.969158 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.970110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.973552 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.976806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.978524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.980128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.980422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.980699 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.987874 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.988438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.989472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.991702 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.992682 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.992970 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.993350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.993629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.995021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.996635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.998387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:33.998665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:33.998938 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.002601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:34.002880 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.003149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.006240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.007852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:34.010881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86735) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:34.011007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.011165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.011293 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.011449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.011532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.011678 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.011804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.011942 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.012339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.012640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.012908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.013185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.013453 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.013716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.013982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.014238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.014478 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86735) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.021155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:34.021434 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.021706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.029491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86734) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 15:35:34.029767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.030045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.030317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.030583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.030848 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.031131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.031497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.031774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.032039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.032555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.032555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.033023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.033302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86734) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 15:35:34.051896 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560abb5729c0 pid: 86735 (default app) Jul 11 15:35:34.055400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65d738-960c-4752-8e6b-5844515608d9 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:34.055691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65d738-960c-4752-8e6b-5844515608d9 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:34.055964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65d738-960c-4752-8e6b-5844515608d9 None None] PATH_INFO: `/v3` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:34.060245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Mon Jul 11 15:35:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:34.070881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560abb5729c0 pid: 86734 (default app) Jul 11 15:35:41.752219 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6b4ab-4c6f-45e5-8310-02069d56f76d None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:41.752868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6b4ab-4c6f-45e5-8310-02069d56f76d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:41.752868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6b4ab-4c6f-45e5-8310-02069d56f76d None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:41.754137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:35:41.766935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f697cc-c3d0-46e6-bf99-fcc24f065e09 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:41.767635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f697cc-c3d0-46e6-bf99-fcc24f065e09 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:41.767862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f697cc-c3d0-46e6-bf99-fcc24f065e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:41.842011 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: INFO dbcounter [None req-92f697cc-c3d0-46e6-bf99-fcc24f065e09 None None] Registered counter for database keystone Jul 11 15:35:41.865519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG oslo_db.sqlalchemy.engines [None req-92f697cc-c3d0-46e6-bf99-fcc24f065e09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86734) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:35:41.876474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writer thread running {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:35:42.065616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG passlib.handlers.bcrypt [None req-92f697cc-c3d0-46e6-bf99-fcc24f065e09 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86734) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 15:35:42.066021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG passlib.handlers.bcrypt [None req-92f697cc-c3d0-46e6-bf99-fcc24f065e09 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86734) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 15:35:42.121220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-92f697cc-c3d0-46e6-bf99-fcc24f065e09 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:42.122800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-92f697cc-c3d0-46e6-bf99-fcc24f065e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:42.260755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1/3] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:35:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 15:35:42.478512 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6b4ab-4c6f-45e5-8310-02069d56f76d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:42.557209 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: INFO dbcounter [None req-b9f6b4ab-4c6f-45e5-8310-02069d56f76d None None] Registered counter for database keystone Jul 11 15:35:42.578756 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG oslo_db.sqlalchemy.engines [None req-b9f6b4ab-4c6f-45e5-8310-02069d56f76d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 15:35:42.588323 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writer thread running {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 15:35:42.704920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6b4ab-4c6f-45e5-8310-02069d56f76d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:42.710445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44172b9b-852d-40b8-9230-60ec2c70cd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:42.711103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44172b9b-852d-40b8-9230-60ec2c70cd6e admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:42.711384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44172b9b-852d-40b8-9230-60ec2c70cd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:42.711656 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44172b9b-852d-40b8-9230-60ec2c70cd6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:42.721068 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44172b9b-852d-40b8-9230-60ec2c70cd6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:42.771764 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: WARNING keystone.common.rbac_enforcer.enforcer [None req-44172b9b-852d-40b8-9230-60ec2c70cd6e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 15:35:42.772364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44172b9b-852d-40b8-9230-60ec2c70cd6e admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:42.782314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 3/4] 10.222.0.26 () {58 vars in 1324 bytes} [Mon Jul 11 15:35:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:35:42.792352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f697cc-c3d0-46e6-bf99-fcc24f065e09 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:42.812144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f697cc-c3d0-46e6-bf99-fcc24f065e09 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:42.818056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f95eb3-137f-482c-9bc2-14848db8a3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:42.819233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f95eb3-137f-482c-9bc2-14848db8a3bb admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:42.819518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f95eb3-137f-482c-9bc2-14848db8a3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:42.819797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f95eb3-137f-482c-9bc2-14848db8a3bb admin admin] PATH_INFO: `/v3/projects/ea74c7f2a67041fea527ddf55a3384ec` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:42.821492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f95eb3-137f-482c-9bc2-14848db8a3bb admin admin] RBAC: Authorizing `identity:get_project(project_id=ea74c7f2a67041fea527ddf55a3384ec)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:42.872421 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f0f95eb3-137f-482c-9bc2-14848db8a3bb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 15:35:42.872784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f95eb3-137f-482c-9bc2-14848db8a3bb admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:42.877638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 2/5] 10.222.0.26 () {56 vars in 1207 bytes} [Mon Jul 11 15:35:42 2022] GET /identity/v3/projects/ea74c7f2a67041fea527ddf55a3384ec => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:44.846446 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ce9c6-c99c-4806-bff9-247f2210642f None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:44.847016 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ce9c6-c99c-4806-bff9-247f2210642f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:44.847016 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ce9c6-c99c-4806-bff9-247f2210642f None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:44.851172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 4/6] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:35:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:35:44.857797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e503a0c-900f-4222-a439-72c060262370 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:44.858499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e503a0c-900f-4222-a439-72c060262370 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:44.858649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e503a0c-900f-4222-a439-72c060262370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:44.884831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-8e503a0c-900f-4222-a439-72c060262370 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:44.886390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8e503a0c-900f-4222-a439-72c060262370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:44.896962 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 3/7] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:35:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 15:35:44.920057 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ce9c6-c99c-4806-bff9-247f2210642f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:44.941513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ce9c6-c99c-4806-bff9-247f2210642f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:44.946960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018e20a-fbee-4d76-8ba5-b5c9262ee05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:44.947609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018e20a-fbee-4d76-8ba5-b5c9262ee05b admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:44.947887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018e20a-fbee-4d76-8ba5-b5c9262ee05b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:44.948155 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018e20a-fbee-4d76-8ba5-b5c9262ee05b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:44.957053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018e20a-fbee-4d76-8ba5-b5c9262ee05b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:44.958853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018e20a-fbee-4d76-8ba5-b5c9262ee05b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:44.968236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 5/8] 10.222.0.26 () {58 vars in 1324 bytes} [Mon Jul 11 15:35:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:35:44.974163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e503a0c-900f-4222-a439-72c060262370 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:44.983777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e503a0c-900f-4222-a439-72c060262370 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:44.990062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366af84d-8502-49be-8105-76c7d1c67f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:44.990949 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366af84d-8502-49be-8105-76c7d1c67f20 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:44.991239 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366af84d-8502-49be-8105-76c7d1c67f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:44.991505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366af84d-8502-49be-8105-76c7d1c67f20 admin admin] PATH_INFO: `/v3/users/db61f34a47204afa92fb860bcaecb5da` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:44.993153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366af84d-8502-49be-8105-76c7d1c67f20 admin admin] RBAC: Authorizing `identity:get_user(user_id=db61f34a47204afa92fb860bcaecb5da)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:44.995008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366af84d-8502-49be-8105-76c7d1c67f20 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:44.996635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 4/9] 10.222.0.26 () {56 vars in 1198 bytes} [Mon Jul 11 15:35:44 2022] GET /identity/v3/users/db61f34a47204afa92fb860bcaecb5da => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:47.034123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f907f8c-2340-4eb9-af84-6b29cc0c6fff None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:47.034689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f907f8c-2340-4eb9-af84-6b29cc0c6fff None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:47.034689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f907f8c-2340-4eb9-af84-6b29cc0c6fff None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:47.036041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:35:47.041322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dd09b-01ae-4a61-8717-c7f911e73954 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:47.041746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dd09b-01ae-4a61-8717-c7f911e73954 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:47.041883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dd09b-01ae-4a61-8717-c7f911e73954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:47.059109 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-d12dd09b-01ae-4a61-8717-c7f911e73954 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:47.060315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d12dd09b-01ae-4a61-8717-c7f911e73954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:47.091885 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00f11-c213-4985-8cef-c61c89d07a71 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:47.092144 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00f11-c213-4985-8cef-c61c89d07a71 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:47.092451 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00f11-c213-4985-8cef-c61c89d07a71 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:47.093841 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 7/11] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:35:47.099114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025fe61-859e-444d-88c4-e34c8d638ee0 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:47.099476 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025fe61-859e-444d-88c4-e34c8d638ee0 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:47.099761 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025fe61-859e-444d-88c4-e34c8d638ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:47.139412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG passlib.handlers.bcrypt [None req-5025fe61-859e-444d-88c4-e34c8d638ee0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86735) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 15:35:47.139826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG passlib.handlers.bcrypt [None req-5025fe61-859e-444d-88c4-e34c8d638ee0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86735) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 15:35:47.146571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 5/12] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:35:47.169083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dd09b-01ae-4a61-8717-c7f911e73954 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:47.184827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-5025fe61-859e-444d-88c4-e34c8d638ee0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:47.186491 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5025fe61-859e-444d-88c4-e34c8d638ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:47.195177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:47.277043 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dd09b-01ae-4a61-8717-c7f911e73954 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:47.288737 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 8/13] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:35:47.310960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025fe61-859e-444d-88c4-e34c8d638ee0 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:47.311744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b9c01-43f0-4ecb-9a05-631b2a199f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:47.312595 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b9c01-43f0-4ecb-9a05-631b2a199f05 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:47.312849 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b9c01-43f0-4ecb-9a05-631b2a199f05 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:47.313171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b9c01-43f0-4ecb-9a05-631b2a199f05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:47.324716 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b9c01-43f0-4ecb-9a05-631b2a199f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-798b9c01-43f0-4ecb-9a05-631b2a199f05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:35:47.335958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:35:47.337290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:35:47.338161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:35:47.338161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:35:47.338161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:35:47.338161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:35:47.338161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:35:47.338161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:35:47.338161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:35:47.338161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:35:47.338161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:35:47.338161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:35:47.338161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:35:47.338161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:35:47.338161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 6/14] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:35:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:35:47.343243 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b9c01-43f0-4ecb-9a05-631b2a199f05 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:47.413884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025fe61-859e-444d-88c4-e34c8d638ee0 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:47.416253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:47.425839 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:47.445109 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b9c01-43f0-4ecb-9a05-631b2a199f05 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:47.451794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8ac2d-c788-4048-845a-90be68e5116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:47.452752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8ac2d-c788-4048-845a-90be68e5116b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:47.453041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8ac2d-c788-4048-845a-90be68e5116b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:47.453315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8ac2d-c788-4048-845a-90be68e5116b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:47.479941 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f13431-94bf-4b56-ae82-5080e2413d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:47.480683 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f13431-94bf-4b56-ae82-5080e2413d3b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:47.480993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f13431-94bf-4b56-ae82-5080e2413d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:47.481297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f13431-94bf-4b56-ae82-5080e2413d3b None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:47.482095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f13431-94bf-4b56-ae82-5080e2413d3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:35:47.482420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f13431-94bf-4b56-ae82-5080e2413d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:47.483851 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f13431-94bf-4b56-ae82-5080e2413d3b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:47.495531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 7/15] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:35:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:35:47.501164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f13431-94bf-4b56-ae82-5080e2413d3b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:47.524578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8ac2d-c788-4048-845a-90be68e5116b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:47.526134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8ac2d-c788-4048-845a-90be68e5116b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:47.604021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f13431-94bf-4b56-ae82-5080e2413d3b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:47.623750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 9/16] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 15:35:47.629424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8ac2d-c788-4048-845a-90be68e5116b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:47.632108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:47.639572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6a730-a6ef-49b1-8bf3-f30e452944e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:47.640490 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6a730-a6ef-49b1-8bf3-f30e452944e7 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:47.640774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6a730-a6ef-49b1-8bf3-f30e452944e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:47.641046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6a730-a6ef-49b1-8bf3-f30e452944e7 None admin] PATH_INFO: `/v3/users/db61f34a47204afa92fb860bcaecb5da` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:47.642349 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6a730-a6ef-49b1-8bf3-f30e452944e7 None admin] RBAC: Authorizing `identity:get_user(user_id=db61f34a47204afa92fb860bcaecb5da)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:47.643821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6a730-a6ef-49b1-8bf3-f30e452944e7 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:47.645485 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 8/17] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:35:47 2022] GET /identity/v3/users/db61f34a47204afa92fb860bcaecb5da => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:47.650806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6a730-a6ef-49b1-8bf3-f30e452944e7 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:47.664902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:47.727395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8ac2d-c788-4048-845a-90be68e5116b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:47.750297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6a730-a6ef-49b1-8bf3-f30e452944e7 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:47.763018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb2b60-3b9b-4500-94c2-e675b95d633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:47.763812 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb2b60-3b9b-4500-94c2-e675b95d633f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:47.764091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb2b60-3b9b-4500-94c2-e675b95d633f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:47.764394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb2b60-3b9b-4500-94c2-e675b95d633f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:47.782387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb2b60-3b9b-4500-94c2-e675b95d633f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:47.783869 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb2b60-3b9b-4500-94c2-e675b95d633f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:47.787970 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e576264-b3e5-4579-84b5-e296cdb20c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:47.788833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576264-b3e5-4579-84b5-e296cdb20c3b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:47.789116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576264-b3e5-4579-84b5-e296cdb20c3b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:47.789389 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576264-b3e5-4579-84b5-e296cdb20c3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:47.790593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e576264-b3e5-4579-84b5-e296cdb20c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:47.792060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e576264-b3e5-4579-84b5-e296cdb20c3b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:47.793708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:35:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:47.799672 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e576264-b3e5-4579-84b5-e296cdb20c3b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-5deb2b60-3b9b-4500-94c2-e675b95d633f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:35:47.803702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:35:47.804578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:35:47.805825 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:35:47.805825 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:35:47.805825 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:35:47.805825 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:35:47.805825 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:35:47.810491 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb2b60-3b9b-4500-94c2-e675b95d633f None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:47.865994 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:47.881977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:47.901229 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e576264-b3e5-4579-84b5-e296cdb20c3b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:47.907505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb2b60-3b9b-4500-94c2-e675b95d633f None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:47.934927 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25575777-7025-432e-bcab-3788cf5a36b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:47.935566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25575777-7025-432e-bcab-3788cf5a36b8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:47.935847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25575777-7025-432e-bcab-3788cf5a36b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:47.936116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25575777-7025-432e-bcab-3788cf5a36b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:47.936986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25575777-7025-432e-bcab-3788cf5a36b8 None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.domain.id=default, user.id=db61f34a47204afa92fb860bcaecb5da) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:35:47.937294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25575777-7025-432e-bcab-3788cf5a36b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:47.938892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25575777-7025-432e-bcab-3788cf5a36b8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:47.943320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a272041-90db-4ba1-b3d4-9cfd75bf744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:47.943983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a272041-90db-4ba1-b3d4-9cfd75bf744a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:47.944267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a272041-90db-4ba1-b3d4-9cfd75bf744a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:47.944572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a272041-90db-4ba1-b3d4-9cfd75bf744a None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:47.945314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a272041-90db-4ba1-b3d4-9cfd75bf744a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:35:47.945648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a272041-90db-4ba1-b3d4-9cfd75bf744a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:47.945762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 10/20] 10.222.0.26 () {56 vars in 1322 bytes} [Mon Jul 11 15:35:47 2022] GET /identity/v3/role_assignments?user.id=db61f34a47204afa92fb860bcaecb5da&scope.domain.id=default&role.id=32f5ce5800cf40d99d894960288d0155 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:47.947049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a272041-90db-4ba1-b3d4-9cfd75bf744a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:47.967666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 11/21] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:35:50.276074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60552b-530e-4eea-a0c0-481ca4fb9e14 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:50.277064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60552b-530e-4eea-a0c0-481ca4fb9e14 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:50.277571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60552b-530e-4eea-a0c0-481ca4fb9e14 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:50.279428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 11/22] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:35:50.285357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54f74-1f01-4ec7-a340-ef47a820b7af None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:50.285800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54f74-1f01-4ec7-a340-ef47a820b7af None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:50.285920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54f74-1f01-4ec7-a340-ef47a820b7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:50.296793 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b76fb-e061-4cc7-be51-60dd407a6e0b None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:50.297290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b76fb-e061-4cc7-be51-60dd407a6e0b None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:50.298043 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b76fb-e061-4cc7-be51-60dd407a6e0b None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:50.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 12/23] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:35:50.308655 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f695a-cddf-495b-8988-b13f7d7bd9f0 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:50.309234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f695a-cddf-495b-8988-b13f7d7bd9f0 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:50.309706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f695a-cddf-495b-8988-b13f7d7bd9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:50.311226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-cbf54f74-1f01-4ec7-a340-ef47a820b7af None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:50.312470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-cbf54f74-1f01-4ec7-a340-ef47a820b7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:50.335595 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-6f8f695a-cddf-495b-8988-b13f7d7bd9f0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:50.337690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6f8f695a-cddf-495b-8988-b13f7d7bd9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:50.432115 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 12/24] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:35:50.445914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 11 15:35:50.459231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54f74-1f01-4ec7-a340-ef47a820b7af None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:50.489939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f695a-cddf-495b-8988-b13f7d7bd9f0 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:50.530053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:50.600692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:50.636023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f695a-cddf-495b-8988-b13f7d7bd9f0 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:50.636539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54f74-1f01-4ec7-a340-ef47a820b7af None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:50.691468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f2a83-16c5-438d-bf1d-bdde08103719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:50.692277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f2a83-16c5-438d-bf1d-bdde08103719 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:50.692598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f2a83-16c5-438d-bf1d-bdde08103719 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:50.692879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f2a83-16c5-438d-bf1d-bdde08103719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:50.694008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6989a59-f235-47da-a740-f012a6c4dd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:50.694815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989a59-f235-47da-a740-f012a6c4dd52 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:50.695095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989a59-f235-47da-a740-f012a6c4dd52 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:50.695369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989a59-f235-47da-a740-f012a6c4dd52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:50.715395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f2a83-16c5-438d-bf1d-bdde08103719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:50.716865 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f2a83-16c5-438d-bf1d-bdde08103719 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:50.717443 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6989a59-f235-47da-a740-f012a6c4dd52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-a6989a59-f235-47da-a740-f012a6c4dd52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:35:50.726475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:35:50.727306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:35:50.728056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:35:50.728056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:35:50.728056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:35:50.728056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:35:50.728056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:35:50.728056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:35:50.728056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:35:50.728056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:35:50.728056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:35:50.728056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:35:50.728056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:35:50.728056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:35:50.728056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 13/26] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:35:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:35:50.736904 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea65a2b-453f-4440-ad51-6d232f85a6b4 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:50.737195 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea65a2b-453f-4440-ad51-6d232f85a6b4 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:50.737477 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea65a2b-453f-4440-ad51-6d232f85a6b4 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:50.738877 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 14/27] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:35:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:35:50.739602 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea65a2b-453f-4440-ad51-6d232f85a6b4 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-180f2a83-16c5-438d-bf1d-bdde08103719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:35:50.752692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:35:50.753506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:35:50.755600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:35:50.755600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:35:50.755600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:35:50.755600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:35:50.755600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 14/28] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:35:50.755600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3454d4-657d-4b70-87a3-1adfd5931311 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:50.755600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3454d4-657d-4b70-87a3-1adfd5931311 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:50.756483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3454d4-657d-4b70-87a3-1adfd5931311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:50.789534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-9c3454d4-657d-4b70-87a3-1adfd5931311 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:50.790828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9c3454d4-657d-4b70-87a3-1adfd5931311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:50.862676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea65a2b-453f-4440-ad51-6d232f85a6b4 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:50.870479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:50.878212 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:35:50.878934 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3454d4-657d-4b70-87a3-1adfd5931311 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:50.904328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42af628-4593-43c9-a410-7da4916e980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:50.905789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42af628-4593-43c9-a410-7da4916e980a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:50.906468 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42af628-4593-43c9-a410-7da4916e980a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:50.907221 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42af628-4593-43c9-a410-7da4916e980a None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:50.908835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42af628-4593-43c9-a410-7da4916e980a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:35:50.909565 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42af628-4593-43c9-a410-7da4916e980a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:50.912033 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42af628-4593-43c9-a410-7da4916e980a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:50.932417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 15/30] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:35:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:50.939203 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350cd3b-60a9-49c3-8064-985b4ff5962c None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:50.940186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350cd3b-60a9-49c3-8064-985b4ff5962c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:50.940918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350cd3b-60a9-49c3-8064-985b4ff5962c None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:50.943284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 16/31] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:35:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:35:50.944653 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350cd3b-60a9-49c3-8064-985b4ff5962c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:50.945875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:50.989110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3454d4-657d-4b70-87a3-1adfd5931311 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:51.025585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea1c58-e3ee-445b-b1fc-08d39ce1ef80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:51.026256 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea1c58-e3ee-445b-b1fc-08d39ce1ef80 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:51.026548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea1c58-e3ee-445b-b1fc-08d39ce1ef80 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:51.026835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea1c58-e3ee-445b-b1fc-08d39ce1ef80 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:51.027692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea1c58-e3ee-445b-b1fc-08d39ce1ef80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:35:51.028023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea1c58-e3ee-445b-b1fc-08d39ce1ef80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:51.029449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea1c58-e3ee-445b-b1fc-08d39ce1ef80 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:51.049444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 16/32] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:51.050313 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea1c58-e3ee-445b-b1fc-08d39ce1ef80 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:51.064399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350cd3b-60a9-49c3-8064-985b4ff5962c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:51.102655 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370df907-2089-4c72-8c9d-cb0bd68da2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:51.103334 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370df907-2089-4c72-8c9d-cb0bd68da2ec None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:51.103623 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370df907-2089-4c72-8c9d-cb0bd68da2ec None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:51.103885 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370df907-2089-4c72-8c9d-cb0bd68da2ec None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:51.104764 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370df907-2089-4c72-8c9d-cb0bd68da2ec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:51.106272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370df907-2089-4c72-8c9d-cb0bd68da2ec None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:51.156232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea1c58-e3ee-445b-b1fc-08d39ce1ef80 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:51.173358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:51.192333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ab493-37f9-4f03-ac94-7f801abaeb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:51.192630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ab493-37f9-4f03-ac94-7f801abaeb53 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:51.192917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ab493-37f9-4f03-ac94-7f801abaeb53 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:51.195514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ab493-37f9-4f03-ac94-7f801abaeb53 None admin] PATH_INFO: `/v3/users/db61f34a47204afa92fb860bcaecb5da` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:51.195514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ab493-37f9-4f03-ac94-7f801abaeb53 None admin] RBAC: Authorizing `identity:get_user(user_id=db61f34a47204afa92fb860bcaecb5da)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:51.195885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ab493-37f9-4f03-ac94-7f801abaeb53 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:51.208623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 17/33] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:35:51 2022] GET /identity/v3/users/db61f34a47204afa92fb860bcaecb5da => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:51.208623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd35cb-619d-4520-be70-4e1dd50a6db6 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:51.208623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd35cb-619d-4520-be70-4e1dd50a6db6 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:51.208623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd35cb-619d-4520-be70-4e1dd50a6db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:51.215995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-dfbd35cb-619d-4520-be70-4e1dd50a6db6 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:51.217245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-dfbd35cb-619d-4520-be70-4e1dd50a6db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:51.242409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 17/34] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Jul 11 15:35:50 2022] POST /identity/v3/roles => generated 219 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:35:51.243435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370df907-2089-4c72-8c9d-cb0bd68da2ec None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:51.297953 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 18/35] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:35:51.298960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd35cb-619d-4520-be70-4e1dd50a6db6 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:51.311880 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:51.400130 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370df907-2089-4c72-8c9d-cb0bd68da2ec None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:51.467761 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50ec48-b505-4802-9db8-57d48f01d3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:51.468840 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50ec48-b505-4802-9db8-57d48f01d3f7 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:51.469415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50ec48-b505-4802-9db8-57d48f01d3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:51.469925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50ec48-b505-4802-9db8-57d48f01d3f7 None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:51.471131 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50ec48-b505-4802-9db8-57d48f01d3f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:51.474186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50ec48-b505-4802-9db8-57d48f01d3f7 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:51.494836 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd35cb-619d-4520-be70-4e1dd50a6db6 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:51.517969 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:51.529117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 18/36] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Jul 11 15:35:51 2022] POST /identity/v3/projects => generated 301 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:35:51.529772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50ec48-b505-4802-9db8-57d48f01d3f7 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:51.547235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9a656-6142-43aa-b792-b0bb498f4c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:51.548517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a656-6142-43aa-b792-b0bb498f4c7a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:51.548804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a656-6142-43aa-b792-b0bb498f4c7a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:51.549081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a656-6142-43aa-b792-b0bb498f4c7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:51.551975 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9a656-6142-43aa-b792-b0bb498f4c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:51.553744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9a656-6142-43aa-b792-b0bb498f4c7a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:51.556121 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 19/37] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:35:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:51.561597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9a656-6142-43aa-b792-b0bb498f4c7a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:51.648336 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:51.682430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50ec48-b505-4802-9db8-57d48f01d3f7 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:51.698453 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9a656-6142-43aa-b792-b0bb498f4c7a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:51.724078 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c73e0f-f0a3-4f3d-b84f-965311313a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:51.724799 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c73e0f-f0a3-4f3d-b84f-965311313a6b None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:51.725096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c73e0f-f0a3-4f3d-b84f-965311313a6b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:51.725477 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c73e0f-f0a3-4f3d-b84f-965311313a6b None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:51.726411 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c73e0f-f0a3-4f3d-b84f-965311313a6b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:51.727950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c73e0f-f0a3-4f3d-b84f-965311313a6b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:51.745864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 19/38] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Jul 11 15:35:51 2022] POST /identity/v3/roles => generated 225 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:35:51.778296 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06075ceb-7e75-4ca9-b02b-986ad2be57d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:51.779207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06075ceb-7e75-4ca9-b02b-986ad2be57d4 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:51.779486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06075ceb-7e75-4ca9-b02b-986ad2be57d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:51.779762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06075ceb-7e75-4ca9-b02b-986ad2be57d4 None admin] PATH_INFO: `/v3/domains/default/users/db61f34a47204afa92fb860bcaecb5da/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:51.786320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06075ceb-7e75-4ca9-b02b-986ad2be57d4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=db61f34a47204afa92fb860bcaecb5da, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:51.787818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06075ceb-7e75-4ca9-b02b-986ad2be57d4 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:51.928991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 20/39] 10.222.0.26 () {58 vars in 1361 bytes} [Mon Jul 11 15:35:51 2022] PUT /identity/v3/domains/default/users/db61f34a47204afa92fb860bcaecb5da/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:35:52.028253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e504a-e423-406d-a671-6c208a96d7e9 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:52.028542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e504a-e423-406d-a671-6c208a96d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:52.028957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e504a-e423-406d-a671-6c208a96d7e9 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:52.030825 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 20/40] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:35:52.036888 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fcde6-faa9-4eb6-9886-b04c2cbbcc3d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:52.037194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fcde6-faa9-4eb6-9886-b04c2cbbcc3d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:52.037463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fcde6-faa9-4eb6-9886-b04c2cbbcc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:52.126449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe93a2-9678-4bd3-8b9b-781a6e9e0829 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:52.126827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe93a2-9678-4bd3-8b9b-781a6e9e0829 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:52.127031 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe93a2-9678-4bd3-8b9b-781a6e9e0829 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:52.128662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 21/41] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:35:52.134383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8df3c-1bd0-4af8-8ba0-a3adddf4c554 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:52.134684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8df3c-1bd0-4af8-8ba0-a3adddf4c554 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:52.134947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8df3c-1bd0-4af8-8ba0-a3adddf4c554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:52.153637 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-7cd8df3c-1bd0-4af8-8ba0-a3adddf4c554 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:52.155255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7cd8df3c-1bd0-4af8-8ba0-a3adddf4c554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:52.166022 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-6f3fcde6-faa9-4eb6-9886-b04c2cbbcc3d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:52.167554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6f3fcde6-faa9-4eb6-9886-b04c2cbbcc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:52.209623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:52.240258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 22/42] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:35:52.242926 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:35:52.262850 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8df3c-1bd0-4af8-8ba0-a3adddf4c554 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:52.265486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fcde6-faa9-4eb6-9886-b04c2cbbcc3d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:52.338479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:52.372354 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fcde6-faa9-4eb6-9886-b04c2cbbcc3d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:52.374000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8df3c-1bd0-4af8-8ba0-a3adddf4c554 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:52.409605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f3359-2d1f-499a-8bdd-9ac7ca9781e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:52.410295 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f3359-2d1f-499a-8bdd-9ac7ca9781e9 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:52.410586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f3359-2d1f-499a-8bdd-9ac7ca9781e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:52.410867 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f3359-2d1f-499a-8bdd-9ac7ca9781e9 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:52.411631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f3359-2d1f-499a-8bdd-9ac7ca9781e9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:52.413341 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f3359-2d1f-499a-8bdd-9ac7ca9781e9 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:52.415018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab18d8-f08c-4979-9cdb-1985a4291b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:52.416212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab18d8-f08c-4979-9cdb-1985a4291b77 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:52.416739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab18d8-f08c-4979-9cdb-1985a4291b77 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:52.417221 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab18d8-f08c-4979-9cdb-1985a4291b77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:52.419069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab18d8-f08c-4979-9cdb-1985a4291b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:52.420695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab18d8-f08c-4979-9cdb-1985a4291b77 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:52.423181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 23/44] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:35:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:52.428113 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab18d8-f08c-4979-9cdb-1985a4291b77 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:52.433406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Jul 11 15:35:52 2022] POST /identity/v3/roles => generated 223 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:35:52.654581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab18d8-f08c-4979-9cdb-1985a4291b77 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:52.688045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae920e68-1510-45b7-becd-44d14c8e0ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:52.688741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae920e68-1510-45b7-becd-44d14c8e0ca9 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:52.689029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae920e68-1510-45b7-becd-44d14c8e0ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:52.689307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae920e68-1510-45b7-becd-44d14c8e0ca9 None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:52.690041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae920e68-1510-45b7-becd-44d14c8e0ca9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:52.691537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae920e68-1510-45b7-becd-44d14c8e0ca9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:52.699822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:52.719177 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Jul 11 15:35:52 2022] POST /identity/v3/projects => generated 312 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:35:53.942755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d9d0f-376e-4859-9add-4f84f31f88af None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:53.943298 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d9d0f-376e-4859-9add-4f84f31f88af None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:53.943298 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d9d0f-376e-4859-9add-4f84f31f88af None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:53.944752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 23/47] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:35:53.950226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54991fdd-071e-4a11-a9d3-fe8ef3e6f0da None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:53.950633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54991fdd-071e-4a11-a9d3-fe8ef3e6f0da None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:53.950763 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54991fdd-071e-4a11-a9d3-fe8ef3e6f0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:53.971575 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-54991fdd-071e-4a11-a9d3-fe8ef3e6f0da None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:53.972793 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-54991fdd-071e-4a11-a9d3-fe8ef3e6f0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:54.042110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:35:54.064751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d9d0f-376e-4859-9add-4f84f31f88af None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:54.100206 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:54.173561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d9d0f-376e-4859-9add-4f84f31f88af None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:54.210697 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d1ac3-8e2a-48bb-a2e7-72af1b5e05ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:54.211440 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d1ac3-8e2a-48bb-a2e7-72af1b5e05ca None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:54.211762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d1ac3-8e2a-48bb-a2e7-72af1b5e05ca None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:54.212383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d1ac3-8e2a-48bb-a2e7-72af1b5e05ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:54.222955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d1ac3-8e2a-48bb-a2e7-72af1b5e05ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-203d1ac3-8e2a-48bb-a2e7-72af1b5e05ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:35:54.230579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:35:54.231462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:35:54.232310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:35:54.232310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:35:54.232310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:35:54.232310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:35:54.232310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:35:54.232310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:35:54.232310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:35:54.232310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:35:54.232310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:35:54.232310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:35:54.232310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:35:54.232310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:35:54.232310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 24/49] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:35:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:35:54.237952 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54991fdd-071e-4a11-a9d3-fe8ef3e6f0da None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:54.340017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54991fdd-071e-4a11-a9d3-fe8ef3e6f0da None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:54.368112 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:54.383602 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab3fda-b3cd-4f34-922d-97e1e04f415e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:54.384282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3fda-b3cd-4f34-922d-97e1e04f415e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:54.384593 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3fda-b3cd-4f34-922d-97e1e04f415e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:54.384870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3fda-b3cd-4f34-922d-97e1e04f415e None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:54.385638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab3fda-b3cd-4f34-922d-97e1e04f415e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:35:54.385947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab3fda-b3cd-4f34-922d-97e1e04f415e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:54.387333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab3fda-b3cd-4f34-922d-97e1e04f415e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:54.395956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 26/50] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:35:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:54.401537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d1ac3-8e2a-48bb-a2e7-72af1b5e05ca None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:54.494789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:54.504472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d1ac3-8e2a-48bb-a2e7-72af1b5e05ca None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:54.538636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e112f9-d7ad-4d33-a81c-73ed6a71e5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:54.539511 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e112f9-d7ad-4d33-a81c-73ed6a71e5b5 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:54.539793 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e112f9-d7ad-4d33-a81c-73ed6a71e5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:54.540072 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e112f9-d7ad-4d33-a81c-73ed6a71e5b5 None admin] PATH_INFO: `/v3/users/db61f34a47204afa92fb860bcaecb5da` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:54.541335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e112f9-d7ad-4d33-a81c-73ed6a71e5b5 None admin] RBAC: Authorizing `identity:get_user(user_id=db61f34a47204afa92fb860bcaecb5da)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:54.542800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e112f9-d7ad-4d33-a81c-73ed6a71e5b5 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:54.544458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 25/51] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:35:54 2022] GET /identity/v3/users/db61f34a47204afa92fb860bcaecb5da => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:54.550026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab3fda-b3cd-4f34-922d-97e1e04f415e None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:54.658223 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab3fda-b3cd-4f34-922d-97e1e04f415e None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:54.693889 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e023c8-1bdd-463d-8b83-669dfe35cfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:54.694687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e023c8-1bdd-463d-8b83-669dfe35cfeb None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:54.694974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e023c8-1bdd-463d-8b83-669dfe35cfeb None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:54.695257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e023c8-1bdd-463d-8b83-669dfe35cfeb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:54.696605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e023c8-1bdd-463d-8b83-669dfe35cfeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:54.697492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947e383-8616-4d72-a540-5d24cc51f527 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:54.697783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947e383-8616-4d72-a540-5d24cc51f527 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:54.698062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947e383-8616-4d72-a540-5d24cc51f527 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:54.698190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e023c8-1bdd-463d-8b83-669dfe35cfeb None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:54.699432 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 26/52] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:35:54.699781 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:35:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:54.704517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedfa97-4508-42e6-8507-e5ace9049d37 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:54.704810 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedfa97-4508-42e6-8507-e5ace9049d37 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:54.705088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedfa97-4508-42e6-8507-e5ace9049d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:54.705178 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e023c8-1bdd-463d-8b83-669dfe35cfeb None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:54.722623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-4fedfa97-4508-42e6-8507-e5ace9049d37 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:54.723830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4fedfa97-4508-42e6-8507-e5ace9049d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:54.756343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:54.793323 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 27/54] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:35:54.807259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e023c8-1bdd-463d-8b83-669dfe35cfeb None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:54.816111 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedfa97-4508-42e6-8507-e5ace9049d37 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:54.841046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24424c9e-1fa5-435e-bdd4-4c675d8c7f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:54.841707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24424c9e-1fa5-435e-bdd4-4c675d8c7f27 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:54.841987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24424c9e-1fa5-435e-bdd4-4c675d8c7f27 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:54.842261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24424c9e-1fa5-435e-bdd4-4c675d8c7f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:54.843106 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24424c9e-1fa5-435e-bdd4-4c675d8c7f27 None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.domain.id=default, user.id=db61f34a47204afa92fb860bcaecb5da) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:35:54.843415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24424c9e-1fa5-435e-bdd4-4c675d8c7f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:54.844942 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24424c9e-1fa5-435e-bdd4-4c675d8c7f27 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:54.853494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1322 bytes} [Mon Jul 11 15:35:54 2022] GET /identity/v3/role_assignments?user.id=db61f34a47204afa92fb860bcaecb5da&scope.domain.id=default&role.id=32f5ce5800cf40d99d894960288d0155 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:35:54.909973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:54.920729 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedfa97-4508-42e6-8507-e5ace9049d37 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:54.960470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f30f2-5b6d-440f-953c-08d4b7ca20d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:54.961346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f30f2-5b6d-440f-953c-08d4b7ca20d4 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:54.961636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f30f2-5b6d-440f-953c-08d4b7ca20d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:54.961910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f30f2-5b6d-440f-953c-08d4b7ca20d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:54.963475 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f30f2-5b6d-440f-953c-08d4b7ca20d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:54.965006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f30f2-5b6d-440f-953c-08d4b7ca20d4 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:54.966749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 28/56] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:35:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:35:54.972981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24424c9e-1fa5-435e-bdd4-4c675d8c7f27 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:55.083158 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24424c9e-1fa5-435e-bdd4-4c675d8c7f27 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:55.097243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:55.118789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e220352-9263-4c7b-82c8-a89d3c6c4353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:55.119469 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e220352-9263-4c7b-82c8-a89d3c6c4353 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:55.119756 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e220352-9263-4c7b-82c8-a89d3c6c4353 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:55.120034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e220352-9263-4c7b-82c8-a89d3c6c4353 None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:55.120815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e220352-9263-4c7b-82c8-a89d3c6c4353 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:55.122307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e220352-9263-4c7b-82c8-a89d3c6c4353 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:55.149985 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 29/57] 10.222.0.26 () {60 vars in 1140 bytes} [Mon Jul 11 15:35:54 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:35:57.163265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eae0fc-f2d6-4966-9707-ac8cacc05a10 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.164091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eae0fc-f2d6-4966-9707-ac8cacc05a10 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.164091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eae0fc-f2d6-4966-9707-ac8cacc05a10 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.166398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 29/58] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:35:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:35:57.174324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279b499-42b7-4a7c-b5b5-c64bbd4a1a32 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.174743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279b499-42b7-4a7c-b5b5-c64bbd4a1a32 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.174902 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279b499-42b7-4a7c-b5b5-c64bbd4a1a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.193619 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-7279b499-42b7-4a7c-b5b5-c64bbd4a1a32 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:35:57.194854 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7279b499-42b7-4a7c-b5b5-c64bbd4a1a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:35:57.272633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 30/59] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:35:57.296822 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eae0fc-f2d6-4966-9707-ac8cacc05a10 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:57.427318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eae0fc-f2d6-4966-9707-ac8cacc05a10 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:57.468627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f2bfa-7154-4552-ba3d-ba0a1fc80ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:57.469462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f2bfa-7154-4552-ba3d-ba0a1fc80ee2 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.469746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f2bfa-7154-4552-ba3d-ba0a1fc80ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.470024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f2bfa-7154-4552-ba3d-ba0a1fc80ee2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.471251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f2bfa-7154-4552-ba3d-ba0a1fc80ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:57.472768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f2bfa-7154-4552-ba3d-ba0a1fc80ee2 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:57.474437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 30/60] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:35:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:35:57.482684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279b499-42b7-4a7c-b5b5-c64bbd4a1a32 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:35:57.582431 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:35:57.592244 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279b499-42b7-4a7c-b5b5-c64bbd4a1a32 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:35:57.649089 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbac35-b0d6-4b78-a927-5c0aec76b692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:35:57.650076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbac35-b0d6-4b78-a927-5c0aec76b692 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:35:57.650454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbac35-b0d6-4b78-a927-5c0aec76b692 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:35:57.650817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbac35-b0d6-4b78-a927-5c0aec76b692 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:35:57.651890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbac35-b0d6-4b78-a927-5c0aec76b692 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:35:57.654261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbac35-b0d6-4b78-a927-5c0aec76b692 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:35:57.683528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 31/61] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:35:57 2022] POST /identity/v3/users => generated 275 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:00.857525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865ff2e-c8fe-4171-9de7-c3104cc9da55 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:00.858069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865ff2e-c8fe-4171-9de7-c3104cc9da55 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:00.858069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865ff2e-c8fe-4171-9de7-c3104cc9da55 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:00.859470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 31/62] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:00.873035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2818-2c25-44f6-8dbf-74dfaafab6a3 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:00.873983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2818-2c25-44f6-8dbf-74dfaafab6a3 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:00.874483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2818-2c25-44f6-8dbf-74dfaafab6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:00.895454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-865a2818-2c25-44f6-8dbf-74dfaafab6a3 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:00.896998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-865a2818-2c25-44f6-8dbf-74dfaafab6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:00.926640 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369411a4-f0e7-4727-a92d-3974a8ff65cd None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:00.927278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369411a4-f0e7-4727-a92d-3974a8ff65cd None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:00.927770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369411a4-f0e7-4727-a92d-3974a8ff65cd None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:00.929799 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:00.935441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be76dd-c341-4141-9231-f6cabb846f0d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:00.935990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be76dd-c341-4141-9231-f6cabb846f0d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:00.936518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be76dd-c341-4141-9231-f6cabb846f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:00.973339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-f1be76dd-c341-4141-9231-f6cabb846f0d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:00.974903 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-f1be76dd-c341-4141-9231-f6cabb846f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:00.982499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 32/64] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:01.016717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:01.023518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a2818-2c25-44f6-8dbf-74dfaafab6a3 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:01.117854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 33/65] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:01.137937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be76dd-c341-4141-9231-f6cabb846f0d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:01.168028 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:01.188218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a2818-2c25-44f6-8dbf-74dfaafab6a3 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:01.228091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f2abb-6fa4-4881-8ddb-31d259e49b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:01.229015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f2abb-6fa4-4881-8ddb-31d259e49b59 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:01.229368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f2abb-6fa4-4881-8ddb-31d259e49b59 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:01.229714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f2abb-6fa4-4881-8ddb-31d259e49b59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:01.242969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f2abb-6fa4-4881-8ddb-31d259e49b59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-290f2abb-6fa4-4881-8ddb-31d259e49b59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:01.253398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:01.254479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:01.255534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:01.255534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:01.255534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:01.255534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:01.255534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:01.255534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:01.255534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:01.255534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:01.255534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:01.255534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:01.255534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:01.255534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:01.257201 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 33/66] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:36:01.258917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cbff8-c4b7-4c3a-a125-9b7dd6e1fc62 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:01.259376 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cbff8-c4b7-4c3a-a125-9b7dd6e1fc62 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:01.259983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cbff8-c4b7-4c3a-a125-9b7dd6e1fc62 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:01.262118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 34/67] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:01.263683 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be76dd-c341-4141-9231-f6cabb846f0d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:01.268542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cbff8-c4b7-4c3a-a125-9b7dd6e1fc62 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:01.307430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd8bfe-3866-4a24-8a55-07f30812d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:01.308581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd8bfe-3866-4a24-8a55-07f30812d53d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:01.309165 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd8bfe-3866-4a24-8a55-07f30812d53d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:01.309550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd8bfe-3866-4a24-8a55-07f30812d53d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:01.322471 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd8bfe-3866-4a24-8a55-07f30812d53d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-d4dd8bfe-3866-4a24-8a55-07f30812d53d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:01.331163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:01.332013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:01.332809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:01.332809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:01.332809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:01.332809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:01.332809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:01.332809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:01.332809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:01.332809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:01.332809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:01.332809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:01.332809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:01.332809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:01.335172 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 34/68] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:36:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:36:01.336628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79339d-24f6-4f79-be4d-d9eb17adb062 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:01.337454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79339d-24f6-4f79-be4d-d9eb17adb062 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:01.337921 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79339d-24f6-4f79-be4d-d9eb17adb062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:01.356101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-8d79339d-24f6-4f79-be4d-d9eb17adb062 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:01.357642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8d79339d-24f6-4f79-be4d-d9eb17adb062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:01.369872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:01.401302 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cbff8-c4b7-4c3a-a125-9b7dd6e1fc62 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:01.433272 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 35/69] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:01.434186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79339d-24f6-4f79-be4d-d9eb17adb062 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:01.439014 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c820b3b-aa48-4a23-a2e3-c582a803fcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:01.439695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c820b3b-aa48-4a23-a2e3-c582a803fcc8 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:01.439978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c820b3b-aa48-4a23-a2e3-c582a803fcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:01.440232 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c820b3b-aa48-4a23-a2e3-c582a803fcc8 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:01.441070 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c820b3b-aa48-4a23-a2e3-c582a803fcc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:01.441379 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c820b3b-aa48-4a23-a2e3-c582a803fcc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:01.443298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c820b3b-aa48-4a23-a2e3-c582a803fcc8 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:01.458669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 35/70] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:01.458669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b842-2270-4728-9dd4-09344ece2405 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:01.458669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b842-2270-4728-9dd4-09344ece2405 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:01.458669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b842-2270-4728-9dd4-09344ece2405 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:01.458669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 36/71] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:01.458669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8faab-cd70-4542-99c8-491b6929ccbf None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:01.459124 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8faab-cd70-4542-99c8-491b6929ccbf None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:01.459496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8faab-cd70-4542-99c8-491b6929ccbf None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:01.460841 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 37/72] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:01.461328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8faab-cd70-4542-99c8-491b6929ccbf None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:01.466035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:01.536543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79339d-24f6-4f79-be4d-d9eb17adb062 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:01.562846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8faab-cd70-4542-99c8-491b6929ccbf None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:01.568892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcb165-fc5c-49f8-9b5b-ccd9ffdd7e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:01.569569 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcb165-fc5c-49f8-9b5b-ccd9ffdd7e4b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:01.569891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcb165-fc5c-49f8-9b5b-ccd9ffdd7e4b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:01.570169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcb165-fc5c-49f8-9b5b-ccd9ffdd7e4b None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:01.570928 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcb165-fc5c-49f8-9b5b-ccd9ffdd7e4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:01.571235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcb165-fc5c-49f8-9b5b-ccd9ffdd7e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:01.572662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcb165-fc5c-49f8-9b5b-ccd9ffdd7e4b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:01.580657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:01.585375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcb165-fc5c-49f8-9b5b-ccd9ffdd7e4b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:01.596146 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:01.598319 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216f329-c319-4505-9303-8e57b03e99e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:01.599135 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216f329-c319-4505-9303-8e57b03e99e8 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:01.599419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216f329-c319-4505-9303-8e57b03e99e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:01.599691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216f329-c319-4505-9303-8e57b03e99e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:01.610230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216f329-c319-4505-9303-8e57b03e99e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-e216f329-c319-4505-9303-8e57b03e99e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:01.618237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:01.619096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:01.619848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:01.619848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:01.619848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:01.619848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:01.619848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:01.619848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:01.619848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:01.619848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:01.619848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:01.619848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:01.619848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:01.619848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:01.619848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 38/74] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:36:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:01.620716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17731dca-1821-4c18-887a-2c56de56f6cf None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:01.620961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17731dca-1821-4c18-887a-2c56de56f6cf None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:01.621226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17731dca-1821-4c18-887a-2c56de56f6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:01.639205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-17731dca-1821-4c18-887a-2c56de56f6cf None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:01.640437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-17731dca-1821-4c18-887a-2c56de56f6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:01.688478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcb165-fc5c-49f8-9b5b-ccd9ffdd7e4b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:01.699047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:01.708002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 39/75] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:01.718409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09103e6-b39b-4090-8b06-f5e1a31153c6 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:01.718409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09103e6-b39b-4090-8b06-f5e1a31153c6 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:01.718409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09103e6-b39b-4090-8b06-f5e1a31153c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:01.722463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c668847-ca4e-4741-9108-3cd204dbc31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:01.724161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668847-ca4e-4741-9108-3cd204dbc31e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:01.724477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668847-ca4e-4741-9108-3cd204dbc31e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:01.724745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668847-ca4e-4741-9108-3cd204dbc31e None admin] PATH_INFO: `/v3/users/97b256ba96b24fd2b1c4c5c238befca3` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:01.734622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-b09103e6-b39b-4090-8b06-f5e1a31153c6 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:01.735892 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b09103e6-b39b-4090-8b06-f5e1a31153c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:01.738572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c668847-ca4e-4741-9108-3cd204dbc31e None admin] RBAC: Authorizing `identity:get_user(user_id=97b256ba96b24fd2b1c4c5c238befca3)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:01.740066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c668847-ca4e-4741-9108-3cd204dbc31e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:01.744403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 37/76] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:01 2022] GET /identity/v3/users/97b256ba96b24fd2b1c4c5c238befca3 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:01.744403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c668847-ca4e-4741-9108-3cd204dbc31e None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:01.802368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 40/77] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:01.803231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09103e6-b39b-4090-8b06-f5e1a31153c6 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:01.818506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:01.854380 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c668847-ca4e-4741-9108-3cd204dbc31e None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:01.887622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6adca5-b306-4c17-b1cd-4f155875e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:01.888472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6adca5-b306-4c17-b1cd-4f155875e10c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:01.888757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6adca5-b306-4c17-b1cd-4f155875e10c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:01.889027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6adca5-b306-4c17-b1cd-4f155875e10c None admin] PATH_INFO: `/v3/users/db61f34a47204afa92fb860bcaecb5da` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:01.890263 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6adca5-b306-4c17-b1cd-4f155875e10c None admin] RBAC: Authorizing `identity:get_user(user_id=db61f34a47204afa92fb860bcaecb5da)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:01.891960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6adca5-b306-4c17-b1cd-4f155875e10c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:01.893656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 38/78] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:01 2022] GET /identity/v3/users/db61f34a47204afa92fb860bcaecb5da => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:01.894429 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6adca5-b306-4c17-b1cd-4f155875e10c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:01.904870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09103e6-b39b-4090-8b06-f5e1a31153c6 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:01.928955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:01.940262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e5873-8f6b-4f2e-85ab-ecaaaf99185b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:01.941018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5873-8f6b-4f2e-85ab-ecaaaf99185b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:01.941269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5873-8f6b-4f2e-85ab-ecaaaf99185b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:01.941548 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5873-8f6b-4f2e-85ab-ecaaaf99185b None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:01.942327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e5873-8f6b-4f2e-85ab-ecaaaf99185b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:01.942641 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e5873-8f6b-4f2e-85ab-ecaaaf99185b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:01.944068 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e5873-8f6b-4f2e-85ab-ecaaaf99185b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:01.952234 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 41/79] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:01.957357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e5873-8f6b-4f2e-85ab-ecaaaf99185b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:01.994292 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6adca5-b306-4c17-b1cd-4f155875e10c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:02.027596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df99e68-cfdc-4e8e-91b6-71ebb362e851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:02.028465 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df99e68-cfdc-4e8e-91b6-71ebb362e851 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:02.028749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df99e68-cfdc-4e8e-91b6-71ebb362e851 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:02.029030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df99e68-cfdc-4e8e-91b6-71ebb362e851 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:02.030233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df99e68-cfdc-4e8e-91b6-71ebb362e851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:02.031766 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df99e68-cfdc-4e8e-91b6-71ebb362e851 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:02.033453 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 39/80] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:02.038618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df99e68-cfdc-4e8e-91b6-71ebb362e851 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:02.041665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:02.054688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e5873-8f6b-4f2e-85ab-ecaaaf99185b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:02.088184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95399ec8-05bb-404d-a5f2-37a5219122ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:02.088853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95399ec8-05bb-404d-a5f2-37a5219122ef None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:02.089157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95399ec8-05bb-404d-a5f2-37a5219122ef None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:02.089440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95399ec8-05bb-404d-a5f2-37a5219122ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:02.138046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df99e68-cfdc-4e8e-91b6-71ebb362e851 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:02.144684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:02.158255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95399ec8-05bb-404d-a5f2-37a5219122ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:02.159758 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95399ec8-05bb-404d-a5f2-37a5219122ef None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:02.171009 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922b71c-7b53-4a6e-8f53-bcc742d34925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:02.171811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922b71c-7b53-4a6e-8f53-bcc742d34925 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:02.172093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922b71c-7b53-4a6e-8f53-bcc742d34925 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:02.172440 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922b71c-7b53-4a6e-8f53-bcc742d34925 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:02.182224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922b71c-7b53-4a6e-8f53-bcc742d34925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-d922b71c-7b53-4a6e-8f53-bcc742d34925 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:02.190006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:02.190872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:02.191624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:02.191624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:02.191624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:02.191624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:02.191624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:02.191624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:02.191624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:02.191624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:02.191624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:02.191624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:02.191624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:02.191624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:02.191624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 40/81] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:02.192242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922b71c-7b53-4a6e-8f53-bcc742d34925 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:02.258613 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:02.264985 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 42/82] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:02.266026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95399ec8-05bb-404d-a5f2-37a5219122ef None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:02.302210 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922b71c-7b53-4a6e-8f53-bcc742d34925 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:02.335089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aee42-ffb0-4bf9-9d2e-4d711d7e5398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:02.335763 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aee42-ffb0-4bf9-9d2e-4d711d7e5398 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:02.336043 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aee42-ffb0-4bf9-9d2e-4d711d7e5398 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:02.336323 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aee42-ffb0-4bf9-9d2e-4d711d7e5398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:02.350746 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:02.365864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95399ec8-05bb-404d-a5f2-37a5219122ef None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:02.399441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4c155-7f21-4666-b768-755fbd99c18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:02.400247 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4c155-7f21-4666-b768-755fbd99c18c None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:02.400556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4c155-7f21-4666-b768-755fbd99c18c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:02.400830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4c155-7f21-4666-b768-755fbd99c18c None admin] PATH_INFO: `/v3/users/97b256ba96b24fd2b1c4c5c238befca3` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:02.402260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4c155-7f21-4666-b768-755fbd99c18c None admin] RBAC: Authorizing `identity:get_user(user_id=97b256ba96b24fd2b1c4c5c238befca3)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:02.403738 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4c155-7f21-4666-b768-755fbd99c18c None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:02.405368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aee42-ffb0-4bf9-9d2e-4d711d7e5398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:02.405461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 43/83] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:02 2022] GET /identity/v3/users/97b256ba96b24fd2b1c4c5c238befca3 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:02.406144 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4c155-7f21-4666-b768-755fbd99c18c None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:02.406897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aee42-ffb0-4bf9-9d2e-4d711d7e5398 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:02.466125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:02.506290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 41/84] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:02.507129 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aee42-ffb0-4bf9-9d2e-4d711d7e5398 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:02.507298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4c155-7f21-4666-b768-755fbd99c18c None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:02.542344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dc67b-64da-4b10-af9f-773d0fad49fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:02.543025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dc67b-64da-4b10-af9f-773d0fad49fc None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:02.543311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dc67b-64da-4b10-af9f-773d0fad49fc None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:02.543588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dc67b-64da-4b10-af9f-773d0fad49fc None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:02.544348 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0dc67b-64da-4b10-af9f-773d0fad49fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:02.545822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0dc67b-64da-4b10-af9f-773d0fad49fc None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:02.565613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 44/85] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:36:02 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:02.577441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dc67b-64da-4b10-af9f-773d0fad49fc None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:02.591727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:02.611664 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aee42-ffb0-4bf9-9d2e-4d711d7e5398 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:02.652343 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b3915-21df-4c83-9945-8f091662b70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:02.653039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b3915-21df-4c83-9945-8f091662b70e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:02.653240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b3915-21df-4c83-9945-8f091662b70e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:02.653506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b3915-21df-4c83-9945-8f091662b70e None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:02.654277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b3915-21df-4c83-9945-8f091662b70e None admin] RBAC: Adding query filter params (name=member) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:02.654585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b3915-21df-4c83-9945-8f091662b70e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:02.656064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b3915-21df-4c83-9945-8f091662b70e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:02.665904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 42/86] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:02.666783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b3915-21df-4c83-9945-8f091662b70e None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:02.694062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:02.701142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dc67b-64da-4b10-af9f-773d0fad49fc None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:02.743596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995f3fd-d168-48c7-bca8-27bdf4574454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:02.744558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995f3fd-d168-48c7-bca8-27bdf4574454 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:02.744853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995f3fd-d168-48c7-bca8-27bdf4574454 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:02.745265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995f3fd-d168-48c7-bca8-27bdf4574454 None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:02.746455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995f3fd-d168-48c7-bca8-27bdf4574454 None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:02.747934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995f3fd-d168-48c7-bca8-27bdf4574454 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:02.749887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 45/87] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:02 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:02.750523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995f3fd-d168-48c7-bca8-27bdf4574454 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:02.787107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b3915-21df-4c83-9945-8f091662b70e None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:02.834616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e9493-20d2-4e43-9b6d-d6217f1fe523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:02.835399 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e9493-20d2-4e43-9b6d-d6217f1fe523 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:02.835765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e9493-20d2-4e43-9b6d-d6217f1fe523 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:02.836440 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e9493-20d2-4e43-9b6d-d6217f1fe523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:02.850677 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:02.878994 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995f3fd-d168-48c7-bca8-27bdf4574454 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:02.918428 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484d5b2-648d-4a4a-b690-bf4fa692eb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:02.919304 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484d5b2-648d-4a4a-b690-bf4fa692eb96 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:02.919590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484d5b2-648d-4a4a-b690-bf4fa692eb96 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:02.919864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484d5b2-648d-4a4a-b690-bf4fa692eb96 None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:02.921579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484d5b2-648d-4a4a-b690-bf4fa692eb96 None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:02.923122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484d5b2-648d-4a4a-b690-bf4fa692eb96 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:02.928009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 46/88] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:02 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:02.928970 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484d5b2-648d-4a4a-b690-bf4fa692eb96 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:02.936068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e9493-20d2-4e43-9b6d-d6217f1fe523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:02.937654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e9493-20d2-4e43-9b6d-d6217f1fe523 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:02.965650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:03.044010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484d5b2-648d-4a4a-b690-bf4fa692eb96 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:03.046791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 43/89] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:03.047776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e9493-20d2-4e43-9b6d-d6217f1fe523 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:03.081386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4486a6-21aa-4885-988b-74d2b53830bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:03.082272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4486a6-21aa-4885-988b-74d2b53830bd None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:03.082557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4486a6-21aa-4885-988b-74d2b53830bd None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:03.082834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4486a6-21aa-4885-988b-74d2b53830bd None admin] PATH_INFO: `/v3/users/97b256ba96b24fd2b1c4c5c238befca3` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:03.084248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4486a6-21aa-4885-988b-74d2b53830bd None admin] RBAC: Authorizing `identity:get_user(user_id=97b256ba96b24fd2b1c4c5c238befca3)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:03.085742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4486a6-21aa-4885-988b-74d2b53830bd None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:03.088062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 47/90] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:02 2022] GET /identity/v3/users/97b256ba96b24fd2b1c4c5c238befca3 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:03.088993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4486a6-21aa-4885-988b-74d2b53830bd None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:03.105952 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:03.156878 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e9493-20d2-4e43-9b6d-d6217f1fe523 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:03.181611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:03.198453 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb6afd-dd11-4424-a43c-b50dedb04af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:03.199425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb6afd-dd11-4424-a43c-b50dedb04af0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:03.199718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb6afd-dd11-4424-a43c-b50dedb04af0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:03.199998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb6afd-dd11-4424-a43c-b50dedb04af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:03.201586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb6afd-dd11-4424-a43c-b50dedb04af0 None admin] RBAC: Adding query filter params (role.id=7df8c80cd6f643d6aa8ecd8281781a3f, scope.project.id=8cacd9253675421d9d915794d90317e4, user.id=97b256ba96b24fd2b1c4c5c238befca3) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:03.201914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb6afd-dd11-4424-a43c-b50dedb04af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:03.204032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb6afd-dd11-4424-a43c-b50dedb04af0 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:03.209749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4486a6-21aa-4885-988b-74d2b53830bd None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:03.210877 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 44/91] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:03 2022] GET /identity/v3/role_assignments?user.id=97b256ba96b24fd2b1c4c5c238befca3&scope.project.id=8cacd9253675421d9d915794d90317e4&role.id=7df8c80cd6f643d6aa8ecd8281781a3f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:03.213161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb6afd-dd11-4424-a43c-b50dedb04af0 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:03.307150 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009d66b-3439-4d95-968e-a4f969301b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:03.307843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009d66b-3439-4d95-968e-a4f969301b51 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:03.308138 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009d66b-3439-4d95-968e-a4f969301b51 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:03.308448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009d66b-3439-4d95-968e-a4f969301b51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:03.309593 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009d66b-3439-4d95-968e-a4f969301b51 None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=8cacd9253675421d9d915794d90317e4, user.id=db61f34a47204afa92fb860bcaecb5da) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:03.311423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009d66b-3439-4d95-968e-a4f969301b51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:03.313082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009d66b-3439-4d95-968e-a4f969301b51 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:03.326910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 48/92] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:03 2022] GET /identity/v3/role_assignments?user.id=db61f34a47204afa92fb860bcaecb5da&scope.project.id=8cacd9253675421d9d915794d90317e4&role.id=32f5ce5800cf40d99d894960288d0155 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:03.329353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009d66b-3439-4d95-968e-a4f969301b51 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:03.377674 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb6afd-dd11-4424-a43c-b50dedb04af0 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:03.436016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39c08b-4fcd-4e7d-b2c6-ed0b5015a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:03.436862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c08b-4fcd-4e7d-b2c6-ed0b5015a1e7 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:03.437147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c08b-4fcd-4e7d-b2c6-ed0b5015a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:03.437436 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c08b-4fcd-4e7d-b2c6-ed0b5015a1e7 None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:03.438788 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39c08b-4fcd-4e7d-b2c6-ed0b5015a1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:03.444383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39c08b-4fcd-4e7d-b2c6-ed0b5015a1e7 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:03.446811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 45/93] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:03 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:03.452356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39c08b-4fcd-4e7d-b2c6-ed0b5015a1e7 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:03.492985 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:03.544665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:03.550346 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009d66b-3439-4d95-968e-a4f969301b51 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:03.608993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b1831-90bf-42dd-a03e-e5375512d0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:03.609693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b1831-90bf-42dd-a03e-e5375512d0ca None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:03.609984 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b1831-90bf-42dd-a03e-e5375512d0ca None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:03.610258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b1831-90bf-42dd-a03e-e5375512d0ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:03.650516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39c08b-4fcd-4e7d-b2c6-ed0b5015a1e7 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:03.739829 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b1831-90bf-42dd-a03e-e5375512d0ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:03.741376 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b1831-90bf-42dd-a03e-e5375512d0ca None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:03.741974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc841f6f-bc85-4c52-92a4-238cd4e2571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:03.742866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc841f6f-bc85-4c52-92a4-238cd4e2571a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:03.743349 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc841f6f-bc85-4c52-92a4-238cd4e2571a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:03.743814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc841f6f-bc85-4c52-92a4-238cd4e2571a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:03.744879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc841f6f-bc85-4c52-92a4-238cd4e2571a None admin] RBAC: Adding query filter params (role.id=49eaa4df59ae423fa6913302fe982e4e, scope.project.id=8cacd9253675421d9d915794d90317e4, user.id=97b256ba96b24fd2b1c4c5c238befca3) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:03.745413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc841f6f-bc85-4c52-92a4-238cd4e2571a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:03.747063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc841f6f-bc85-4c52-92a4-238cd4e2571a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:03.762384 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 46/94] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:03 2022] GET /identity/v3/role_assignments?user.id=97b256ba96b24fd2b1c4c5c238befca3&scope.project.id=8cacd9253675421d9d915794d90317e4&role.id=49eaa4df59ae423fa6913302fe982e4e => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:03.846610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:03.873298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 49/95] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:03.878990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc841f6f-bc85-4c52-92a4-238cd4e2571a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:03.990544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc841f6f-bc85-4c52-92a4-238cd4e2571a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:04.012003 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:04.027192 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea21bc-300b-432a-b490-fabb6ee919be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:04.028104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea21bc-300b-432a-b490-fabb6ee919be None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:04.028428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea21bc-300b-432a-b490-fabb6ee919be None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:04.028715 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea21bc-300b-432a-b490-fabb6ee919be None admin] PATH_INFO: `/v3/projects/d001c34473cd4907af59d6d6a0298af3` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:04.029974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea21bc-300b-432a-b490-fabb6ee919be None admin] RBAC: Authorizing `identity:get_project(project_id=d001c34473cd4907af59d6d6a0298af3)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:04.031741 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea21bc-300b-432a-b490-fabb6ee919be None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:04.033536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 47/96] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:03 2022] GET /identity/v3/projects/d001c34473cd4907af59d6d6a0298af3 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:04.039615 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b1831-90bf-42dd-a03e-e5375512d0ca None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:04.157667 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b1831-90bf-42dd-a03e-e5375512d0ca None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:04.211678 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99c4bf-2fcc-49c9-80c5-585cb446617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:04.212709 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99c4bf-2fcc-49c9-80c5-585cb446617b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:04.212993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99c4bf-2fcc-49c9-80c5-585cb446617b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:04.213269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99c4bf-2fcc-49c9-80c5-585cb446617b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:04.214134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99c4bf-2fcc-49c9-80c5-585cb446617b None admin] RBAC: Adding query filter params (role.id=7df8c80cd6f643d6aa8ecd8281781a3f, scope.project.id=d001c34473cd4907af59d6d6a0298af3, user.id=97b256ba96b24fd2b1c4c5c238befca3) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:04.214446 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99c4bf-2fcc-49c9-80c5-585cb446617b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:04.215917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99c4bf-2fcc-49c9-80c5-585cb446617b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:04.225223 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 50/97] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:04 2022] GET /identity/v3/role_assignments?user.id=97b256ba96b24fd2b1c4c5c238befca3&scope.project.id=d001c34473cd4907af59d6d6a0298af3&role.id=7df8c80cd6f643d6aa8ecd8281781a3f => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:05.597846 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8940b-9ba0-4545-be12-82f63348ba39 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:05.597846 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8940b-9ba0-4545-be12-82f63348ba39 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:05.597846 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8940b-9ba0-4545-be12-82f63348ba39 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:05.597846 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 48/98] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:05.603158 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51ed6-045d-4631-b81c-387a920ff339 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:05.603887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51ed6-045d-4631-b81c-387a920ff339 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:05.604318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51ed6-045d-4631-b81c-387a920ff339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:05.631034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-f9e51ed6-045d-4631-b81c-387a920ff339 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:05.632938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f9e51ed6-045d-4631-b81c-387a920ff339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:05.695341 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:05.749429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 51/99] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:05.808085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8940b-9ba0-4545-be12-82f63348ba39 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:05.811438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b6219-862f-47a2-bf61-c86e19860683 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:05.811854 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b6219-862f-47a2-bf61-c86e19860683 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:05.812220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b6219-862f-47a2-bf61-c86e19860683 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:05.814495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 52/100] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:05.823049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22757c48-65f1-4d7a-b946-7a0195bcaaed None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:05.823789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22757c48-65f1-4d7a-b946-7a0195bcaaed None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:05.824983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22757c48-65f1-4d7a-b946-7a0195bcaaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:05.855677 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-22757c48-65f1-4d7a-b946-7a0195bcaaed None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:05.856798 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-22757c48-65f1-4d7a-b946-7a0195bcaaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:05.943117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 53/101] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:05.994434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22757c48-65f1-4d7a-b946-7a0195bcaaed None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:06.065168 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8940b-9ba0-4545-be12-82f63348ba39 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:06.141230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c48a6c-8c4a-4050-84b6-be7f61ccb14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:06.141960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c48a6c-8c4a-4050-84b6-be7f61ccb14f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:06.142209 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c48a6c-8c4a-4050-84b6-be7f61ccb14f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:06.142648 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c48a6c-8c4a-4050-84b6-be7f61ccb14f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:06.157470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c48a6c-8c4a-4050-84b6-be7f61ccb14f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-90c48a6c-8c4a-4050-84b6-be7f61ccb14f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:06.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:06.174562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:06.175552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:06.175552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:06.175552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:06.175552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:06.175552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:06.175552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:06.175552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:06.175552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:06.175552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:06.175552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:06.175552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:06.175552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:06.176276 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22757c48-65f1-4d7a-b946-7a0195bcaaed None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:06.176649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:06.177874 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 49/102] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:06.189064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c48a6c-8c4a-4050-84b6-be7f61ccb14f None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:06.248372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476c626-daf7-42c1-97cc-13decc5d9dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:06.249421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476c626-daf7-42c1-97cc-13decc5d9dca None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:06.249865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476c626-daf7-42c1-97cc-13decc5d9dca None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:06.250509 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476c626-daf7-42c1-97cc-13decc5d9dca None admin] PATH_INFO: `/v3/domains/default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:06.252714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476c626-daf7-42c1-97cc-13decc5d9dca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:06.254687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476c626-daf7-42c1-97cc-13decc5d9dca None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:06.260975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 54/103] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:06.267998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476c626-daf7-42c1-97cc-13decc5d9dca None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:06.285878 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:06.384397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c48a6c-8c4a-4050-84b6-be7f61ccb14f None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:06.484952 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51526fa1-2288-427d-b84e-27266c76b9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:06.485917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51526fa1-2288-427d-b84e-27266c76b9be None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:06.486417 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51526fa1-2288-427d-b84e-27266c76b9be None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:06.486910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51526fa1-2288-427d-b84e-27266c76b9be None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:06.488365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51526fa1-2288-427d-b84e-27266c76b9be None admin] RBAC: Adding query filter params (name=reader) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:06.488927 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51526fa1-2288-427d-b84e-27266c76b9be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:06.491515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51526fa1-2288-427d-b84e-27266c76b9be None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:06.523365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 50/104] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:06.525680 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45241a0-fe6e-40ef-8fc8-f86a610eaa96 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:06.526184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45241a0-fe6e-40ef-8fc8-f86a610eaa96 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:06.526680 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45241a0-fe6e-40ef-8fc8-f86a610eaa96 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:06.534991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 51/105] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:06.544011 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476c626-daf7-42c1-97cc-13decc5d9dca None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:06.548058 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45241a0-fe6e-40ef-8fc8-f86a610eaa96 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:06.613213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40376634-ea5e-4685-9935-cbdc600c16fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:06.614060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40376634-ea5e-4685-9935-cbdc600c16fa None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:06.614408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40376634-ea5e-4685-9935-cbdc600c16fa None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:06.614748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40376634-ea5e-4685-9935-cbdc600c16fa None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:06.615658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40376634-ea5e-4685-9935-cbdc600c16fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:06.617976 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40376634-ea5e-4685-9935-cbdc600c16fa None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:06.673353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 55/106] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Jul 11 15:36:06 2022] POST /identity/v3/projects => generated 302 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:06.675069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415279f-5900-4e05-965c-fd3370bccdf3 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:06.675415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415279f-5900-4e05-965c-fd3370bccdf3 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:06.675748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415279f-5900-4e05-965c-fd3370bccdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:06.707843 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45241a0-fe6e-40ef-8fc8-f86a610eaa96 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:06.724676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:06.725141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-c415279f-5900-4e05-965c-fd3370bccdf3 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:06.726604 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c415279f-5900-4e05-965c-fd3370bccdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:06.752827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:06.752994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a1402-0381-4abd-b2e1-d37d95974ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:06.753786 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a1402-0381-4abd-b2e1-d37d95974ff8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:06.754084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a1402-0381-4abd-b2e1-d37d95974ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:06.754363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a1402-0381-4abd-b2e1-d37d95974ff8 None admin] PATH_INFO: `/v3/users/821bddf8fb1b40cf8223b9d1b829d0e8` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:06.782045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a1402-0381-4abd-b2e1-d37d95974ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=821bddf8fb1b40cf8223b9d1b829d0e8)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:06.783604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a1402-0381-4abd-b2e1-d37d95974ff8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:06.785579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 52/107] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:06 2022] GET /identity/v3/users/821bddf8fb1b40cf8223b9d1b829d0e8 => generated 289 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:06.806003 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a1402-0381-4abd-b2e1-d37d95974ff8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:06.850082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 56/108] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:06.891801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415279f-5900-4e05-965c-fd3370bccdf3 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:07.091259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415279f-5900-4e05-965c-fd3370bccdf3 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:07.119191 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a1402-0381-4abd-b2e1-d37d95974ff8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:07.138113 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94223108-1210-4aa9-add0-21269d57eeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:07.138952 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94223108-1210-4aa9-add0-21269d57eeef None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:07.139288 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94223108-1210-4aa9-add0-21269d57eeef None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:07.139564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94223108-1210-4aa9-add0-21269d57eeef None admin] PATH_INFO: `/v3/roles/member` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:07.151949 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94223108-1210-4aa9-add0-21269d57eeef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-94223108-1210-4aa9-add0-21269d57eeef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:07.160171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:07.161156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:07.161918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:07.161918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:07.161918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:07.161918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:07.161918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:07.161918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:07.161918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:07.161918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:07.161918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:07.161918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:07.161918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:07.161918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:07.161918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 57/109] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:36:07.163035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96918a5-5e43-4893-b3f9-2db02f41e506 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:07.163306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96918a5-5e43-4893-b3f9-2db02f41e506 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:07.163635 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96918a5-5e43-4893-b3f9-2db02f41e506 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:07.170039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 58/110] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:07.171564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be266b23-83c7-4d15-8cf0-61c4358d2a8a None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:07.171861 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be266b23-83c7-4d15-8cf0-61c4358d2a8a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:07.172339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be266b23-83c7-4d15-8cf0-61c4358d2a8a None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:07.173871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 59/111] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:07.178175 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be266b23-83c7-4d15-8cf0-61c4358d2a8a None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:07.180470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e46cf-dccd-4d0e-928d-68ae46618923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:07.181400 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e46cf-dccd-4d0e-928d-68ae46618923 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:07.181884 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e46cf-dccd-4d0e-928d-68ae46618923 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:07.182377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e46cf-dccd-4d0e-928d-68ae46618923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:07.202945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:07.229867 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:07.276351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e46cf-dccd-4d0e-928d-68ae46618923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:07.277918 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e46cf-dccd-4d0e-928d-68ae46618923 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:07.299500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be266b23-83c7-4d15-8cf0-61c4358d2a8a None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:07.339019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8abb0-7069-4228-af90-e17804fff02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:07.339700 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8abb0-7069-4228-af90-e17804fff02e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:07.339989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8abb0-7069-4228-af90-e17804fff02e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:07.340319 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8abb0-7069-4228-af90-e17804fff02e None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:07.341096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8abb0-7069-4228-af90-e17804fff02e None admin] RBAC: Adding query filter params (name=member) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:07.341569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8abb0-7069-4228-af90-e17804fff02e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:07.342941 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8abb0-7069-4228-af90-e17804fff02e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:07.356868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 60/112] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:07.356868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde1009-9b9c-4cf2-8892-b7460adcc0b1 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:07.356868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde1009-9b9c-4cf2-8892-b7460adcc0b1 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:07.356868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde1009-9b9c-4cf2-8892-b7460adcc0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:07.371575 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-1cde1009-9b9c-4cf2-8892-b7460adcc0b1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:07.372846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1cde1009-9b9c-4cf2-8892-b7460adcc0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:07.390655 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 53/113] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 15:36:07.392176 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40893e-6609-4067-b13c-323b55098dea None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:07.392576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40893e-6609-4067-b13c-323b55098dea None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:07.392942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40893e-6609-4067-b13c-323b55098dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:07.410528 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-3f40893e-6609-4067-b13c-323b55098dea None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:07.411834 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3f40893e-6609-4067-b13c-323b55098dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:07.446636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 61/114] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:07.447765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6c9f1-5af1-48c5-aa2e-3a4f171ab02b None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:07.448058 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6c9f1-5af1-48c5-aa2e-3a4f171ab02b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:07.448402 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6c9f1-5af1-48c5-aa2e-3a4f171ab02b None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:07.453997 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 62/115] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:07.454566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6c9f1-5af1-48c5-aa2e-3a4f171ab02b None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:07.458389 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:07.502108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:07.509315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 54/116] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:07.524553 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40893e-6609-4067-b13c-323b55098dea None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:07.572406 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6c9f1-5af1-48c5-aa2e-3a4f171ab02b None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:07.611086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932160e-8a21-4b5f-a9c5-9c4ca8444e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:07.611896 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932160e-8a21-4b5f-a9c5-9c4ca8444e38 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:07.612182 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932160e-8a21-4b5f-a9c5-9c4ca8444e38 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:07.612503 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932160e-8a21-4b5f-a9c5-9c4ca8444e38 None admin] PATH_INFO: `/v3/users/97b256ba96b24fd2b1c4c5c238befca3` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:07.613743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932160e-8a21-4b5f-a9c5-9c4ca8444e38 None admin] RBAC: Authorizing `identity:get_user(user_id=97b256ba96b24fd2b1c4c5c238befca3)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:07.615242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932160e-8a21-4b5f-a9c5-9c4ca8444e38 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:07.617270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 63/117] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:07 2022] GET /identity/v3/users/97b256ba96b24fd2b1c4c5c238befca3 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:07.618417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4c469-0c94-4447-9ca6-d721e29649dd None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:07.618701 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4c469-0c94-4447-9ca6-d721e29649dd None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:07.619005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4c469-0c94-4447-9ca6-d721e29649dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:07.645701 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-b9d4c469-0c94-4447-9ca6-d721e29649dd None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:07.646906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b9d4c469-0c94-4447-9ca6-d721e29649dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:07.655395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40893e-6609-4067-b13c-323b55098dea None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:07.698723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbadff-d148-4b22-be7b-747efd45a713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:07.699784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbadff-d148-4b22-be7b-747efd45a713 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:07.700112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbadff-d148-4b22-be7b-747efd45a713 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:07.700470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbadff-d148-4b22-be7b-747efd45a713 None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:07.701983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbadff-d148-4b22-be7b-747efd45a713 None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:07.704634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbadff-d148-4b22-be7b-747efd45a713 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:07.706731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 55/118] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:07 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:07.711695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbadff-d148-4b22-be7b-747efd45a713 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:07.739455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 64/119] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:07.739455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4c469-0c94-4447-9ca6-d721e29649dd None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:07.739455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:07.798340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:07.840483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbadff-d148-4b22-be7b-747efd45a713 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:07.857492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4c469-0c94-4447-9ca6-d721e29649dd None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:07.875784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57d71c-3f51-41f2-84c9-d2ddab2a777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:07.876636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57d71c-3f51-41f2-84c9-d2ddab2a777a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:07.876945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57d71c-3f51-41f2-84c9-d2ddab2a777a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:07.877225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57d71c-3f51-41f2-84c9-d2ddab2a777a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:07.888512 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57d71c-3f51-41f2-84c9-d2ddab2a777a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-cc57d71c-3f51-41f2-84c9-d2ddab2a777a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:07.896364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:07.897382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:07.898458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:07.898458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:07.898458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:07.898458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:07.898458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:07.898458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:07.898458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:07.898458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:07.898458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:07.898458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:07.898458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:07.898458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:07.898458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 56/120] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:36:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:07.899607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b5621-52f9-4a4a-ae1e-110e729508c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:07.900587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5621-52f9-4a4a-ae1e-110e729508c4 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:07.900922 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5621-52f9-4a4a-ae1e-110e729508c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:07.901245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5621-52f9-4a4a-ae1e-110e729508c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:07.903149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57d71c-3f51-41f2-84c9-d2ddab2a777a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:07.914110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b5621-52f9-4a4a-ae1e-110e729508c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-cb8b5621-52f9-4a4a-ae1e-110e729508c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:07.923933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:07.925013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:07.926216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:07.926216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:07.926216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:07.926216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:07.926216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:07.926216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:07.926216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:07.926216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:07.926216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:07.926216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:07.926216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:07.926216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:07.926216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 65/121] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:07.927114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b5621-52f9-4a4a-ae1e-110e729508c4 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:08.001674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:08.019714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57d71c-3f51-41f2-84c9-d2ddab2a777a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:08.045922 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b5621-52f9-4a4a-ae1e-110e729508c4 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:08.049439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:08.060123 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c7c04-c7c4-48b9-92d1-fec7dd4a732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:08.061650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c7c04-c7c4-48b9-92d1-fec7dd4a732c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:08.061974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c7c04-c7c4-48b9-92d1-fec7dd4a732c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:08.062320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c7c04-c7c4-48b9-92d1-fec7dd4a732c None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:08.063855 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c7c04-c7c4-48b9-92d1-fec7dd4a732c None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:08.065597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c7c04-c7c4-48b9-92d1-fec7dd4a732c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:08.072311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 57/122] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:07 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:08.072311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c7c04-c7c4-48b9-92d1-fec7dd4a732c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:08.091061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2127f-710b-459e-9a3b-0daeff52b113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:08.091514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2127f-710b-459e-9a3b-0daeff52b113 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:08.091804 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2127f-710b-459e-9a3b-0daeff52b113 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:08.092086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2127f-710b-459e-9a3b-0daeff52b113 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:08.092975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2127f-710b-459e-9a3b-0daeff52b113 None admin] RBAC: Adding query filter params (role.id=f25a1522772f4a8683f4c221dff1093a, scope.project.id=8cacd9253675421d9d915794d90317e4, user.id=821bddf8fb1b40cf8223b9d1b829d0e8) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:08.093293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2127f-710b-459e-9a3b-0daeff52b113 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:08.094842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2127f-710b-459e-9a3b-0daeff52b113 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:08.101435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 66/123] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:07 2022] GET /identity/v3/role_assignments?user.id=821bddf8fb1b40cf8223b9d1b829d0e8&scope.project.id=8cacd9253675421d9d915794d90317e4&role.id=f25a1522772f4a8683f4c221dff1093a => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:08.102520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2127f-710b-459e-9a3b-0daeff52b113 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:08.227795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c7c04-c7c4-48b9-92d1-fec7dd4a732c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:08.233028 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2127f-710b-459e-9a3b-0daeff52b113 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:08.266862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:08.278484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794ba04-7647-46d7-89d1-56964e6a4a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:08.279513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794ba04-7647-46d7-89d1-56964e6a4a9e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:08.279947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794ba04-7647-46d7-89d1-56964e6a4a9e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:08.280393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794ba04-7647-46d7-89d1-56964e6a4a9e None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:08.281212 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b6516-f372-4aa0-8ede-8f279a32bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:08.281707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794ba04-7647-46d7-89d1-56964e6a4a9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:08.282087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794ba04-7647-46d7-89d1-56964e6a4a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:08.283016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b6516-f372-4aa0-8ede-8f279a32bcca None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:08.283451 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b6516-f372-4aa0-8ede-8f279a32bcca None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:08.283874 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b6516-f372-4aa0-8ede-8f279a32bcca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:08.284137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794ba04-7647-46d7-89d1-56964e6a4a9e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:08.295259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 67/124] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:08.300335 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794ba04-7647-46d7-89d1-56964e6a4a9e None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:08.304403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b6516-f372-4aa0-8ede-8f279a32bcca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-fd8b6516-f372-4aa0-8ede-8f279a32bcca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:08.310235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:08.311265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:08.312068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:08.312068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:08.312068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:08.312068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:08.312068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:08.312068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:08.312068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:08.312068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:08.312068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:08.312068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:08.312068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:08.312068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:08.314546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 58/125] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:36:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:08.320410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b6516-f372-4aa0-8ede-8f279a32bcca None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:08.379765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:08.429175 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b6516-f372-4aa0-8ede-8f279a32bcca None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:08.435058 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794ba04-7647-46d7-89d1-56964e6a4a9e None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:08.470545 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e4343-a770-49a2-98ec-17592560bd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:08.472008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e4343-a770-49a2-98ec-17592560bd08 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:08.472785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e4343-a770-49a2-98ec-17592560bd08 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:08.473496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e4343-a770-49a2-98ec-17592560bd08 None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4/users/97b256ba96b24fd2b1c4c5c238befca3/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:08.475814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e4343-a770-49a2-98ec-17592560bd08 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cacd9253675421d9d915794d90317e4, user_id=97b256ba96b24fd2b1c4c5c238befca3, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:08.477155 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed870f-9a18-453f-9d7e-865e67a1124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:08.477885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e4343-a770-49a2-98ec-17592560bd08 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:08.477997 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed870f-9a18-453f-9d7e-865e67a1124b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:08.478389 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed870f-9a18-453f-9d7e-865e67a1124b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:08.478730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed870f-9a18-453f-9d7e-865e67a1124b None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:08.479860 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed870f-9a18-453f-9d7e-865e67a1124b None admin] RBAC: Adding query filter params (name=member) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:08.480237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed870f-9a18-453f-9d7e-865e67a1124b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:08.482084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed870f-9a18-453f-9d7e-865e67a1124b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:08.494587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 68/126] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:08.495394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed870f-9a18-453f-9d7e-865e67a1124b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:08.497253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 59/127] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:36:08 2022] PUT /identity/v3/projects/8cacd9253675421d9d915794d90317e4/users/97b256ba96b24fd2b1c4c5c238befca3/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:08.498339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e4343-a770-49a2-98ec-17592560bd08 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:08.587404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:08.673568 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed870f-9a18-453f-9d7e-865e67a1124b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:08.684120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e4343-a770-49a2-98ec-17592560bd08 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:08.709649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:08.736638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7b751-cc0c-4d05-96f0-bab149fe6287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:08.738092 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7b751-cc0c-4d05-96f0-bab149fe6287 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:08.738691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7b751-cc0c-4d05-96f0-bab149fe6287 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:08.739231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7b751-cc0c-4d05-96f0-bab149fe6287 None admin] PATH_INFO: `/v3/users/db61f34a47204afa92fb860bcaecb5da` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:08.741194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7b751-cc0c-4d05-96f0-bab149fe6287 None admin] RBAC: Authorizing `identity:get_user(user_id=db61f34a47204afa92fb860bcaecb5da)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:08.742966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7b751-cc0c-4d05-96f0-bab149fe6287 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:08.745089 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 69/128] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:08 2022] GET /identity/v3/users/db61f34a47204afa92fb860bcaecb5da => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:08.746158 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7b751-cc0c-4d05-96f0-bab149fe6287 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:08.759049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6879cf-74d9-46b2-aeb4-d47e56973a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:08.760565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6879cf-74d9-46b2-aeb4-d47e56973a98 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:08.761065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6879cf-74d9-46b2-aeb4-d47e56973a98 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:08.761543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6879cf-74d9-46b2-aeb4-d47e56973a98 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:08.762564 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6879cf-74d9-46b2-aeb4-d47e56973a98 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:08.763144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6879cf-74d9-46b2-aeb4-d47e56973a98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:08.764625 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6879cf-74d9-46b2-aeb4-d47e56973a98 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:08.779752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 60/129] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:08.781717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6879cf-74d9-46b2-aeb4-d47e56973a98 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:08.883402 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7b751-cc0c-4d05-96f0-bab149fe6287 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:08.916603 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:08.945693 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6879cf-74d9-46b2-aeb4-d47e56973a98 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:08.949578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f0c17-126e-4aba-ba1f-9ac8f7af7231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:08.949924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f0c17-126e-4aba-ba1f-9ac8f7af7231 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:08.950209 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f0c17-126e-4aba-ba1f-9ac8f7af7231 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:08.950483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f0c17-126e-4aba-ba1f-9ac8f7af7231 None admin] PATH_INFO: `/v3/users/97b256ba96b24fd2b1c4c5c238befca3` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:08.951815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f0c17-126e-4aba-ba1f-9ac8f7af7231 None admin] RBAC: Authorizing `identity:get_user(user_id=97b256ba96b24fd2b1c4c5c238befca3)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:08.953417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f0c17-126e-4aba-ba1f-9ac8f7af7231 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:08.956281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 70/130] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:08 2022] GET /identity/v3/users/97b256ba96b24fd2b1c4c5c238befca3 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:08.957376 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f0c17-126e-4aba-ba1f-9ac8f7af7231 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:09.001302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61382cdf-055f-4da8-aafc-192ffed30d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:09.003862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61382cdf-055f-4da8-aafc-192ffed30d5d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:09.008169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61382cdf-055f-4da8-aafc-192ffed30d5d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:09.008793 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61382cdf-055f-4da8-aafc-192ffed30d5d None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:09.010596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61382cdf-055f-4da8-aafc-192ffed30d5d None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:09.013449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61382cdf-055f-4da8-aafc-192ffed30d5d None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:09.016831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 61/131] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:08 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:09.018158 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61382cdf-055f-4da8-aafc-192ffed30d5d None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:09.084228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:09.156027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61382cdf-055f-4da8-aafc-192ffed30d5d None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:09.202498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40780c75-4e0a-4825-8a5c-4c1d0d10ddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:09.204039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40780c75-4e0a-4825-8a5c-4c1d0d10ddc8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:09.204736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40780c75-4e0a-4825-8a5c-4c1d0d10ddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:09.205279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40780c75-4e0a-4825-8a5c-4c1d0d10ddc8 None admin] PATH_INFO: `/v3/projects/d001c34473cd4907af59d6d6a0298af3` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:09.207120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40780c75-4e0a-4825-8a5c-4c1d0d10ddc8 None admin] RBAC: Authorizing `identity:get_project(project_id=d001c34473cd4907af59d6d6a0298af3)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:09.209268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40780c75-4e0a-4825-8a5c-4c1d0d10ddc8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:09.211719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 62/132] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:09 2022] GET /identity/v3/projects/d001c34473cd4907af59d6d6a0298af3 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:09.213190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40780c75-4e0a-4825-8a5c-4c1d0d10ddc8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:09.291429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f0c17-126e-4aba-ba1f-9ac8f7af7231 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:09.345956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7ee70-6502-4d6f-958c-cfc00b1e1c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:09.347271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7ee70-6502-4d6f-958c-cfc00b1e1c11 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:09.347649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7ee70-6502-4d6f-958c-cfc00b1e1c11 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:09.347994 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7ee70-6502-4d6f-958c-cfc00b1e1c11 None admin] PATH_INFO: `/v3/users/97b256ba96b24fd2b1c4c5c238befca3` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:09.349545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7ee70-6502-4d6f-958c-cfc00b1e1c11 None admin] RBAC: Authorizing `identity:get_user(user_id=97b256ba96b24fd2b1c4c5c238befca3)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:09.351752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7ee70-6502-4d6f-958c-cfc00b1e1c11 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:09.354006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 71/133] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:08 2022] GET /identity/v3/users/97b256ba96b24fd2b1c4c5c238befca3 => generated 275 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:09.358748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40780c75-4e0a-4825-8a5c-4c1d0d10ddc8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:09.360775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7ee70-6502-4d6f-958c-cfc00b1e1c11 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:09.380168 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:09.419662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791e45f-6347-49ff-a0d1-f159ea6e40bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:09.420122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791e45f-6347-49ff-a0d1-f159ea6e40bc None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:09.420542 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791e45f-6347-49ff-a0d1-f159ea6e40bc None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:09.420895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791e45f-6347-49ff-a0d1-f159ea6e40bc None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4/users/db61f34a47204afa92fb860bcaecb5da/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:09.423892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791e45f-6347-49ff-a0d1-f159ea6e40bc None admin] RBAC: Authorizing `identity:create_grant(project_id=8cacd9253675421d9d915794d90317e4, user_id=db61f34a47204afa92fb860bcaecb5da, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:09.425814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791e45f-6347-49ff-a0d1-f159ea6e40bc None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:09.445858 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 63/134] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:36:09 2022] PUT /identity/v3/projects/8cacd9253675421d9d915794d90317e4/users/db61f34a47204afa92fb860bcaecb5da/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:09.447907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb02765-a483-421e-af24-4025939d5238 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:09.448184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:09.448308 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb02765-a483-421e-af24-4025939d5238 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:09.448719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb02765-a483-421e-af24-4025939d5238 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:09.451164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 64/135] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:09.454184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb02765-a483-421e-af24-4025939d5238 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:09.505991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7ee70-6502-4d6f-958c-cfc00b1e1c11 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:09.546392 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817caeef-b715-4098-91ba-ab4ba0cef018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:09.547937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817caeef-b715-4098-91ba-ab4ba0cef018 None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:09.548523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817caeef-b715-4098-91ba-ab4ba0cef018 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:09.549036 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817caeef-b715-4098-91ba-ab4ba0cef018 None admin] PATH_INFO: `/v3/projects/d001c34473cd4907af59d6d6a0298af3/users/97b256ba96b24fd2b1c4c5c238befca3/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:09.553313 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817caeef-b715-4098-91ba-ab4ba0cef018 None admin] RBAC: Authorizing `identity:create_grant(project_id=d001c34473cd4907af59d6d6a0298af3, user_id=97b256ba96b24fd2b1c4c5c238befca3, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:09.555340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817caeef-b715-4098-91ba-ab4ba0cef018 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:09.584659 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 72/136] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:36:09 2022] PUT /identity/v3/projects/d001c34473cd4907af59d6d6a0298af3/users/97b256ba96b24fd2b1c4c5c238befca3/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:09.587752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac776f-8761-4f27-af27-ce10c64d7fcf None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:09.590529 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac776f-8761-4f27-af27-ce10c64d7fcf None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:09.591930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac776f-8761-4f27-af27-ce10c64d7fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:09.626075 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-b0ac776f-8761-4f27-af27-ce10c64d7fcf None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:09.629288 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b0ac776f-8761-4f27-af27-ce10c64d7fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:09.665527 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb02765-a483-421e-af24-4025939d5238 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:09.710873 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccfcb3-4ae2-4fbf-b9d2-bf49e9c697ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:09.712646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccfcb3-4ae2-4fbf-b9d2-bf49e9c697ba None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:09.713977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccfcb3-4ae2-4fbf-b9d2-bf49e9c697ba None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:09.714613 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccfcb3-4ae2-4fbf-b9d2-bf49e9c697ba None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:09.716554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 73/137] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:09.717799 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccfcb3-4ae2-4fbf-b9d2-bf49e9c697ba None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:09.720461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccfcb3-4ae2-4fbf-b9d2-bf49e9c697ba None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:09.727581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 65/138] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:09 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:09.728447 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac776f-8761-4f27-af27-ce10c64d7fcf None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:09.790254 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:09.809100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccfcb3-4ae2-4fbf-b9d2-bf49e9c697ba None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:09.852719 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac776f-8761-4f27-af27-ce10c64d7fcf None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:09.888028 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71602078-6c77-498e-a507-cf32d195433d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:09.888261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:09.888966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71602078-6c77-498e-a507-cf32d195433d None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:09.889248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71602078-6c77-498e-a507-cf32d195433d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:09.889524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71602078-6c77-498e-a507-cf32d195433d None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4/users/97b256ba96b24fd2b1c4c5c238befca3/roles/49eaa4df59ae423fa6913302fe982e4e` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:09.892327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71602078-6c77-498e-a507-cf32d195433d None admin] RBAC: Authorizing `identity:create_grant(project_id=8cacd9253675421d9d915794d90317e4, user_id=97b256ba96b24fd2b1c4c5c238befca3, role_id=49eaa4df59ae423fa6913302fe982e4e)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:09.893848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71602078-6c77-498e-a507-cf32d195433d None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:09.912381 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 74/139] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:36:09 2022] PUT /identity/v3/projects/8cacd9253675421d9d915794d90317e4/users/97b256ba96b24fd2b1c4c5c238befca3/roles/49eaa4df59ae423fa6913302fe982e4e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:09.972336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccfcb3-4ae2-4fbf-b9d2-bf49e9c697ba None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:10.015801 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff6c47-f31f-4e3a-bc44-ba63539ba193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:10.017160 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff6c47-f31f-4e3a-bc44-ba63539ba193 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:10.017675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff6c47-f31f-4e3a-bc44-ba63539ba193 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:10.018170 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff6c47-f31f-4e3a-bc44-ba63539ba193 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:10.019745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff6c47-f31f-4e3a-bc44-ba63539ba193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:10.021524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff6c47-f31f-4e3a-bc44-ba63539ba193 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:10.023911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 66/140] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:10.029906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71602078-6c77-498e-a507-cf32d195433d None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:10.162108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71602078-6c77-498e-a507-cf32d195433d None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:10.165381 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:10.204783 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6fc8d-adbe-4654-b0d1-adc52da712e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:10.205531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6fc8d-adbe-4654-b0d1-adc52da712e7 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:10.205821 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6fc8d-adbe-4654-b0d1-adc52da712e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:10.206103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6fc8d-adbe-4654-b0d1-adc52da712e7 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:10.206911 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6fc8d-adbe-4654-b0d1-adc52da712e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:10.208484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6fc8d-adbe-4654-b0d1-adc52da712e7 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:10.240727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 75/141] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:36:10 2022] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:10.896404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bd17a-31ce-4a30-96a3-4a41642f93ce None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:10.897426 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bd17a-31ce-4a30-96a3-4a41642f93ce None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:10.897915 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bd17a-31ce-4a30-96a3-4a41642f93ce None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:10.899753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 67/142] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:10.905664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153408-bf21-4c26-954b-9404676d4240 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:10.906567 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153408-bf21-4c26-954b-9404676d4240 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:10.907084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153408-bf21-4c26-954b-9404676d4240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:10.927157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3d153408-bf21-4c26-954b-9404676d4240 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:10.928721 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3d153408-bf21-4c26-954b-9404676d4240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:11.015994 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 76/143] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:11.042170 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bd17a-31ce-4a30-96a3-4a41642f93ce None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:11.142281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8460aad-5e22-4c43-9478-dd76452b32d7 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:11.142920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8460aad-5e22-4c43-9478-dd76452b32d7 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:11.143197 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8460aad-5e22-4c43-9478-dd76452b32d7 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:11.144819 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 77/144] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:36:11.160703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1664cc2-285a-434b-8b82-288a1d6137f1 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:11.160995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1664cc2-285a-434b-8b82-288a1d6137f1 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:11.161181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1664cc2-285a-434b-8b82-288a1d6137f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:11.192328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-c1664cc2-285a-434b-8b82-288a1d6137f1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:11.192328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c1664cc2-285a-434b-8b82-288a1d6137f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:11.195544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bd17a-31ce-4a30-96a3-4a41642f93ce None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:11.211054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:11.250547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7851c-f561-4c01-92b1-5882a435643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:11.251374 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7851c-f561-4c01-92b1-5882a435643f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:11.251659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7851c-f561-4c01-92b1-5882a435643f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:11.251937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7851c-f561-4c01-92b1-5882a435643f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:11.269399 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7851c-f561-4c01-92b1-5882a435643f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:11.275781 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 78/145] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-87d7851c-f561-4c01-92b1-5882a435643f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:11.282213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:11.283650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:11.284617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:11.284617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:11.284617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:11.284617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:11.284617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:11.284617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:11.284617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:11.284617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:11.284617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:11.284617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:11.284617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:11.284617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:11.284617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 68/146] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:11.290388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1664cc2-285a-434b-8b82-288a1d6137f1 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:11.313278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:11.317512 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7851c-f561-4c01-92b1-5882a435643f None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:11.401763 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1664cc2-285a-434b-8b82-288a1d6137f1 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:11.442828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a61148-6e3e-49b6-adcc-21c8cc9ddd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:11.443442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a61148-6e3e-49b6-adcc-21c8cc9ddd52 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:11.443726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a61148-6e3e-49b6-adcc-21c8cc9ddd52 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:11.444104 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a61148-6e3e-49b6-adcc-21c8cc9ddd52 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:11.445492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a61148-6e3e-49b6-adcc-21c8cc9ddd52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:11.445804 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a61148-6e3e-49b6-adcc-21c8cc9ddd52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:11.447306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a61148-6e3e-49b6-adcc-21c8cc9ddd52 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:11.451281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7851c-f561-4c01-92b1-5882a435643f None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:11.458856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 79/147] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:11.464984 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a61148-6e3e-49b6-adcc-21c8cc9ddd52 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:11.496435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0520f-0453-41f4-a048-bde3f9d63925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:11.497255 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0520f-0453-41f4-a048-bde3f9d63925 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:11.497628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0520f-0453-41f4-a048-bde3f9d63925 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:11.497905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0520f-0453-41f4-a048-bde3f9d63925 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:11.513363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0520f-0453-41f4-a048-bde3f9d63925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-c2f0520f-0453-41f4-a048-bde3f9d63925 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:11.527701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:11.529830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:11.531752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:11.531752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:11.531752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:11.531752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:11.531752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:11.531752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:11.531752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:11.531752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:11.531752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:11.531752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:11.531752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:11.531752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:11.531752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 69/148] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:11.540346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0520f-0453-41f4-a048-bde3f9d63925 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:11.567320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:11.585782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a61148-6e3e-49b6-adcc-21c8cc9ddd52 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:11.600061 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:11.628389 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944faaa0-8e34-466d-ab24-51e8e8d11919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:11.629826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944faaa0-8e34-466d-ab24-51e8e8d11919 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:11.630115 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944faaa0-8e34-466d-ab24-51e8e8d11919 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:11.630396 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944faaa0-8e34-466d-ab24-51e8e8d11919 None admin] PATH_INFO: `/v3/users/821bddf8fb1b40cf8223b9d1b829d0e8` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:11.631635 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944faaa0-8e34-466d-ab24-51e8e8d11919 None admin] RBAC: Authorizing `identity:get_user(user_id=821bddf8fb1b40cf8223b9d1b829d0e8)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:11.633629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944faaa0-8e34-466d-ab24-51e8e8d11919 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:11.636010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 80/149] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:11 2022] GET /identity/v3/users/821bddf8fb1b40cf8223b9d1b829d0e8 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:11.642380 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944faaa0-8e34-466d-ab24-51e8e8d11919 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:11.717142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0520f-0453-41f4-a048-bde3f9d63925 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:11.760403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44ead6-d68e-48bf-b149-3ad8a4187b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:11.761466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44ead6-d68e-48bf-b149-3ad8a4187b75 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:11.761970 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44ead6-d68e-48bf-b149-3ad8a4187b75 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:11.762446 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44ead6-d68e-48bf-b149-3ad8a4187b75 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:11.763415 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44ead6-d68e-48bf-b149-3ad8a4187b75 None admin] RBAC: Adding query filter params (name=member) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:11.763940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44ead6-d68e-48bf-b149-3ad8a4187b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:11.765601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44ead6-d68e-48bf-b149-3ad8a4187b75 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:11.779845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 70/150] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:11.786816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44ead6-d68e-48bf-b149-3ad8a4187b75 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:11.815762 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944faaa0-8e34-466d-ab24-51e8e8d11919 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:11.894753 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0b78f-4867-46fa-8900-06b176f6c98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:11.895983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0b78f-4867-46fa-8900-06b176f6c98c None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:11.896512 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0b78f-4867-46fa-8900-06b176f6c98c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:11.896991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0b78f-4867-46fa-8900-06b176f6c98c None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:11.899605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0b78f-4867-46fa-8900-06b176f6c98c None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:11.901345 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0b78f-4867-46fa-8900-06b176f6c98c None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:11.910645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 81/151] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:11 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:11.912309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0b78f-4867-46fa-8900-06b176f6c98c None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:11.945451 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:11.968544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:11.991678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44ead6-d68e-48bf-b149-3ad8a4187b75 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:12.056319 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3e079-a99b-4813-87cd-a1825f0e2a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:12.057230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3e079-a99b-4813-87cd-a1825f0e2a61 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:12.057513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3e079-a99b-4813-87cd-a1825f0e2a61 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:12.057790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3e079-a99b-4813-87cd-a1825f0e2a61 None admin] PATH_INFO: `/v3/users/97b256ba96b24fd2b1c4c5c238befca3` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:12.060052 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3e079-a99b-4813-87cd-a1825f0e2a61 None admin] RBAC: Authorizing `identity:get_user(user_id=97b256ba96b24fd2b1c4c5c238befca3)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:12.061571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3e079-a99b-4813-87cd-a1825f0e2a61 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:12.064315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 71/152] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:11 2022] GET /identity/v3/users/97b256ba96b24fd2b1c4c5c238befca3 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:12.072937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3e079-a99b-4813-87cd-a1825f0e2a61 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:12.092664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0b78f-4867-46fa-8900-06b176f6c98c None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:12.140551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726a0b0-1faf-48fc-bb0b-1e9bc304eacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:12.141736 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726a0b0-1faf-48fc-bb0b-1e9bc304eacf None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:12.142017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726a0b0-1faf-48fc-bb0b-1e9bc304eacf None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:12.142569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726a0b0-1faf-48fc-bb0b-1e9bc304eacf None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4/users/821bddf8fb1b40cf8223b9d1b829d0e8/roles/f25a1522772f4a8683f4c221dff1093a` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:12.144618 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726a0b0-1faf-48fc-bb0b-1e9bc304eacf None admin] RBAC: Authorizing `identity:create_grant(project_id=8cacd9253675421d9d915794d90317e4, user_id=821bddf8fb1b40cf8223b9d1b829d0e8, role_id=f25a1522772f4a8683f4c221dff1093a)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:12.146088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726a0b0-1faf-48fc-bb0b-1e9bc304eacf None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:12.168001 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 82/153] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:36:11 2022] PUT /identity/v3/projects/8cacd9253675421d9d915794d90317e4/users/821bddf8fb1b40cf8223b9d1b829d0e8/roles/f25a1522772f4a8683f4c221dff1093a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:12.261606 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3e079-a99b-4813-87cd-a1825f0e2a61 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:12.308306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e664d4-6421-40e3-b799-82775b86c2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:12.308978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e664d4-6421-40e3-b799-82775b86c2db None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:12.309261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e664d4-6421-40e3-b799-82775b86c2db None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:12.309588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e664d4-6421-40e3-b799-82775b86c2db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:12.345658 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:12.404141 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e664d4-6421-40e3-b799-82775b86c2db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:12.405688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e664d4-6421-40e3-b799-82775b86c2db None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:12.535657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 72/154] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:12.541011 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726a0b0-1faf-48fc-bb0b-1e9bc304eacf None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:12.643008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:12.672974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726a0b0-1faf-48fc-bb0b-1e9bc304eacf None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:12.709161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f94ff-1cbc-4e51-ac8d-df2c73f04129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:12.710045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f94ff-1cbc-4e51-ac8d-df2c73f04129 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:12.710335 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f94ff-1cbc-4e51-ac8d-df2c73f04129 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:12.710611 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f94ff-1cbc-4e51-ac8d-df2c73f04129 None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:12.711817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f94ff-1cbc-4e51-ac8d-df2c73f04129 None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:12.713647 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f94ff-1cbc-4e51-ac8d-df2c73f04129 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:12.715561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 83/155] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:12 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:12.721556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e664d4-6421-40e3-b799-82775b86c2db None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:12.794520 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:12.846229 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e664d4-6421-40e3-b799-82775b86c2db None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:12.888998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c16e2-7f76-46a3-9f98-283e4c364f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:12.889680 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c16e2-7f76-46a3-9f98-283e4c364f91 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:12.889966 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c16e2-7f76-46a3-9f98-283e4c364f91 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:12.890242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c16e2-7f76-46a3-9f98-283e4c364f91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:12.891703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c16e2-7f76-46a3-9f98-283e4c364f91 None admin] RBAC: Adding query filter params (role.id=7df8c80cd6f643d6aa8ecd8281781a3f, scope.project.id=8cacd9253675421d9d915794d90317e4, user.id=97b256ba96b24fd2b1c4c5c238befca3) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:12.892026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c16e2-7f76-46a3-9f98-283e4c364f91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:12.893527 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c16e2-7f76-46a3-9f98-283e4c364f91 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:12.900159 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 73/156] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:12 2022] GET /identity/v3/role_assignments?user.id=97b256ba96b24fd2b1c4c5c238befca3&scope.project.id=8cacd9253675421d9d915794d90317e4&role.id=7df8c80cd6f643d6aa8ecd8281781a3f => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:13.103982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcca4e4-f74d-4101-9799-c83f85c307a0 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:13.104537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcca4e4-f74d-4101-9799-c83f85c307a0 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:13.104537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcca4e4-f74d-4101-9799-c83f85c307a0 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:13.105915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 84/157] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:13.118022 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45e58-bc4c-407d-9d6d-852ae5ae7bfd None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:13.118737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45e58-bc4c-407d-9d6d-852ae5ae7bfd None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:13.118737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45e58-bc4c-407d-9d6d-852ae5ae7bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:13.141989 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-8ac45e58-bc4c-407d-9d6d-852ae5ae7bfd None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:13.143209 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8ac45e58-bc4c-407d-9d6d-852ae5ae7bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:13.243821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 74/158] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:13.299530 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcca4e4-f74d-4101-9799-c83f85c307a0 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:13.419916 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcca4e4-f74d-4101-9799-c83f85c307a0 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:13.440303 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260a173-e766-4fde-a649-4055910a81b1 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:13.440640 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260a173-e766-4fde-a649-4055910a81b1 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:13.440871 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260a173-e766-4fde-a649-4055910a81b1 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:13.442510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 75/159] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:13.448392 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41083d7-5944-489e-b543-9c009c240338 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:13.448680 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41083d7-5944-489e-b543-9c009c240338 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:13.448981 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41083d7-5944-489e-b543-9c009c240338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:13.464364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf703655-cdc9-4610-8098-be4813431600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:13.465182 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf703655-cdc9-4610-8098-be4813431600 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:13.465466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf703655-cdc9-4610-8098-be4813431600 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:13.465739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf703655-cdc9-4610-8098-be4813431600 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:13.478396 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf703655-cdc9-4610-8098-be4813431600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-cf703655-cdc9-4610-8098-be4813431600 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:13.486826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:13.487696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:13.488490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:13.488490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:13.488490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:13.488490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:13.488490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:13.488490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:13.488490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:13.488490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:13.488490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:13.488490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:13.488490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:13.488490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:13.488490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 85/160] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:13.489655 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e41083d7-5944-489e-b543-9c009c240338 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:13.490703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e41083d7-5944-489e-b543-9c009c240338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:13.494206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf703655-cdc9-4610-8098-be4813431600 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:13.511242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:13.586191 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:13.623510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 76/161] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:13.663870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf703655-cdc9-4610-8098-be4813431600 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:13.668161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41083d7-5944-489e-b543-9c009c240338 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:13.744325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad8ce0-fe71-490d-829c-990e8a24fa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:13.744944 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8ce0-fe71-490d-829c-990e8a24fa34 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:13.745227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8ce0-fe71-490d-829c-990e8a24fa34 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:13.745501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8ce0-fe71-490d-829c-990e8a24fa34 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:13.746270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad8ce0-fe71-490d-829c-990e8a24fa34 None admin] RBAC: Adding query filter params (name=member) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:13.746577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad8ce0-fe71-490d-829c-990e8a24fa34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:13.747982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad8ce0-fe71-490d-829c-990e8a24fa34 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:13.762892 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 86/162] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:13.764194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91960a41-4c66-4607-93b5-f424d703e8b7 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:13.764514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91960a41-4c66-4607-93b5-f424d703e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:13.764792 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91960a41-4c66-4607-93b5-f424d703e8b7 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:13.766970 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 87/163] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:13.774019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14611fe2-fa88-428d-9d88-5759288ebdd7 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:13.774301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14611fe2-fa88-428d-9d88-5759288ebdd7 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:13.774577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14611fe2-fa88-428d-9d88-5759288ebdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:13.812076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-14611fe2-fa88-428d-9d88-5759288ebdd7 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:13.813893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-14611fe2-fa88-428d-9d88-5759288ebdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:13.855835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41083d7-5944-489e-b543-9c009c240338 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:13.892856 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a4b6c-401c-47be-8acc-e52b5f4e2fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:13.893682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a4b6c-401c-47be-8acc-e52b5f4e2fc0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:13.893977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a4b6c-401c-47be-8acc-e52b5f4e2fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:13.894501 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a4b6c-401c-47be-8acc-e52b5f4e2fc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:13.917437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a4b6c-401c-47be-8acc-e52b5f4e2fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-401a4b6c-401c-47be-8acc-e52b5f4e2fc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:13.931411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:13.932332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:13.933110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:13.933110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:13.933110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:13.933110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:13.933110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:13.933110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:13.933110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:13.933110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:13.933110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:13.933110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:13.933110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:13.933110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:13.933110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 77/164] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:36:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:36:13.933757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a4b6c-401c-47be-8acc-e52b5f4e2fc0 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:13.961678 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:13.975342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 88/165] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:13.976002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14611fe2-fa88-428d-9d88-5759288ebdd7 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:14.002627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:14.085354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14611fe2-fa88-428d-9d88-5759288ebdd7 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:14.088098 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a4b6c-401c-47be-8acc-e52b5f4e2fc0 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:14.123361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da862e0c-9376-4ce0-8ffd-bfb30f0ea574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:14.124168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da862e0c-9376-4ce0-8ffd-bfb30f0ea574 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:14.124682 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da862e0c-9376-4ce0-8ffd-bfb30f0ea574 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:14.125313 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da862e0c-9376-4ce0-8ffd-bfb30f0ea574 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:14.126789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da862e0c-9376-4ce0-8ffd-bfb30f0ea574 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:14.127369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da862e0c-9376-4ce0-8ffd-bfb30f0ea574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:14.129114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da862e0c-9376-4ce0-8ffd-bfb30f0ea574 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:14.138315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 89/166] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:14.139317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da862e0c-9376-4ce0-8ffd-bfb30f0ea574 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:14.189833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934658f-7024-4524-87c7-bd6dbd88d11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:14.191335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934658f-7024-4524-87c7-bd6dbd88d11b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:14.191863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934658f-7024-4524-87c7-bd6dbd88d11b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:14.197505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934658f-7024-4524-87c7-bd6dbd88d11b None admin] PATH_INFO: `/v3/users/97b256ba96b24fd2b1c4c5c238befca3` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:14.199378 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934658f-7024-4524-87c7-bd6dbd88d11b None admin] RBAC: Authorizing `identity:get_user(user_id=97b256ba96b24fd2b1c4c5c238befca3)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:14.201119 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934658f-7024-4524-87c7-bd6dbd88d11b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:14.203405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 78/167] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:13 2022] GET /identity/v3/users/97b256ba96b24fd2b1c4c5c238befca3 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:14.204501 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934658f-7024-4524-87c7-bd6dbd88d11b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:14.207676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:14.294316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da862e0c-9376-4ce0-8ffd-bfb30f0ea574 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:14.393039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8db21-544e-4e15-94b7-d9882c73e3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:14.394274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8db21-544e-4e15-94b7-d9882c73e3dd None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:14.394393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934658f-7024-4524-87c7-bd6dbd88d11b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:14.394872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8db21-544e-4e15-94b7-d9882c73e3dd None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:14.395341 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8db21-544e-4e15-94b7-d9882c73e3dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:14.413516 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8db21-544e-4e15-94b7-d9882c73e3dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:14.425374 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-1ea8db21-544e-4e15-94b7-d9882c73e3dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:14.430236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:14.431149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:14.432006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:14.432006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:14.432006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:14.432006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:14.432006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:14.432006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:14.432006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:14.432006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:14.432006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:14.432006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:14.432006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:14.432006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:14.434459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 90/168] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:36:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:14.435469 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8db21-544e-4e15-94b7-d9882c73e3dd None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:14.459998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d9da5-2483-442a-adf0-71fd07f16738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:14.460953 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d9da5-2483-442a-adf0-71fd07f16738 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:14.461237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d9da5-2483-442a-adf0-71fd07f16738 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:14.461511 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d9da5-2483-442a-adf0-71fd07f16738 None admin] PATH_INFO: `/v3/users/97b256ba96b24fd2b1c4c5c238befca3` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:14.465551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d9da5-2483-442a-adf0-71fd07f16738 None admin] RBAC: Authorizing `identity:get_user(user_id=97b256ba96b24fd2b1c4c5c238befca3)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:14.467238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d9da5-2483-442a-adf0-71fd07f16738 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:14.469171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 79/169] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:14 2022] GET /identity/v3/users/97b256ba96b24fd2b1c4c5c238befca3 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:14.469760 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d9da5-2483-442a-adf0-71fd07f16738 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:14.624092 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d9da5-2483-442a-adf0-71fd07f16738 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:14.661677 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8db21-544e-4e15-94b7-d9882c73e3dd None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:14.681636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:14.685176 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaa8ad-5dd2-4eff-b32b-02d63428c5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:14.685861 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa8ad-5dd2-4eff-b32b-02d63428c5c4 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:14.686186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa8ad-5dd2-4eff-b32b-02d63428c5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:14.686572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa8ad-5dd2-4eff-b32b-02d63428c5c4 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:14.687335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faaa8ad-5dd2-4eff-b32b-02d63428c5c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:14.687756 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faaa8ad-5dd2-4eff-b32b-02d63428c5c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:14.690153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faaa8ad-5dd2-4eff-b32b-02d63428c5c4 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:14.696862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58c9d8-e8c7-4f1b-9932-b8ecd4c3c282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:14.697608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58c9d8-e8c7-4f1b-9932-b8ecd4c3c282 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:14.697965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58c9d8-e8c7-4f1b-9932-b8ecd4c3c282 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:14.698317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58c9d8-e8c7-4f1b-9932-b8ecd4c3c282 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:14.704176 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 80/170] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:14.705071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaa8ad-5dd2-4eff-b32b-02d63428c5c4 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:14.772126 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58c9d8-e8c7-4f1b-9932-b8ecd4c3c282 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:14.773761 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58c9d8-e8c7-4f1b-9932-b8ecd4c3c282 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:14.776689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:14.877220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 91/171] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:14.878010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58c9d8-e8c7-4f1b-9932-b8ecd4c3c282 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:14.906356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaa8ad-5dd2-4eff-b32b-02d63428c5c4 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:14.936753 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:14.990800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58c9d8-e8c7-4f1b-9932-b8ecd4c3c282 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:15.027299 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a63ae0-361f-405b-8bef-b58cf46d7944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:15.028217 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a63ae0-361f-405b-8bef-b58cf46d7944 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.028534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a63ae0-361f-405b-8bef-b58cf46d7944 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.028843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a63ae0-361f-405b-8bef-b58cf46d7944 None admin] PATH_INFO: `/v3/users/db61f34a47204afa92fb860bcaecb5da` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.030059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a63ae0-361f-405b-8bef-b58cf46d7944 None admin] RBAC: Authorizing `identity:get_user(user_id=db61f34a47204afa92fb860bcaecb5da)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:15.031692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a63ae0-361f-405b-8bef-b58cf46d7944 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:15.033477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cff32d-38ab-4d98-bbde-d206e46d4b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:15.033712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 92/172] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:14 2022] GET /identity/v3/users/db61f34a47204afa92fb860bcaecb5da => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:15.034333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a63ae0-361f-405b-8bef-b58cf46d7944 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:15.034506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cff32d-38ab-4d98-bbde-d206e46d4b28 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.034770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cff32d-38ab-4d98-bbde-d206e46d4b28 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.035055 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cff32d-38ab-4d98-bbde-d206e46d4b28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.148939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a63ae0-361f-405b-8bef-b58cf46d7944 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:15.160695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:15.189831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd15c1-2c9c-44bb-8a17-3fd151f7d57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:15.190486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd15c1-2c9c-44bb-8a17-3fd151f7d57d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.190926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd15c1-2c9c-44bb-8a17-3fd151f7d57d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.191330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd15c1-2c9c-44bb-8a17-3fd151f7d57d None admin] PATH_INFO: `/v3/projects/d001c34473cd4907af59d6d6a0298af3` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.193017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd15c1-2c9c-44bb-8a17-3fd151f7d57d None admin] RBAC: Authorizing `identity:get_project(project_id=d001c34473cd4907af59d6d6a0298af3)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:15.194752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd15c1-2c9c-44bb-8a17-3fd151f7d57d None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:15.196886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 93/173] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:15 2022] GET /identity/v3/projects/d001c34473cd4907af59d6d6a0298af3 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:15.203906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdb19a-b363-43b1-a9b1-f109256c0c7f None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.204434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdb19a-b363-43b1-a9b1-f109256c0c7f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.204857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdb19a-b363-43b1-a9b1-f109256c0c7f None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.206446 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 94/174] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:15.207590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdb19a-b363-43b1-a9b1-f109256c0c7f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:15.293186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cff32d-38ab-4d98-bbde-d206e46d4b28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:15.295360 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cff32d-38ab-4d98-bbde-d206e46d4b28 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:15.321341 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdb19a-b363-43b1-a9b1-f109256c0c7f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:15.365947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d1ad7-da92-4c64-b003-5c0c73ddf2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:15.365947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d1ad7-da92-4c64-b003-5c0c73ddf2bb None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.366265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d1ad7-da92-4c64-b003-5c0c73ddf2bb None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.366357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d1ad7-da92-4c64-b003-5c0c73ddf2bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.396615 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:15.423633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:15.478856 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 81/175] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 774 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:15.484775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cff32d-38ab-4d98-bbde-d206e46d4b28 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:15.486513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d1ad7-da92-4c64-b003-5c0c73ddf2bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:15.488315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d1ad7-da92-4c64-b003-5c0c73ddf2bb None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:15.595917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 95/176] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:15.597428 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50216efd-5e8e-4ef8-9988-b9afdd38f5ca None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.597714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50216efd-5e8e-4ef8-9988-b9afdd38f5ca None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.597984 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50216efd-5e8e-4ef8-9988-b9afdd38f5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.598348 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cff32d-38ab-4d98-bbde-d206e46d4b28 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:15.613858 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-50216efd-5e8e-4ef8-9988-b9afdd38f5ca None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:15.615064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-50216efd-5e8e-4ef8-9988-b9afdd38f5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:15.633665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee2a61-2f88-4936-a9ee-268642148f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:15.634421 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2a61-2f88-4936-a9ee-268642148f68 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.634705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2a61-2f88-4936-a9ee-268642148f68 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.634960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2a61-2f88-4936-a9ee-268642148f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.635805 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee2a61-2f88-4936-a9ee-268642148f68 None admin] RBAC: Adding query filter params (role.id=7df8c80cd6f643d6aa8ecd8281781a3f, scope.project.id=d001c34473cd4907af59d6d6a0298af3, user.id=97b256ba96b24fd2b1c4c5c238befca3) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:15.636119 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee2a61-2f88-4936-a9ee-268642148f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:15.637629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee2a61-2f88-4936-a9ee-268642148f68 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:15.643677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 82/177] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:15 2022] GET /identity/v3/role_assignments?user.id=97b256ba96b24fd2b1c4c5c238befca3&scope.project.id=d001c34473cd4907af59d6d6a0298af3&role.id=7df8c80cd6f643d6aa8ecd8281781a3f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:15.652696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122165c-0a1c-4115-94d3-0cf5ec3bcce7 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.652696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122165c-0a1c-4115-94d3-0cf5ec3bcce7 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.652696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122165c-0a1c-4115-94d3-0cf5ec3bcce7 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.652696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 83/178] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:15.652696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122165c-0a1c-4115-94d3-0cf5ec3bcce7 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:15.664320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:15.675261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:15.693332 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 96/179] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:15.694709 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cc397-cf0a-4abd-829b-a054c8d78ee3 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.695005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cc397-cf0a-4abd-829b-a054c8d78ee3 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.695286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cc397-cf0a-4abd-829b-a054c8d78ee3 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.701151 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 97/180] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:15.701151 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc6b12-1603-4912-980f-77227c461a93 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.701151 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc6b12-1603-4912-980f-77227c461a93 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.701151 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc6b12-1603-4912-980f-77227c461a93 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.701151 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 98/181] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:15.701151 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc6b12-1603-4912-980f-77227c461a93 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:15.789434 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122165c-0a1c-4115-94d3-0cf5ec3bcce7 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:15.824062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc6b12-1603-4912-980f-77227c461a93 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:15.829217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015a330-856e-478d-88a7-1105e4a89a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:15.830167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a330-856e-478d-88a7-1105e4a89a8c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.830369 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a330-856e-478d-88a7-1105e4a89a8c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.830646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a330-856e-478d-88a7-1105e4a89a8c None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.831855 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015a330-856e-478d-88a7-1105e4a89a8c None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:15.833852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015a330-856e-478d-88a7-1105e4a89a8c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:15.836425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 84/182] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:15 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:15.837960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd57af6-5ae5-4ca1-9b60-671f3d9efe8a None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.838247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd57af6-5ae5-4ca1-9b60-671f3d9efe8a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.838610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd57af6-5ae5-4ca1-9b60-671f3d9efe8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.859546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-0dd57af6-5ae5-4ca1-9b60-671f3d9efe8a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:15.860802 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-0dd57af6-5ae5-4ca1-9b60-671f3d9efe8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:15.864030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29962d8-1c92-4e59-9e7f-fb16414f6b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:15.865095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29962d8-1c92-4e59-9e7f-fb16414f6b70 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.865383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29962d8-1c92-4e59-9e7f-fb16414f6b70 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.865660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29962d8-1c92-4e59-9e7f-fb16414f6b70 None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.866897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29962d8-1c92-4e59-9e7f-fb16414f6b70 None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:15.868453 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29962d8-1c92-4e59-9e7f-fb16414f6b70 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:15.870421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 99/183] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:15 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:15.876402 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2ad13-578d-4d91-b6fe-89ce2681a300 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.876402 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2ad13-578d-4d91-b6fe-89ce2681a300 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.876402 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2ad13-578d-4d91-b6fe-89ce2681a300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.888933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-6fa2ad13-578d-4d91-b6fe-89ce2681a300 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:15.890106 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6fa2ad13-578d-4d91-b6fe-89ce2681a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:15.936988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 85/184] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:15.938539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eda3ce-a9fd-41ef-87fa-0e4a8082c697 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:15.938829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eda3ce-a9fd-41ef-87fa-0e4a8082c697 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:15.939104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eda3ce-a9fd-41ef-87fa-0e4a8082c697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:15.943717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:15.947488 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:15.956990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-17eda3ce-a9fd-41ef-87fa-0e4a8082c697 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:15.958174 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-17eda3ce-a9fd-41ef-87fa-0e4a8082c697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:15.967116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 100/185] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:15.967961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2ad13-578d-4d91-b6fe-89ce2681a300 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.029021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 86/186] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:16.029021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eda3ce-a9fd-41ef-87fa-0e4a8082c697 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.071694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2ad13-578d-4d91-b6fe-89ce2681a300 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.105128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4c475-37db-4be9-9207-82aa207c936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.105922 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4c475-37db-4be9-9207-82aa207c936e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.106198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4c475-37db-4be9-9207-82aa207c936e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.106470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4c475-37db-4be9-9207-82aa207c936e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.116562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4c475-37db-4be9-9207-82aa207c936e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-b8b4c475-37db-4be9-9207-82aa207c936e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:16.124048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:16.125056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:16.125909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:16.125909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:16.125909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:16.125909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:16.125909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:16.125909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:16.125909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:16.125909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:16.125909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:16.125909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:16.125909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:16.125909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:16.125909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 101/187] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:36:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:16.126544 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4c475-37db-4be9-9207-82aa207c936e None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.132311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eda3ce-a9fd-41ef-87fa-0e4a8082c697 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.161854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:16.167204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9403950-4e4c-4093-8fc7-7f70365495b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.167864 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9403950-4e4c-4093-8fc7-7f70365495b8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.168144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9403950-4e4c-4093-8fc7-7f70365495b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.168450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9403950-4e4c-4093-8fc7-7f70365495b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.169292 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9403950-4e4c-4093-8fc7-7f70365495b8 None admin] RBAC: Adding query filter params (role.id=49eaa4df59ae423fa6913302fe982e4e, scope.project.id=8cacd9253675421d9d915794d90317e4, user.id=97b256ba96b24fd2b1c4c5c238befca3) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:16.169600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9403950-4e4c-4093-8fc7-7f70365495b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:16.171096 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9403950-4e4c-4093-8fc7-7f70365495b8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:16.172787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:16.177639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 87/188] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:16 2022] GET /identity/v3/role_assignments?user.id=97b256ba96b24fd2b1c4c5c238befca3&scope.project.id=8cacd9253675421d9d915794d90317e4&role.id=49eaa4df59ae423fa6913302fe982e4e => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:16.178502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9403950-4e4c-4093-8fc7-7f70365495b8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.250426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4c475-37db-4be9-9207-82aa207c936e None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.289744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9403950-4e4c-4093-8fc7-7f70365495b8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.289991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fea86-9b8c-41a6-a433-57754d916af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.290514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fea86-9b8c-41a6-a433-57754d916af6 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.290806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fea86-9b8c-41a6-a433-57754d916af6 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.291081 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fea86-9b8c-41a6-a433-57754d916af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.292325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fea86-9b8c-41a6-a433-57754d916af6 None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=8cacd9253675421d9d915794d90317e4, user.id=db61f34a47204afa92fb860bcaecb5da) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:16.292526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fea86-9b8c-41a6-a433-57754d916af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:16.293995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fea86-9b8c-41a6-a433-57754d916af6 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:16.301963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 102/189] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:16 2022] GET /identity/v3/role_assignments?user.id=db61f34a47204afa92fb860bcaecb5da&scope.project.id=8cacd9253675421d9d915794d90317e4&role.id=32f5ce5800cf40d99d894960288d0155 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:16.302726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fea86-9b8c-41a6-a433-57754d916af6 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.340265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c264289-936e-455a-a284-b7c40aa4c1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.341788 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c264289-936e-455a-a284-b7c40aa4c1eb None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.342225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c264289-936e-455a-a284-b7c40aa4c1eb None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.342509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c264289-936e-455a-a284-b7c40aa4c1eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.356464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c264289-936e-455a-a284-b7c40aa4c1eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-8c264289-936e-455a-a284-b7c40aa4c1eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:16.365597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:16.366709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:16.367592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:16.367592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:16.367592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:16.367592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:16.367592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:16.367592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:16.367592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:16.367592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:16.367592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:16.367592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:16.367592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:16.367592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:16.367592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 88/190] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:36:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:16.368368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c264289-936e-455a-a284-b7c40aa4c1eb None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.430560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fea86-9b8c-41a6-a433-57754d916af6 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.437797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:16.444561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:16.479311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5065da-9db7-4cec-b6bb-703241621c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.480126 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5065da-9db7-4cec-b6bb-703241621c94 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.480440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5065da-9db7-4cec-b6bb-703241621c94 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.480716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5065da-9db7-4cec-b6bb-703241621c94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.481900 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5065da-9db7-4cec-b6bb-703241621c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:16.483400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5065da-9db7-4cec-b6bb-703241621c94 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:16.486008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 103/191] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:16.486778 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5065da-9db7-4cec-b6bb-703241621c94 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.497752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c264289-936e-455a-a284-b7c40aa4c1eb None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.535206 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d33839-3e1d-488e-9448-279363a6b6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.536491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d33839-3e1d-488e-9448-279363a6b6f2 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.536781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d33839-3e1d-488e-9448-279363a6b6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.537055 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d33839-3e1d-488e-9448-279363a6b6f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.550780 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d33839-3e1d-488e-9448-279363a6b6f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-24d33839-3e1d-488e-9448-279363a6b6f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:16.558736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:16.559593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:16.560495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:16.560495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:16.560495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:16.560495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:16.560495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:16.560495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:16.560495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:16.560495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:16.560495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:16.560495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:16.560495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:16.560495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:16.560495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 89/192] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:16.561147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d33839-3e1d-488e-9448-279363a6b6f2 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.600089 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5065da-9db7-4cec-b6bb-703241621c94 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.633948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390aca0-c94a-42ce-a627-1b6a60d37a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.634618 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390aca0-c94a-42ce-a627-1b6a60d37a38 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.634897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390aca0-c94a-42ce-a627-1b6a60d37a38 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.635169 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390aca0-c94a-42ce-a627-1b6a60d37a38 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.635936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390aca0-c94a-42ce-a627-1b6a60d37a38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:16.636261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390aca0-c94a-42ce-a627-1b6a60d37a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:16.637680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390aca0-c94a-42ce-a627-1b6a60d37a38 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:16.645869 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 104/193] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:16.646610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390aca0-c94a-42ce-a627-1b6a60d37a38 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.669363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d33839-3e1d-488e-9448-279363a6b6f2 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.684810 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:16.690190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:16.702570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d5fa0-c3b7-490f-9463-0b8ad32dc43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.703253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d5fa0-c3b7-490f-9463-0b8ad32dc43e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.703529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d5fa0-c3b7-490f-9463-0b8ad32dc43e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.703822 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d5fa0-c3b7-490f-9463-0b8ad32dc43e None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.704707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d5fa0-c3b7-490f-9463-0b8ad32dc43e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:16.705011 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d5fa0-c3b7-490f-9463-0b8ad32dc43e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:16.706414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d5fa0-c3b7-490f-9463-0b8ad32dc43e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:16.717427 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 90/194] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:16.718069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d5fa0-c3b7-490f-9463-0b8ad32dc43e None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.752450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390aca0-c94a-42ce-a627-1b6a60d37a38 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.785916 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaf4b6-7712-498e-9fb5-f9972d5538d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.786597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf4b6-7712-498e-9fb5-f9972d5538d5 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.786881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf4b6-7712-498e-9fb5-f9972d5538d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.787159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf4b6-7712-498e-9fb5-f9972d5538d5 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.787890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaf4b6-7712-498e-9fb5-f9972d5538d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:16.789383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaf4b6-7712-498e-9fb5-f9972d5538d5 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:16.809672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 105/195] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:36:16 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:16.821208 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaf4b6-7712-498e-9fb5-f9972d5538d5 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.836211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d5fa0-c3b7-490f-9463-0b8ad32dc43e None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.876854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fe0a9-4490-44a4-a430-131e6983d611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.877568 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fe0a9-4490-44a4-a430-131e6983d611 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.877858 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fe0a9-4490-44a4-a430-131e6983d611 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.878131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fe0a9-4490-44a4-a430-131e6983d611 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.878918 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fe0a9-4490-44a4-a430-131e6983d611 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:16.879229 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fe0a9-4490-44a4-a430-131e6983d611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:16.880754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fe0a9-4490-44a4-a430-131e6983d611 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:16.890327 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 91/196] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:16.891107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fe0a9-4490-44a4-a430-131e6983d611 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:16.923532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:16.932006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaf4b6-7712-498e-9fb5-f9972d5538d5 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:16.946502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:16.974951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fb5bf-12ea-4501-a6aa-c5668340f12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:16.975771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb5bf-12ea-4501-a6aa-c5668340f12d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:16.976052 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb5bf-12ea-4501-a6aa-c5668340f12d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:16.976387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb5bf-12ea-4501-a6aa-c5668340f12d None admin] PATH_INFO: `/v3/users/50260b91f0cc4c88b5ef72a6ca8b483b` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:16.993012 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fb5bf-12ea-4501-a6aa-c5668340f12d None admin] RBAC: Authorizing `identity:get_user(user_id=50260b91f0cc4c88b5ef72a6ca8b483b)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:16.994496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fb5bf-12ea-4501-a6aa-c5668340f12d None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:16.996419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 106/197] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:16 2022] GET /identity/v3/users/50260b91f0cc4c88b5ef72a6ca8b483b => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:16.997083 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fb5bf-12ea-4501-a6aa-c5668340f12d None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:17.016619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fe0a9-4490-44a4-a430-131e6983d611 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:17.059312 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd0a2e-4739-4c25-8650-035b6de323fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:17.060413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd0a2e-4739-4c25-8650-035b6de323fe None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:17.060413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd0a2e-4739-4c25-8650-035b6de323fe None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:17.060660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd0a2e-4739-4c25-8650-035b6de323fe None admin] PATH_INFO: `/v3/users/50260b91f0cc4c88b5ef72a6ca8b483b` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:17.062494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd0a2e-4739-4c25-8650-035b6de323fe None admin] RBAC: Authorizing `identity:get_user(user_id=50260b91f0cc4c88b5ef72a6ca8b483b)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:17.064002 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd0a2e-4739-4c25-8650-035b6de323fe None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:17.065732 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 92/198] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:16 2022] GET /identity/v3/users/50260b91f0cc4c88b5ef72a6ca8b483b => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:17.066515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd0a2e-4739-4c25-8650-035b6de323fe None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:17.120530 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fb5bf-12ea-4501-a6aa-c5668340f12d None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:17.167299 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2de4e5-ec8b-4360-8232-dd08a05c00ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:17.168185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de4e5-ec8b-4360-8232-dd08a05c00ee None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:17.168544 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de4e5-ec8b-4360-8232-dd08a05c00ee None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:17.168817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de4e5-ec8b-4360-8232-dd08a05c00ee None admin] PATH_INFO: `/v3/users/821bddf8fb1b40cf8223b9d1b829d0e8` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:17.170033 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2de4e5-ec8b-4360-8232-dd08a05c00ee None admin] RBAC: Authorizing `identity:get_user(user_id=821bddf8fb1b40cf8223b9d1b829d0e8)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:17.171514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2de4e5-ec8b-4360-8232-dd08a05c00ee None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:17.173935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 107/199] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:16 2022] GET /identity/v3/users/821bddf8fb1b40cf8223b9d1b829d0e8 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:17.174712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2de4e5-ec8b-4360-8232-dd08a05c00ee None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:17.186071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd0a2e-4739-4c25-8650-035b6de323fe None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:17.201569 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:17.202963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:17.235173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344baa04-240e-4cb0-b96f-d3cc0349f8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:17.236010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344baa04-240e-4cb0-b96f-d3cc0349f8f3 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:17.236315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344baa04-240e-4cb0-b96f-d3cc0349f8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:17.236595 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344baa04-240e-4cb0-b96f-d3cc0349f8f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:17.293162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2de4e5-ec8b-4360-8232-dd08a05c00ee None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:17.319179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344baa04-240e-4cb0-b96f-d3cc0349f8f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:17.320923 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344baa04-240e-4cb0-b96f-d3cc0349f8f3 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:17.336533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af2b61-a2a7-485b-ac28-80fba5b1d9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:17.337250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af2b61-a2a7-485b-ac28-80fba5b1d9aa None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:17.337539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af2b61-a2a7-485b-ac28-80fba5b1d9aa None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:17.337823 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af2b61-a2a7-485b-ac28-80fba5b1d9aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:17.416097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af2b61-a2a7-485b-ac28-80fba5b1d9aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:17.418209 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af2b61-a2a7-485b-ac28-80fba5b1d9aa None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:17.431479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 93/200] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:17.432479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344baa04-240e-4cb0-b96f-d3cc0349f8f3 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:17.441267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:17.445636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:17.534587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 108/201] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:17.537101 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af2b61-a2a7-485b-ac28-80fba5b1d9aa None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:17.558571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344baa04-240e-4cb0-b96f-d3cc0349f8f3 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:17.596632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7403c-24e3-435d-a743-de0229b09dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:17.597395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7403c-24e3-435d-a743-de0229b09dfa None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:17.597684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7403c-24e3-435d-a743-de0229b09dfa None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:17.597960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7403c-24e3-435d-a743-de0229b09dfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:17.641638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af2b61-a2a7-485b-ac28-80fba5b1d9aa None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:17.662347 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:17.674276 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7403c-24e3-435d-a743-de0229b09dfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:17.676654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7403c-24e3-435d-a743-de0229b09dfa None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:17.677015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f842a-61d5-4f75-b64c-506d03a8e1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:17.677973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f842a-61d5-4f75-b64c-506d03a8e1ca None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:17.678322 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f842a-61d5-4f75-b64c-506d03a8e1ca None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:17.678666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f842a-61d5-4f75-b64c-506d03a8e1ca None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:17.679960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f842a-61d5-4f75-b64c-506d03a8e1ca None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:17.681521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f842a-61d5-4f75-b64c-506d03a8e1ca None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:17.687145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:17.688738 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 109/202] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:17 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:17.689681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f842a-61d5-4f75-b64c-506d03a8e1ca None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:17.789233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 94/203] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:17.790610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7403c-24e3-435d-a743-de0229b09dfa None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:17.792529 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f842a-61d5-4f75-b64c-506d03a8e1ca None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:17.827134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484257a4-54f7-496d-9df5-e53b407f6b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:17.828050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484257a4-54f7-496d-9df5-e53b407f6b94 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:17.828372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484257a4-54f7-496d-9df5-e53b407f6b94 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:17.828653 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484257a4-54f7-496d-9df5-e53b407f6b94 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:17.830227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484257a4-54f7-496d-9df5-e53b407f6b94 None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:17.831338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484257a4-54f7-496d-9df5-e53b407f6b94 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:17.838134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 110/204] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:17 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:17.838134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484257a4-54f7-496d-9df5-e53b407f6b94 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:17.894096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:17.906947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7403c-24e3-435d-a743-de0229b09dfa None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:17.917439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:17.939614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484257a4-54f7-496d-9df5-e53b407f6b94 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:17.948148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da938a0a-3a2b-475c-bd58-de8398ae2abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:17.949134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938a0a-3a2b-475c-bd58-de8398ae2abd None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:17.949614 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938a0a-3a2b-475c-bd58-de8398ae2abd None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:17.950177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938a0a-3a2b-475c-bd58-de8398ae2abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:17.951246 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da938a0a-3a2b-475c-bd58-de8398ae2abd None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=21d24ab37b7c4dbaa4794944fac657c0, user.id=50260b91f0cc4c88b5ef72a6ca8b483b) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:17.951757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da938a0a-3a2b-475c-bd58-de8398ae2abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:17.953740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da938a0a-3a2b-475c-bd58-de8398ae2abd None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:17.960184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 95/205] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:17 2022] GET /identity/v3/role_assignments?user.id=50260b91f0cc4c88b5ef72a6ca8b483b&scope.project.id=21d24ab37b7c4dbaa4794944fac657c0&role.id=32f5ce5800cf40d99d894960288d0155 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:17.961431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da938a0a-3a2b-475c-bd58-de8398ae2abd None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:17.993666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fbee1-80f3-4570-8ebb-253479aec9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:17.994608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fbee1-80f3-4570-8ebb-253479aec9bf None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:17.994899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fbee1-80f3-4570-8ebb-253479aec9bf None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:17.995176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fbee1-80f3-4570-8ebb-253479aec9bf None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:17.997562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fbee1-80f3-4570-8ebb-253479aec9bf None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:17.999108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fbee1-80f3-4570-8ebb-253479aec9bf None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:18.001065 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 111/206] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:17 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:18.006937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fbee1-80f3-4570-8ebb-253479aec9bf None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:18.079562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da938a0a-3a2b-475c-bd58-de8398ae2abd None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:18.120689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51167f0c-4898-4871-a0d3-d3131f40c536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:18.121754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51167f0c-4898-4871-a0d3-d3131f40c536 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:18.122278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51167f0c-4898-4871-a0d3-d3131f40c536 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:18.122810 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51167f0c-4898-4871-a0d3-d3131f40c536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:18.123869 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51167f0c-4898-4871-a0d3-d3131f40c536 None admin] RBAC: Adding query filter params (role.id=49eaa4df59ae423fa6913302fe982e4e, scope.project.id=21d24ab37b7c4dbaa4794944fac657c0, user.id=50260b91f0cc4c88b5ef72a6ca8b483b) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:18.124440 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51167f0c-4898-4871-a0d3-d3131f40c536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:18.126354 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51167f0c-4898-4871-a0d3-d3131f40c536 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:18.138495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 96/207] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:17 2022] GET /identity/v3/role_assignments?user.id=50260b91f0cc4c88b5ef72a6ca8b483b&scope.project.id=21d24ab37b7c4dbaa4794944fac657c0&role.id=49eaa4df59ae423fa6913302fe982e4e => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:18.239985 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fbee1-80f3-4570-8ebb-253479aec9bf None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:18.278751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:18.296355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc7563-eb0c-4079-813d-2754a17dcf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:18.298091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc7563-eb0c-4079-813d-2754a17dcf21 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:18.298555 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc7563-eb0c-4079-813d-2754a17dcf21 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:18.299003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc7563-eb0c-4079-813d-2754a17dcf21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:18.300043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc7563-eb0c-4079-813d-2754a17dcf21 None admin] RBAC: Adding query filter params (role.id=f25a1522772f4a8683f4c221dff1093a, scope.project.id=8cacd9253675421d9d915794d90317e4, user.id=821bddf8fb1b40cf8223b9d1b829d0e8) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:18.300385 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc7563-eb0c-4079-813d-2754a17dcf21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:18.301874 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc7563-eb0c-4079-813d-2754a17dcf21 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:18.308722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 112/208] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:18 2022] GET /identity/v3/role_assignments?user.id=821bddf8fb1b40cf8223b9d1b829d0e8&scope.project.id=8cacd9253675421d9d915794d90317e4&role.id=f25a1522772f4a8683f4c221dff1093a => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:19.049994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e6099-167d-4694-a70c-40cedf31b5a4 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:19.051000 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e6099-167d-4694-a70c-40cedf31b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:19.051509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e6099-167d-4694-a70c-40cedf31b5a4 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:19.053158 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 97/209] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:19.058553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318ae9b-5b90-41d5-8468-c023a63dc667 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:19.058846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318ae9b-5b90-41d5-8468-c023a63dc667 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:19.059124 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318ae9b-5b90-41d5-8468-c023a63dc667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:19.076318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-e318ae9b-5b90-41d5-8468-c023a63dc667 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:19.077507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e318ae9b-5b90-41d5-8468-c023a63dc667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:19.148593 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 113/210] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:19.172530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e6099-167d-4694-a70c-40cedf31b5a4 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:19.219945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:19.240142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaabaab-49d8-48f3-a5f8-fe707a2de073 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:19.240693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaabaab-49d8-48f3-a5f8-fe707a2de073 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:19.240767 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaabaab-49d8-48f3-a5f8-fe707a2de073 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:19.242297 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 114/211] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:36:19.247118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caac0a-b13e-495a-a221-4aef47720dcd None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:19.247463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caac0a-b13e-495a-a221-4aef47720dcd None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:19.247662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caac0a-b13e-495a-a221-4aef47720dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:19.271432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-71caac0a-b13e-495a-a221-4aef47720dcd None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:19.273072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-71caac0a-b13e-495a-a221-4aef47720dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:19.296010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e6099-167d-4694-a70c-40cedf31b5a4 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:19.332784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043a947-8e60-4001-b85b-b01c3ef57277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:19.333985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043a947-8e60-4001-b85b-b01c3ef57277 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:19.334467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043a947-8e60-4001-b85b-b01c3ef57277 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:19.335003 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043a947-8e60-4001-b85b-b01c3ef57277 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:19.350443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043a947-8e60-4001-b85b-b01c3ef57277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:19.357689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 115/212] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-9043a947-8e60-4001-b85b-b01c3ef57277 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:19.358152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:19.359004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:19.360734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:19.360734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:19.360734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:19.360734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:19.360734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:19.360734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:19.360734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:19.360734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:19.360734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:19.360734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:19.360734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:19.360734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:19.360734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 98/213] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:19.365315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caac0a-b13e-495a-a221-4aef47720dcd None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:19.383555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043a947-8e60-4001-b85b-b01c3ef57277 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:19.427269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:19.492091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caac0a-b13e-495a-a221-4aef47720dcd None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:19.497173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:19.503492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043a947-8e60-4001-b85b-b01c3ef57277 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:19.538667 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc2806-d1bc-485a-8af2-18ba386ee784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:19.539667 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc2806-d1bc-485a-8af2-18ba386ee784 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:19.540087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc2806-d1bc-485a-8af2-18ba386ee784 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:19.540484 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc2806-d1bc-485a-8af2-18ba386ee784 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:19.541766 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc2806-d1bc-485a-8af2-18ba386ee784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:19.541895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92b562-2a88-48bb-81dd-771857877bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:19.542720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92b562-2a88-48bb-81dd-771857877bba None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:19.543145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92b562-2a88-48bb-81dd-771857877bba None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:19.543556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92b562-2a88-48bb-81dd-771857877bba None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:19.543723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc2806-d1bc-485a-8af2-18ba386ee784 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:19.544648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92b562-2a88-48bb-81dd-771857877bba None admin] RBAC: Adding query filter params (name=member) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:19.545100 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92b562-2a88-48bb-81dd-771857877bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:19.546653 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92b562-2a88-48bb-81dd-771857877bba None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:19.550464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 99/214] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:19.551454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc2806-d1bc-485a-8af2-18ba386ee784 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:19.558413 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 116/215] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:19.564330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92b562-2a88-48bb-81dd-771857877bba None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:19.678796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc2806-d1bc-485a-8af2-18ba386ee784 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:19.678972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92b562-2a88-48bb-81dd-771857877bba None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:19.689810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:19.716545 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83783d01-2ff2-43c3-a6bf-eda2032375a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:19.717385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83783d01-2ff2-43c3-a6bf-eda2032375a8 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:19.717677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83783d01-2ff2-43c3-a6bf-eda2032375a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:19.718001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83783d01-2ff2-43c3-a6bf-eda2032375a8 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:19.718821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83783d01-2ff2-43c3-a6bf-eda2032375a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:19.720493 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83783d01-2ff2-43c3-a6bf-eda2032375a8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:19.721623 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f7b33-701e-447e-8362-e6a1c844d3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:19.722741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f7b33-701e-447e-8362-e6a1c844d3e3 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:19.723229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f7b33-701e-447e-8362-e6a1c844d3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:19.723714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f7b33-701e-447e-8362-e6a1c844d3e3 None admin] PATH_INFO: `/v3/users/7d8b99e6b5874ff28b529e8ba179d5d1` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:19.739979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f7b33-701e-447e-8362-e6a1c844d3e3 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8b99e6b5874ff28b529e8ba179d5d1)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:19.742007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f7b33-701e-447e-8362-e6a1c844d3e3 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:19.744076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 117/216] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:19 2022] GET /identity/v3/users/7d8b99e6b5874ff28b529e8ba179d5d1 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:19.750074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f7b33-701e-447e-8362-e6a1c844d3e3 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:19.757551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 100/217] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:36:19 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:19.867284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f7b33-701e-447e-8362-e6a1c844d3e3 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:19.904672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd260cb4-5729-4820-833d-81bbccfe3f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:19.905343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd260cb4-5729-4820-833d-81bbccfe3f67 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:19.905629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd260cb4-5729-4820-833d-81bbccfe3f67 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:19.905909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd260cb4-5729-4820-833d-81bbccfe3f67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:19.944102 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:19.980821 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd260cb4-5729-4820-833d-81bbccfe3f67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:19.982317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd260cb4-5729-4820-833d-81bbccfe3f67 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:20.088111 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 118/218] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:20.093859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83783d01-2ff2-43c3-a6bf-eda2032375a8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:20.117903 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:20.180312 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b6e05-c5f2-484a-926f-73a8266ccc32 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:20.180649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b6e05-c5f2-484a-926f-73a8266ccc32 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:20.180890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b6e05-c5f2-484a-926f-73a8266ccc32 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:20.182301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 119/219] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:36:20.189811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63b8df-69b2-4d14-b2c6-e0276b6c0db5 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:20.189811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63b8df-69b2-4d14-b2c6-e0276b6c0db5 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:20.189811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63b8df-69b2-4d14-b2c6-e0276b6c0db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:20.221300 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-5c63b8df-69b2-4d14-b2c6-e0276b6c0db5 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:20.222538 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5c63b8df-69b2-4d14-b2c6-e0276b6c0db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:20.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83783d01-2ff2-43c3-a6bf-eda2032375a8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:20.292820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:20.300100 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 120/220] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:20.305684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a29b8e-79a4-4f33-b343-1428f85f1dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:20.306582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a29b8e-79a4-4f33-b343-1428f85f1dda None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:20.306870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a29b8e-79a4-4f33-b343-1428f85f1dda None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:20.307147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a29b8e-79a4-4f33-b343-1428f85f1dda None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:20.313035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a29b8e-79a4-4f33-b343-1428f85f1dda None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:20.314530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a29b8e-79a4-4f33-b343-1428f85f1dda None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:20.316458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 101/221] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:20 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:20.322545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63b8df-69b2-4d14-b2c6-e0276b6c0db5 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:20.350063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a29b8e-79a4-4f33-b343-1428f85f1dda None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:20.479231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63b8df-69b2-4d14-b2c6-e0276b6c0db5 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:20.506969 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:20.517257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f73b66-5e21-459a-81ed-cf716e0cafcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:20.518305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f73b66-5e21-459a-81ed-cf716e0cafcb None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:20.518817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f73b66-5e21-459a-81ed-cf716e0cafcb None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:20.519322 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f73b66-5e21-459a-81ed-cf716e0cafcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:20.520541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f73b66-5e21-459a-81ed-cf716e0cafcb None admin] RBAC: Adding query filter params (role.id=7df8c80cd6f643d6aa8ecd8281781a3f, scope.project.id=21d24ab37b7c4dbaa4794944fac657c0, user.id=7d8b99e6b5874ff28b529e8ba179d5d1) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:20.521042 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f73b66-5e21-459a-81ed-cf716e0cafcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:20.522695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f73b66-5e21-459a-81ed-cf716e0cafcb None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:20.523275 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a29b8e-79a4-4f33-b343-1428f85f1dda None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:20.529697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 121/222] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:20 2022] GET /identity/v3/role_assignments?user.id=7d8b99e6b5874ff28b529e8ba179d5d1&scope.project.id=21d24ab37b7c4dbaa4794944fac657c0&role.id=7df8c80cd6f643d6aa8ecd8281781a3f => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:20.538167 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e59fe-5293-40cf-9491-fd0cf6e2a0c1 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:20.538723 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e59fe-5293-40cf-9491-fd0cf6e2a0c1 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:20.539232 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e59fe-5293-40cf-9491-fd0cf6e2a0c1 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:20.541222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 122/223] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:20.547239 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56620c-8bd2-4053-8c63-fd8624cd3915 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:20.548128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56620c-8bd2-4053-8c63-fd8624cd3915 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:20.548620 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56620c-8bd2-4053-8c63-fd8624cd3915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:20.563415 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdda33-55b5-405f-852b-71294a63674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:20.564232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdda33-55b5-405f-852b-71294a63674c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:20.564547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdda33-55b5-405f-852b-71294a63674c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:20.564824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdda33-55b5-405f-852b-71294a63674c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:20.583457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3a56620c-8bd2-4053-8c63-fd8624cd3915 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:20.585334 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdda33-55b5-405f-852b-71294a63674c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:20.587683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3a56620c-8bd2-4053-8c63-fd8624cd3915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-1cfdda33-55b5-405f-852b-71294a63674c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:20.602079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:20.603001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:20.603773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:20.603773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:20.603773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:20.603773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:20.603773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:20.603773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:20.603773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:20.603773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:20.603773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:20.603773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:20.603773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:20.603773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:20.603773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 102/224] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:36:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:36:20.611539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdda33-55b5-405f-852b-71294a63674c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:20.722347 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:20.736429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 123/225] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:20.765053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56620c-8bd2-4053-8c63-fd8624cd3915 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:20.793875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdda33-55b5-405f-852b-71294a63674c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:20.873088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841df25-d6ba-4c90-b5f7-f4da9d1a85a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:20.874170 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841df25-d6ba-4c90-b5f7-f4da9d1a85a2 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:20.874699 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841df25-d6ba-4c90-b5f7-f4da9d1a85a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:20.875235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841df25-d6ba-4c90-b5f7-f4da9d1a85a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:20.876183 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841df25-d6ba-4c90-b5f7-f4da9d1a85a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:20.876747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841df25-d6ba-4c90-b5f7-f4da9d1a85a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:20.877637 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56620c-8bd2-4053-8c63-fd8624cd3915 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:20.878561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841df25-d6ba-4c90-b5f7-f4da9d1a85a2 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:20.893744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 103/226] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:20.899418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841df25-d6ba-4c90-b5f7-f4da9d1a85a2 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:20.916678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:20.919768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0ee84-6fb2-4ece-9269-7bda1044bed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:20.919768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0ee84-6fb2-4ece-9269-7bda1044bed5 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:20.919990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0ee84-6fb2-4ece-9269-7bda1044bed5 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:20.920209 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0ee84-6fb2-4ece-9269-7bda1044bed5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:20.945196 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0ee84-6fb2-4ece-9269-7bda1044bed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-ffb0ee84-6fb2-4ece-9269-7bda1044bed5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:20.957434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:20.958317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:20.959087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:20.959087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:20.959087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:20.959087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:20.959087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:20.959087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:20.959087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:20.959087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:20.959087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:20.959087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:20.959087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:20.959087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:20.959087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 124/227] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:36:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:36:20.970039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0ee84-6fb2-4ece-9269-7bda1044bed5 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:21.067200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:21.088228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841df25-d6ba-4c90-b5f7-f4da9d1a85a2 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:21.135991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba318-a0eb-494a-a56f-9ca30c5c0ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:21.135991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba318-a0eb-494a-a56f-9ca30c5c0ae0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:21.135991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba318-a0eb-494a-a56f-9ca30c5c0ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:21.135991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba318-a0eb-494a-a56f-9ca30c5c0ae0 None admin] PATH_INFO: `/v3/users/50260b91f0cc4c88b5ef72a6ca8b483b` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:21.136873 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eba318-a0eb-494a-a56f-9ca30c5c0ae0 None admin] RBAC: Authorizing `identity:get_user(user_id=50260b91f0cc4c88b5ef72a6ca8b483b)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:21.138340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eba318-a0eb-494a-a56f-9ca30c5c0ae0 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:21.140227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 104/228] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:20 2022] GET /identity/v3/users/50260b91f0cc4c88b5ef72a6ca8b483b => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:21.146679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba318-a0eb-494a-a56f-9ca30c5c0ae0 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:21.149507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0ee84-6fb2-4ece-9269-7bda1044bed5 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:21.234022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1879e-76bc-461f-bd75-32f00b50d9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:21.235167 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1879e-76bc-461f-bd75-32f00b50d9d3 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:21.235598 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1879e-76bc-461f-bd75-32f00b50d9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:21.235896 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1879e-76bc-461f-bd75-32f00b50d9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:21.236701 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1879e-76bc-461f-bd75-32f00b50d9d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:21.237007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1879e-76bc-461f-bd75-32f00b50d9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:21.238416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1879e-76bc-461f-bd75-32f00b50d9d3 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:21.259408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 125/229] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:21.263473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1879e-76bc-461f-bd75-32f00b50d9d3 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:21.292649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:21.335350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba318-a0eb-494a-a56f-9ca30c5c0ae0 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:21.391275 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455ea9e-982b-47fd-b86f-6b9477c07ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:21.392615 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455ea9e-982b-47fd-b86f-6b9477c07ddf None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:21.393100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455ea9e-982b-47fd-b86f-6b9477c07ddf None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:21.393572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455ea9e-982b-47fd-b86f-6b9477c07ddf None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:21.396427 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455ea9e-982b-47fd-b86f-6b9477c07ddf None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:21.398127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455ea9e-982b-47fd-b86f-6b9477c07ddf None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:21.402728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 105/230] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:21 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:21.406805 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455ea9e-982b-47fd-b86f-6b9477c07ddf None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:21.448000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1879e-76bc-461f-bd75-32f00b50d9d3 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:21.479449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:21.515338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfc62c-49a5-435e-b6d3-efc190929141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:21.516738 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc62c-49a5-435e-b6d3-efc190929141 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:21.517365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc62c-49a5-435e-b6d3-efc190929141 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:21.518629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc62c-49a5-435e-b6d3-efc190929141 None admin] PATH_INFO: `/v3/users/50260b91f0cc4c88b5ef72a6ca8b483b` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:21.521947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfc62c-49a5-435e-b6d3-efc190929141 None admin] RBAC: Authorizing `identity:get_user(user_id=50260b91f0cc4c88b5ef72a6ca8b483b)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:21.523857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfc62c-49a5-435e-b6d3-efc190929141 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:21.526562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 126/231] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:21 2022] GET /identity/v3/users/50260b91f0cc4c88b5ef72a6ca8b483b => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:21.532837 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfc62c-49a5-435e-b6d3-efc190929141 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:21.604471 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455ea9e-982b-47fd-b86f-6b9477c07ddf None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:21.650307 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945eae9a-681a-49d5-929b-370cc15079bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:21.652319 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eae9a-681a-49d5-929b-370cc15079bb None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:21.653119 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eae9a-681a-49d5-929b-370cc15079bb None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:21.655308 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eae9a-681a-49d5-929b-370cc15079bb None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0/users/50260b91f0cc4c88b5ef72a6ca8b483b/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:21.662384 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945eae9a-681a-49d5-929b-370cc15079bb None admin] RBAC: Authorizing `identity:create_grant(project_id=21d24ab37b7c4dbaa4794944fac657c0, user_id=50260b91f0cc4c88b5ef72a6ca8b483b, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:21.663863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945eae9a-681a-49d5-929b-370cc15079bb None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:21.692578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfc62c-49a5-435e-b6d3-efc190929141 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:21.694725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 106/232] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:36:21 2022] PUT /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0/users/50260b91f0cc4c88b5ef72a6ca8b483b/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:21.744751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd9baf-279b-48fd-b62c-54bec05dc838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:21.746098 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd9baf-279b-48fd-b62c-54bec05dc838 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:21.746677 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd9baf-279b-48fd-b62c-54bec05dc838 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:21.747202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd9baf-279b-48fd-b62c-54bec05dc838 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:21.748900 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd9baf-279b-48fd-b62c-54bec05dc838 None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:21.750832 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd9baf-279b-48fd-b62c-54bec05dc838 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:21.753006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 127/233] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:21 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:21.759621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945eae9a-681a-49d5-929b-370cc15079bb None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:21.774981 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:21.916967 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945eae9a-681a-49d5-929b-370cc15079bb None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:21.954307 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b5547-561e-4843-a6cb-85f4a69cb9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:21.955389 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b5547-561e-4843-a6cb-85f4a69cb9e6 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:21.955671 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b5547-561e-4843-a6cb-85f4a69cb9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:21.955940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b5547-561e-4843-a6cb-85f4a69cb9e6 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0/users/50260b91f0cc4c88b5ef72a6ca8b483b/roles/49eaa4df59ae423fa6913302fe982e4e` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:21.958235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b5547-561e-4843-a6cb-85f4a69cb9e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=21d24ab37b7c4dbaa4794944fac657c0, user_id=50260b91f0cc4c88b5ef72a6ca8b483b, role_id=49eaa4df59ae423fa6913302fe982e4e)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:21.959883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b5547-561e-4843-a6cb-85f4a69cb9e6 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:21.976777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 107/234] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:36:21 2022] PUT /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0/users/50260b91f0cc4c88b5ef72a6ca8b483b/roles/49eaa4df59ae423fa6913302fe982e4e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:22.280216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3ead7-9496-4d43-b997-e9f3f6385ba3 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:22.280543 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3ead7-9496-4d43-b997-e9f3f6385ba3 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:22.280806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3ead7-9496-4d43-b997-e9f3f6385ba3 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:22.282494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 128/235] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:22.287985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109490c7-3c31-4991-8830-346680864029 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:22.288469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109490c7-3c31-4991-8830-346680864029 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:22.288565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109490c7-3c31-4991-8830-346680864029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:22.307070 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-109490c7-3c31-4991-8830-346680864029 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:22.308263 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-109490c7-3c31-4991-8830-346680864029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:22.316259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915855f-9241-4c98-b179-488ad7de1788 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:22.316576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915855f-9241-4c98-b179-488ad7de1788 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:22.316832 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915855f-9241-4c98-b179-488ad7de1788 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:22.318468 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 129/236] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:22.324429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52939f7c-7433-4c77-a19e-87545f4884ff None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:22.324713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52939f7c-7433-4c77-a19e-87545f4884ff None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:22.324987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52939f7c-7433-4c77-a19e-87545f4884ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:22.348106 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-52939f7c-7433-4c77-a19e-87545f4884ff None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:22.350166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-52939f7c-7433-4c77-a19e-87545f4884ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:22.390323 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:22.404313 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 108/237] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:22.424666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:22.437531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109490c7-3c31-4991-8830-346680864029 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:22.460664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 130/238] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:22.480393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52939f7c-7433-4c77-a19e-87545f4884ff None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:22.642808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109490c7-3c31-4991-8830-346680864029 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:22.657818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52939f7c-7433-4c77-a19e-87545f4884ff None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:22.695576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6a957-4fda-439a-ad93-69def706df1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:22.696810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6a957-4fda-439a-ad93-69def706df1d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:22.697636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6a957-4fda-439a-ad93-69def706df1d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:22.698108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6a957-4fda-439a-ad93-69def706df1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:22.699508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6a957-4fda-439a-ad93-69def706df1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:22.701693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6a957-4fda-439a-ad93-69def706df1d None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:22.704419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 131/239] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:22.710901 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6a957-4fda-439a-ad93-69def706df1d None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:22.737046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26c19b-eb91-4740-ad29-5be23b872133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:22.738233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26c19b-eb91-4740-ad29-5be23b872133 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:22.738708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26c19b-eb91-4740-ad29-5be23b872133 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:22.739211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26c19b-eb91-4740-ad29-5be23b872133 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:22.780928 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26c19b-eb91-4740-ad29-5be23b872133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:22.788657 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-9c26c19b-eb91-4740-ad29-5be23b872133 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:22.788883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:22.789747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:22.790525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:22.790525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:22.790525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:22.790525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:22.790525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:22.790525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:22.790525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:22.790525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:22.790525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:22.790525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:22.790525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:22.790525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:22.796717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 109/240] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:36:22.801343 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26c19b-eb91-4740-ad29-5be23b872133 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:22.846714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6a957-4fda-439a-ad93-69def706df1d None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:22.887823 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225c94c-4c60-4302-ab21-a400ca06ae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:22.888994 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225c94c-4c60-4302-ab21-a400ca06ae80 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:22.889503 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225c94c-4c60-4302-ab21-a400ca06ae80 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:22.890017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225c94c-4c60-4302-ab21-a400ca06ae80 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:22.891062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225c94c-4c60-4302-ab21-a400ca06ae80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:22.892908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225c94c-4c60-4302-ab21-a400ca06ae80 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:22.923766 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 132/241] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:36:22 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:22.963366 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:23.038084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26c19b-eb91-4740-ad29-5be23b872133 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:23.096312 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20d13f-9418-4dd9-a205-e3969eef045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:23.097025 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20d13f-9418-4dd9-a205-e3969eef045a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:23.097312 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20d13f-9418-4dd9-a205-e3969eef045a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:23.097588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20d13f-9418-4dd9-a205-e3969eef045a None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:23.098367 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20d13f-9418-4dd9-a205-e3969eef045a None admin] RBAC: Adding query filter params (name=reader) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:23.098678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20d13f-9418-4dd9-a205-e3969eef045a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:23.100110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20d13f-9418-4dd9-a205-e3969eef045a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:23.109974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 110/242] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:23.116007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225c94c-4c60-4302-ab21-a400ca06ae80 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:23.149615 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11adc7f-8f3d-4926-95c9-f7d096a7f23d None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:23.150075 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11adc7f-8f3d-4926-95c9-f7d096a7f23d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:23.150458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11adc7f-8f3d-4926-95c9-f7d096a7f23d None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:23.152062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 111/243] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:36:23.160198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4e18-b415-499a-824b-224a882b4d78 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:23.160453 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4e18-b415-499a-824b-224a882b4d78 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:23.160800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4e18-b415-499a-824b-224a882b4d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:23.184621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-719d4e18-b415-499a-824b-224a882b4d78 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:23.186040 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-719d4e18-b415-499a-824b-224a882b4d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:23.238816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225c94c-4c60-4302-ab21-a400ca06ae80 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:23.241787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:23.278788 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 112/244] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:23.287151 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f7887-3e23-455d-ab95-53ef4cd744d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:23.288181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f7887-3e23-455d-ab95-53ef4cd744d0 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:23.288562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f7887-3e23-455d-ab95-53ef4cd744d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:23.288902 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f7887-3e23-455d-ab95-53ef4cd744d0 None admin] PATH_INFO: `/v3/users/889aabf847434f87be99061a513f1b5c` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:23.302808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d4e18-b415-499a-824b-224a882b4d78 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:23.304046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f7887-3e23-455d-ab95-53ef4cd744d0 None admin] RBAC: Authorizing `identity:get_user(user_id=889aabf847434f87be99061a513f1b5c)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:23.305707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f7887-3e23-455d-ab95-53ef4cd744d0 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:23.307870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 133/245] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:23 2022] GET /identity/v3/users/889aabf847434f87be99061a513f1b5c => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:23.313803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f7887-3e23-455d-ab95-53ef4cd744d0 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:23.357451 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:23.414026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d4e18-b415-499a-824b-224a882b4d78 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:23.433785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f7887-3e23-455d-ab95-53ef4cd744d0 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:23.449604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05d92a-ec81-4d39-adfe-6c4129182aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:23.450494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05d92a-ec81-4d39-adfe-6c4129182aa2 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:23.450779 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05d92a-ec81-4d39-adfe-6c4129182aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:23.451056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05d92a-ec81-4d39-adfe-6c4129182aa2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:23.463652 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05d92a-ec81-4d39-adfe-6c4129182aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-fa05d92a-ec81-4d39-adfe-6c4129182aa2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:23.472149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:23.473085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:23.473954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:23.473954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:23.473954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:23.473954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:23.473954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:23.473954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:23.473954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:23.473954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:23.473954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:23.473954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:23.473954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:23.473954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:23.474539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb28778-f34d-489c-bcec-2a8a4c8b1129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:23.474539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb28778-f34d-489c-bcec-2a8a4c8b1129 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:23.474539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb28778-f34d-489c-bcec-2a8a4c8b1129 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:23.474539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb28778-f34d-489c-bcec-2a8a4c8b1129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:23.478426 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 113/246] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:23.479639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05d92a-ec81-4d39-adfe-6c4129182aa2 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:23.509462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:23.551772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb28778-f34d-489c-bcec-2a8a4c8b1129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:23.553477 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb28778-f34d-489c-bcec-2a8a4c8b1129 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:23.585643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05d92a-ec81-4d39-adfe-6c4129182aa2 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:23.595354 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:23.623324 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c090bd-25a6-4963-b171-df2c0e4f15f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:23.624040 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c090bd-25a6-4963-b171-df2c0e4f15f7 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:23.624352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c090bd-25a6-4963-b171-df2c0e4f15f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:23.624639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c090bd-25a6-4963-b171-df2c0e4f15f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:23.625477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c090bd-25a6-4963-b171-df2c0e4f15f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:23.625788 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c090bd-25a6-4963-b171-df2c0e4f15f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:23.627412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c090bd-25a6-4963-b171-df2c0e4f15f7 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:23.636850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 114/247] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:23.642975 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c090bd-25a6-4963-b171-df2c0e4f15f7 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:23.665041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 134/248] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 15:36:23.670919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb28778-f34d-489c-bcec-2a8a4c8b1129 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:23.734845 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:23.759199 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c090bd-25a6-4963-b171-df2c0e4f15f7 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:23.776623 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb28778-f34d-489c-bcec-2a8a4c8b1129 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:23.797772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349ea48-4305-4d0a-8424-29985408c5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:23.798692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349ea48-4305-4d0a-8424-29985408c5ae None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:23.798979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349ea48-4305-4d0a-8424-29985408c5ae None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:23.799689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349ea48-4305-4d0a-8424-29985408c5ae None admin] PATH_INFO: `/v3/users/7d8b99e6b5874ff28b529e8ba179d5d1` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:23.801007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349ea48-4305-4d0a-8424-29985408c5ae None admin] RBAC: Authorizing `identity:get_user(user_id=7d8b99e6b5874ff28b529e8ba179d5d1)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:23.802381 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349ea48-4305-4d0a-8424-29985408c5ae None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:23.804357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 115/249] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:23 2022] GET /identity/v3/users/7d8b99e6b5874ff28b529e8ba179d5d1 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:23.810483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349ea48-4305-4d0a-8424-29985408c5ae None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:23.815318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd1a68-22fd-4605-b6d5-3e6f452fb1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:23.816449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd1a68-22fd-4605-b6d5-3e6f452fb1d9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:23.816891 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd1a68-22fd-4605-b6d5-3e6f452fb1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:23.817300 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd1a68-22fd-4605-b6d5-3e6f452fb1d9 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:23.818687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd1a68-22fd-4605-b6d5-3e6f452fb1d9 None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:23.820378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd1a68-22fd-4605-b6d5-3e6f452fb1d9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:23.822366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 135/250] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:23 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:23.828456 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd1a68-22fd-4605-b6d5-3e6f452fb1d9 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:23.856070 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:23.927811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349ea48-4305-4d0a-8424-29985408c5ae None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:23.934895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd1a68-22fd-4605-b6d5-3e6f452fb1d9 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:23.965985 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:23.967815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2d73c-060f-4326-befb-b47903cdf387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:23.970005 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2d73c-060f-4326-befb-b47903cdf387 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:23.970322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2d73c-060f-4326-befb-b47903cdf387 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:23.970769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2d73c-060f-4326-befb-b47903cdf387 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:23.972057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2d73c-060f-4326-befb-b47903cdf387 None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:23.973172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90c91d-b5e8-4ce2-934f-5ff2e825f325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:23.973621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2d73c-060f-4326-befb-b47903cdf387 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:23.974267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90c91d-b5e8-4ce2-934f-5ff2e825f325 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:23.974691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90c91d-b5e8-4ce2-934f-5ff2e825f325 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:23.975101 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90c91d-b5e8-4ce2-934f-5ff2e825f325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:23.976110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90c91d-b5e8-4ce2-934f-5ff2e825f325 None admin] RBAC: Adding query filter params (role.id=f25a1522772f4a8683f4c221dff1093a, scope.project.id=21d24ab37b7c4dbaa4794944fac657c0, user.id=889aabf847434f87be99061a513f1b5c) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:23.976600 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90c91d-b5e8-4ce2-934f-5ff2e825f325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:23.978220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90c91d-b5e8-4ce2-934f-5ff2e825f325 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:23.978797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 116/251] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:23 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:23.982917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2d73c-060f-4326-befb-b47903cdf387 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:23.985422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 136/252] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:23 2022] GET /identity/v3/role_assignments?user.id=889aabf847434f87be99061a513f1b5c&scope.project.id=21d24ab37b7c4dbaa4794944fac657c0&role.id=f25a1522772f4a8683f4c221dff1093a => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:24.107004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2d73c-060f-4326-befb-b47903cdf387 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:24.115461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:24.148986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bd6a2-8dce-4413-868a-31c8b3674845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:24.149925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd6a2-8dce-4413-868a-31c8b3674845 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:24.150210 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd6a2-8dce-4413-868a-31c8b3674845 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:24.150489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd6a2-8dce-4413-868a-31c8b3674845 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0/users/7d8b99e6b5874ff28b529e8ba179d5d1/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:24.152575 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bd6a2-8dce-4413-868a-31c8b3674845 None admin] RBAC: Authorizing `identity:create_grant(project_id=21d24ab37b7c4dbaa4794944fac657c0, user_id=7d8b99e6b5874ff28b529e8ba179d5d1, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:24.154026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bd6a2-8dce-4413-868a-31c8b3674845 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:24.169612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 117/253] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:36:23 2022] PUT /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0/users/7d8b99e6b5874ff28b529e8ba179d5d1/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:36:24.298672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08f890-f99e-410c-819f-4d7e88b63d0f None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:24.299002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08f890-f99e-410c-819f-4d7e88b63d0f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:24.299232 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08f890-f99e-410c-819f-4d7e88b63d0f None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:24.301002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 137/254] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:24.306708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2348ef-578f-4aaa-9686-2edc341a484e None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:24.307224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2348ef-578f-4aaa-9686-2edc341a484e None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:24.307301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2348ef-578f-4aaa-9686-2edc341a484e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:24.332818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-4e2348ef-578f-4aaa-9686-2edc341a484e None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:24.334898 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4e2348ef-578f-4aaa-9686-2edc341a484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:24.417959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 118/255] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:24.451204 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08f890-f99e-410c-819f-4d7e88b63d0f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:24.583358 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08f890-f99e-410c-819f-4d7e88b63d0f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:24.621161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8d217-b265-4c6a-b161-f9228cd00e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:24.622013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d217-b265-4c6a-b161-f9228cd00e6b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:24.622298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d217-b265-4c6a-b161-f9228cd00e6b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:24.622571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d217-b265-4c6a-b161-f9228cd00e6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:24.634099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8d217-b265-4c6a-b161-f9228cd00e6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-eec8d217-b265-4c6a-b161-f9228cd00e6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:24.641990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:24.642882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:24.643662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:24.643662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:24.643662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:24.643662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:24.643662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:24.643662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:24.643662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:24.643662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:24.643662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:24.643662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:24.643662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:24.643662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:24.643662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 138/256] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:36:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:24.650911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2348ef-578f-4aaa-9686-2edc341a484e None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:24.759806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:24.768677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2348ef-578f-4aaa-9686-2edc341a484e None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:24.813750 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7ca44-05b7-4c22-bc2a-bc14558f9c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:24.814442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7ca44-05b7-4c22-bc2a-bc14558f9c69 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:24.814731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7ca44-05b7-4c22-bc2a-bc14558f9c69 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:24.815016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7ca44-05b7-4c22-bc2a-bc14558f9c69 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:24.815795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7ca44-05b7-4c22-bc2a-bc14558f9c69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:24.816113 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7ca44-05b7-4c22-bc2a-bc14558f9c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:24.817541 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7ca44-05b7-4c22-bc2a-bc14558f9c69 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:24.832251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 119/257] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:24.838423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8d217-b265-4c6a-b161-f9228cd00e6b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:24.882615 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0acac5-eb8f-4920-a0ec-0f7205593009 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:24.882936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0acac5-eb8f-4920-a0ec-0f7205593009 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:24.883179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0acac5-eb8f-4920-a0ec-0f7205593009 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:24.884778 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 120/258] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:36:24.889706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da444201-27bf-4f45-ae1f-39e0332ae9ba None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:24.889993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da444201-27bf-4f45-ae1f-39e0332ae9ba None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:24.890321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da444201-27bf-4f45-ae1f-39e0332ae9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:24.919965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-da444201-27bf-4f45-ae1f-39e0332ae9ba None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:24.921689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-da444201-27bf-4f45-ae1f-39e0332ae9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:24.941087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:25.024622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8d217-b265-4c6a-b161-f9228cd00e6b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:25.066115 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 121/259] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:25.076351 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0660c15-9528-46ff-99c2-03b7fef1347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:25.077246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0660c15-9528-46ff-99c2-03b7fef1347f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:25.077532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0660c15-9528-46ff-99c2-03b7fef1347f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:25.077895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0660c15-9528-46ff-99c2-03b7fef1347f None admin] PATH_INFO: `/v3/users/50260b91f0cc4c88b5ef72a6ca8b483b` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:25.079133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0660c15-9528-46ff-99c2-03b7fef1347f None admin] RBAC: Authorizing `identity:get_user(user_id=50260b91f0cc4c88b5ef72a6ca8b483b)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:25.080646 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0660c15-9528-46ff-99c2-03b7fef1347f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:25.082634 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 139/260] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:24 2022] GET /identity/v3/users/50260b91f0cc4c88b5ef72a6ca8b483b => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:25.089093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da444201-27bf-4f45-ae1f-39e0332ae9ba None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:25.103273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0660c15-9528-46ff-99c2-03b7fef1347f None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:25.253433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:25.276729 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da444201-27bf-4f45-ae1f-39e0332ae9ba None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:25.287549 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0660c15-9528-46ff-99c2-03b7fef1347f None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:25.311445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788b709-71b8-471f-af03-09361abc1681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:25.312251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788b709-71b8-471f-af03-09361abc1681 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:25.312610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788b709-71b8-471f-af03-09361abc1681 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:25.312889 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788b709-71b8-471f-af03-09361abc1681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:25.332853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:25.355903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4f520-52eb-4199-974d-ab09511e299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:25.356760 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4f520-52eb-4199-974d-ab09511e299b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:25.357035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4f520-52eb-4199-974d-ab09511e299b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:25.357306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4f520-52eb-4199-974d-ab09511e299b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:25.373421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4f520-52eb-4199-974d-ab09511e299b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-9cb4f520-52eb-4199-974d-ab09511e299b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:25.394693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:25.395473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:25.395473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:25.395473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:25.395473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:25.395473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:25.395473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:25.395473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:25.395473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:25.395473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:25.395473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:25.395473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:25.395473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:25.395473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 140/261] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:36:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:36:25.402356 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4f520-52eb-4199-974d-ab09511e299b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:25.447183 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788b709-71b8-471f-af03-09361abc1681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:25.448728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788b709-71b8-471f-af03-09361abc1681 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:25.534853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4f520-52eb-4199-974d-ab09511e299b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:25.572165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467845ca-e628-421b-94ce-ca6b47eeb76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:25.572935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467845ca-e628-421b-94ce-ca6b47eeb76e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:25.573213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467845ca-e628-421b-94ce-ca6b47eeb76e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:25.573485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467845ca-e628-421b-94ce-ca6b47eeb76e None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:25.574712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467845ca-e628-421b-94ce-ca6b47eeb76e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:25.576140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467845ca-e628-421b-94ce-ca6b47eeb76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:25.577713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467845ca-e628-421b-94ce-ca6b47eeb76e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:25.589123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 141/262] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:25.596067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467845ca-e628-421b-94ce-ca6b47eeb76e None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:25.614061 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:25.630165 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 122/263] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:25.635605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788b709-71b8-471f-af03-09361abc1681 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:25.740695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:25.743790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788b709-71b8-471f-af03-09361abc1681 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:25.780608 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a1a58-d7ce-4a2d-a70b-507d3f575a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:25.781535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a1a58-d7ce-4a2d-a70b-507d3f575a4f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:25.781812 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a1a58-d7ce-4a2d-a70b-507d3f575a4f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:25.782085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a1a58-d7ce-4a2d-a70b-507d3f575a4f None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:25.783327 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a1a58-d7ce-4a2d-a70b-507d3f575a4f None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:25.784927 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a1a58-d7ce-4a2d-a70b-507d3f575a4f None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:25.786959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 123/264] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:25 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:25.792805 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a1a58-d7ce-4a2d-a70b-507d3f575a4f None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:25.840484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467845ca-e628-421b-94ce-ca6b47eeb76e None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:25.849202 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:25.896487 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a1a58-d7ce-4a2d-a70b-507d3f575a4f None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:25.905860 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae290e0-8b13-47d8-b437-ac5b4a02276f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:25.906862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae290e0-8b13-47d8-b437-ac5b4a02276f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:25.907148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae290e0-8b13-47d8-b437-ac5b4a02276f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:25.907428 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae290e0-8b13-47d8-b437-ac5b4a02276f None admin] PATH_INFO: `/v3/users/50260b91f0cc4c88b5ef72a6ca8b483b` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:25.913023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae290e0-8b13-47d8-b437-ac5b4a02276f None admin] RBAC: Authorizing `identity:get_user(user_id=50260b91f0cc4c88b5ef72a6ca8b483b)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:25.914512 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae290e0-8b13-47d8-b437-ac5b4a02276f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:25.916654 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 142/265] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:25 2022] GET /identity/v3/users/50260b91f0cc4c88b5ef72a6ca8b483b => generated 283 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:25.922039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae290e0-8b13-47d8-b437-ac5b4a02276f None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:25.932442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41dfb8-a5c7-460f-95ef-324feb47d432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:25.933117 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41dfb8-a5c7-460f-95ef-324feb47d432 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:25.933395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41dfb8-a5c7-460f-95ef-324feb47d432 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:25.933666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41dfb8-a5c7-460f-95ef-324feb47d432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:25.934503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41dfb8-a5c7-460f-95ef-324feb47d432 None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=21d24ab37b7c4dbaa4794944fac657c0, user.id=50260b91f0cc4c88b5ef72a6ca8b483b) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:25.934811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41dfb8-a5c7-460f-95ef-324feb47d432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:25.936258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41dfb8-a5c7-460f-95ef-324feb47d432 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:25.943300 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 124/266] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:25 2022] GET /identity/v3/role_assignments?user.id=50260b91f0cc4c88b5ef72a6ca8b483b&scope.project.id=21d24ab37b7c4dbaa4794944fac657c0&role.id=32f5ce5800cf40d99d894960288d0155 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:26.046419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae290e0-8b13-47d8-b437-ac5b4a02276f None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:26.072702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:26.083378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457abc29-bb3b-40a4-8897-fd31de13f366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:26.084663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457abc29-bb3b-40a4-8897-fd31de13f366 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:26.085331 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457abc29-bb3b-40a4-8897-fd31de13f366 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:26.085852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457abc29-bb3b-40a4-8897-fd31de13f366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:26.157862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457abc29-bb3b-40a4-8897-fd31de13f366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:26.159351 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457abc29-bb3b-40a4-8897-fd31de13f366 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:26.267852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 143/267] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 15:36:26.277450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41dfb8-a5c7-460f-95ef-324feb47d432 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:26.409394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41dfb8-a5c7-460f-95ef-324feb47d432 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:26.433160 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:26.444251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a192b-acb4-457e-92aa-0ecc3da441f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:26.445164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a192b-acb4-457e-92aa-0ecc3da441f6 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:26.445448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a192b-acb4-457e-92aa-0ecc3da441f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:26.445718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a192b-acb4-457e-92aa-0ecc3da441f6 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:26.446904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a192b-acb4-457e-92aa-0ecc3da441f6 None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:26.448398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a192b-acb4-457e-92aa-0ecc3da441f6 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:26.450308 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 125/268] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:26 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:26.456317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457abc29-bb3b-40a4-8897-fd31de13f366 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:26.479807 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:26.592633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457abc29-bb3b-40a4-8897-fd31de13f366 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:26.599294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ebf07-bfda-4c73-b2d2-b4b00f1c23bb None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:26.599896 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ebf07-bfda-4c73-b2d2-b4b00f1c23bb None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:26.600410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ebf07-bfda-4c73-b2d2-b4b00f1c23bb None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:26.602023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 126/269] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:36:26.607795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a5fa0-e0d9-415d-bbc8-986147efa696 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:26.608455 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a5fa0-e0d9-415d-bbc8-986147efa696 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:26.608935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a5fa0-e0d9-415d-bbc8-986147efa696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:26.627364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-779a5fa0-e0d9-415d-bbc8-986147efa696 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:26.629088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-779a5fa0-e0d9-415d-bbc8-986147efa696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:26.641455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1115790-2205-4d74-b1de-71b0bba801dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:26.642454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1115790-2205-4d74-b1de-71b0bba801dc None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:26.642959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1115790-2205-4d74-b1de-71b0bba801dc None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:26.643431 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1115790-2205-4d74-b1de-71b0bba801dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:26.644586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1115790-2205-4d74-b1de-71b0bba801dc None admin] RBAC: Adding query filter params (role.id=49eaa4df59ae423fa6913302fe982e4e, scope.project.id=21d24ab37b7c4dbaa4794944fac657c0, user.id=50260b91f0cc4c88b5ef72a6ca8b483b) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:26.645100 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1115790-2205-4d74-b1de-71b0bba801dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:26.647059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1115790-2205-4d74-b1de-71b0bba801dc None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:26.655803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 144/270] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:26 2022] GET /identity/v3/role_assignments?user.id=50260b91f0cc4c88b5ef72a6ca8b483b&scope.project.id=21d24ab37b7c4dbaa4794944fac657c0&role.id=49eaa4df59ae423fa6913302fe982e4e => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:26.740343 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 127/271] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:26.781537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1115790-2205-4d74-b1de-71b0bba801dc None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:26.890869 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:26.923394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1115790-2205-4d74-b1de-71b0bba801dc None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:26.964678 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14557cd9-9f92-42e3-b3ee-3dcd75ac09cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:26.965968 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14557cd9-9f92-42e3-b3ee-3dcd75ac09cb None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:26.966459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14557cd9-9f92-42e3-b3ee-3dcd75ac09cb None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:26.966928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14557cd9-9f92-42e3-b3ee-3dcd75ac09cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:26.968500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14557cd9-9f92-42e3-b3ee-3dcd75ac09cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:26.970233 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14557cd9-9f92-42e3-b3ee-3dcd75ac09cb None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:26.972588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 145/272] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:26.978929 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a5fa0-e0d9-415d-bbc8-986147efa696 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:27.003493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9cfc5-e1f1-46e6-99e3-b8078f745ea9 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:27.003774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9cfc5-e1f1-46e6-99e3-b8078f745ea9 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:27.003975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9cfc5-e1f1-46e6-99e3-b8078f745ea9 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:27.006006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 146/273] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:27.012570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8efe20-45ca-42e0-8d88-7743799af1c1 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:27.012789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8efe20-45ca-42e0-8d88-7743799af1c1 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:27.013018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8efe20-45ca-42e0-8d88-7743799af1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:27.035133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-0d8efe20-45ca-42e0-8d88-7743799af1c1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:27.036910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-0d8efe20-45ca-42e0-8d88-7743799af1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:27.106397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a5fa0-e0d9-415d-bbc8-986147efa696 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:27.126299 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:27.133617 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 147/274] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:27.134749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c2b7f-6542-490d-a321-0d91024a3453 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:27.135047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c2b7f-6542-490d-a321-0d91024a3453 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:27.135317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c2b7f-6542-490d-a321-0d91024a3453 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:27.136652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 148/275] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:27.142200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af50f3c-08df-49a3-b65e-698da3835bcf None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:27.142489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af50f3c-08df-49a3-b65e-698da3835bcf None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:27.142778 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af50f3c-08df-49a3-b65e-698da3835bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:27.150417 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f276e45-a8e0-49aa-9e02-07f1a26acc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:27.151618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f276e45-a8e0-49aa-9e02-07f1a26acc16 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:27.152113 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f276e45-a8e0-49aa-9e02-07f1a26acc16 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:27.152605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f276e45-a8e0-49aa-9e02-07f1a26acc16 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:27.154642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f276e45-a8e0-49aa-9e02-07f1a26acc16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:27.156831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f276e45-a8e0-49aa-9e02-07f1a26acc16 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:27.159910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-5af50f3c-08df-49a3-b65e-698da3835bcf None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:27.161140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5af50f3c-08df-49a3-b65e-698da3835bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:27.181874 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 128/276] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:36:26 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:27.184454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f276e45-a8e0-49aa-9e02-07f1a26acc16 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:27.248899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 149/277] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:27.250512 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55553f-5a60-4ced-b792-4d2e49f548d9 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:27.250877 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55553f-5a60-4ced-b792-4d2e49f548d9 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:27.251097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55553f-5a60-4ced-b792-4d2e49f548d9 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:27.252422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 150/278] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:27.258510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c49391-2741-42d4-a92e-e548bd447991 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:27.258790 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c49391-2741-42d4-a92e-e548bd447991 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:27.258994 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c49391-2741-42d4-a92e-e548bd447991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:27.266642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:27.279138 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-70c49391-2741-42d4-a92e-e548bd447991 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:27.280481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-70c49391-2741-42d4-a92e-e548bd447991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:27.323819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f276e45-a8e0-49aa-9e02-07f1a26acc16 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:27.363588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 151/279] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:27.364429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c49391-2741-42d4-a92e-e548bd447991 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:27.365374 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc440a-d435-4c30-aab2-038235cbd19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:27.366513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc440a-d435-4c30-aab2-038235cbd19a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:27.366798 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc440a-d435-4c30-aab2-038235cbd19a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:27.367074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc440a-d435-4c30-aab2-038235cbd19a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:27.379424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc440a-d435-4c30-aab2-038235cbd19a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-6acc440a-d435-4c30-aab2-038235cbd19a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:27.388074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:27.389050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:27.389833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:27.389833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:27.389833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:27.389833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:27.389833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:27.389833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:27.389833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:27.389833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:27.389833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:27.389833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:27.389833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:27.389833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:27.389833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 129/280] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:27.390881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc440a-d435-4c30-aab2-038235cbd19a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:27.443726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:27.494784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c49391-2741-42d4-a92e-e548bd447991 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:27.530506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc440a-d435-4c30-aab2-038235cbd19a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:27.535983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf06c40-7d44-4259-a704-0b5ae39c3805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:27.536848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf06c40-7d44-4259-a704-0b5ae39c3805 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:27.537130 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf06c40-7d44-4259-a704-0b5ae39c3805 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:27.537400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf06c40-7d44-4259-a704-0b5ae39c3805 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:27.541095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:27.552345 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf06c40-7d44-4259-a704-0b5ae39c3805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-2bf06c40-7d44-4259-a704-0b5ae39c3805 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:27.560093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:27.561023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:27.561839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:27.561839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:27.561839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:27.561839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:27.561839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:27.561839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:27.561839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:27.561839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:27.561839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:27.561839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:27.561839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:27.561839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:27.562498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 152/281] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:27.563679 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf06c40-7d44-4259-a704-0b5ae39c3805 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:27.581642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80acc33-bde2-499c-8954-2bb25a56514e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:27.582462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80acc33-bde2-499c-8954-2bb25a56514e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:27.582749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80acc33-bde2-499c-8954-2bb25a56514e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:27.583037 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80acc33-bde2-499c-8954-2bb25a56514e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:27.594672 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80acc33-bde2-499c-8954-2bb25a56514e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-f80acc33-bde2-499c-8954-2bb25a56514e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:27.602468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:27.603499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:27.604775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:27.604775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:27.604775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:27.604775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:27.604775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:27.604775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:27.604775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:27.604775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:27.604775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:27.604775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:27.604775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:27.604775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:27.604775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 130/282] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:27.609691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80acc33-bde2-499c-8954-2bb25a56514e None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:27.694125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf06c40-7d44-4259-a704-0b5ae39c3805 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:27.716115 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:27.724218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80acc33-bde2-499c-8954-2bb25a56514e None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:27.743135 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088171c-6651-4287-9b9d-b7a6f86f2018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:27.744473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088171c-6651-4287-9b9d-b7a6f86f2018 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:27.745304 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088171c-6651-4287-9b9d-b7a6f86f2018 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:27.745786 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088171c-6651-4287-9b9d-b7a6f86f2018 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:27.746733 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088171c-6651-4287-9b9d-b7a6f86f2018 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:27.747225 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088171c-6651-4287-9b9d-b7a6f86f2018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:27.749677 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088171c-6651-4287-9b9d-b7a6f86f2018 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:27.761951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 153/283] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:27.763121 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088171c-6651-4287-9b9d-b7a6f86f2018 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:27.768862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b1bad-bda7-420e-b45f-0f7219ab2392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:27.769570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1bad-bda7-420e-b45f-0f7219ab2392 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:27.769855 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1bad-bda7-420e-b45f-0f7219ab2392 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:27.770130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1bad-bda7-420e-b45f-0f7219ab2392 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:27.770984 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b1bad-bda7-420e-b45f-0f7219ab2392 None admin] RBAC: Adding query filter params (name=member) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:27.771298 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b1bad-bda7-420e-b45f-0f7219ab2392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:27.772817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b1bad-bda7-420e-b45f-0f7219ab2392 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:27.782870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 131/284] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:27.787988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b1bad-bda7-420e-b45f-0f7219ab2392 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:27.848727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:27.899986 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088171c-6651-4287-9b9d-b7a6f86f2018 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:27.911264 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b1bad-bda7-420e-b45f-0f7219ab2392 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:27.938465 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d2baf-6099-4f32-a114-e85921a2f815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:27.939262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d2baf-6099-4f32-a114-e85921a2f815 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:27.939612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d2baf-6099-4f32-a114-e85921a2f815 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:27.939966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d2baf-6099-4f32-a114-e85921a2f815 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:27.940869 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d2baf-6099-4f32-a114-e85921a2f815 None admin] RBAC: Adding query filter params (name=member) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:27.941245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d2baf-6099-4f32-a114-e85921a2f815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:27.942892 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d2baf-6099-4f32-a114-e85921a2f815 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:27.951831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 154/285] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:27.955428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efd462-060b-4517-928d-5f68952f87f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:27.956552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efd462-060b-4517-928d-5f68952f87f7 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:27.957006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efd462-060b-4517-928d-5f68952f87f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:27.957154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d2baf-6099-4f32-a114-e85921a2f815 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:27.957964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efd462-060b-4517-928d-5f68952f87f7 None admin] PATH_INFO: `/v3/users/889aabf847434f87be99061a513f1b5c` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:27.959350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efd462-060b-4517-928d-5f68952f87f7 None admin] RBAC: Authorizing `identity:get_user(user_id=889aabf847434f87be99061a513f1b5c)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:27.962446 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efd462-060b-4517-928d-5f68952f87f7 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:27.964619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 132/286] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:27 2022] GET /identity/v3/users/889aabf847434f87be99061a513f1b5c => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:27.965593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efd462-060b-4517-928d-5f68952f87f7 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:27.995835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:28.077644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d2baf-6099-4f32-a114-e85921a2f815 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:28.093182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efd462-060b-4517-928d-5f68952f87f7 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:28.098586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:28.118061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1a2e7-4c3c-4b31-a393-0c53b09b1051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:28.118959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1a2e7-4c3c-4b31-a393-0c53b09b1051 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:28.119241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1a2e7-4c3c-4b31-a393-0c53b09b1051 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:28.119516 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1a2e7-4c3c-4b31-a393-0c53b09b1051 None admin] PATH_INFO: `/v3/users/70f171af49b8493797704cacd4a844ff` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:28.134165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1a2e7-4c3c-4b31-a393-0c53b09b1051 None admin] RBAC: Authorizing `identity:get_user(user_id=70f171af49b8493797704cacd4a844ff)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:28.135681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1a2e7-4c3c-4b31-a393-0c53b09b1051 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:28.137463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 155/287] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:27 2022] GET /identity/v3/users/70f171af49b8493797704cacd4a844ff => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:28.139885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc5594-b8ae-4518-bd0b-b8bd77eb85b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:28.141090 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc5594-b8ae-4518-bd0b-b8bd77eb85b5 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:28.141621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc5594-b8ae-4518-bd0b-b8bd77eb85b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:28.142084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc5594-b8ae-4518-bd0b-b8bd77eb85b5 None admin] PATH_INFO: `/v3/users/7d8b99e6b5874ff28b529e8ba179d5d1` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:28.143197 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1a2e7-4c3c-4b31-a393-0c53b09b1051 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:28.144064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc5594-b8ae-4518-bd0b-b8bd77eb85b5 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8b99e6b5874ff28b529e8ba179d5d1)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:28.145739 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc5594-b8ae-4518-bd0b-b8bd77eb85b5 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:28.149177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 133/288] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:27 2022] GET /identity/v3/users/7d8b99e6b5874ff28b529e8ba179d5d1 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:28.150136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc5594-b8ae-4518-bd0b-b8bd77eb85b5 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:28.266724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1a2e7-4c3c-4b31-a393-0c53b09b1051 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:28.267666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:28.279032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc5594-b8ae-4518-bd0b-b8bd77eb85b5 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:28.318409 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c1734-5e2e-497c-806b-e09d419a53aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:28.319114 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c1734-5e2e-497c-806b-e09d419a53aa None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:28.319394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c1734-5e2e-497c-806b-e09d419a53aa None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:28.319671 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c1734-5e2e-497c-806b-e09d419a53aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:28.320550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c1734-5e2e-497c-806b-e09d419a53aa None admin] RBAC: Adding query filter params (role.id=7df8c80cd6f643d6aa8ecd8281781a3f, user.id=70f171af49b8493797704cacd4a844ff, scope.system=all) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:28.320864 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c1734-5e2e-497c-806b-e09d419a53aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:28.322335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c1734-5e2e-497c-806b-e09d419a53aa None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:28.323433 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7c0d0-82bb-4a94-a224-67f72a4e3186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:28.325260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7c0d0-82bb-4a94-a224-67f72a4e3186 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:28.325857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7c0d0-82bb-4a94-a224-67f72a4e3186 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:28.326399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7c0d0-82bb-4a94-a224-67f72a4e3186 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:28.328073 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7c0d0-82bb-4a94-a224-67f72a4e3186 None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:28.329730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7c0d0-82bb-4a94-a224-67f72a4e3186 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:28.332098 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 156/289] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:28 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:28.332522 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 134/290] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Jul 11 15:36:28 2022] GET /identity/v3/role_assignments?user.id=70f171af49b8493797704cacd4a844ff&scope.system=all&role.id=7df8c80cd6f643d6aa8ecd8281781a3f => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:28.333315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7c0d0-82bb-4a94-a224-67f72a4e3186 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:28.346852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c1734-5e2e-497c-806b-e09d419a53aa None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:28.392737 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:28.493944 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7c0d0-82bb-4a94-a224-67f72a4e3186 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:28.546897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d5880-7bc6-4afe-8929-31e3a19b975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:28.548427 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d5880-7bc6-4afe-8929-31e3a19b975d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:28.549934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d5880-7bc6-4afe-8929-31e3a19b975d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:28.550463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d5880-7bc6-4afe-8929-31e3a19b975d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:28.617888 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c1734-5e2e-497c-806b-e09d419a53aa None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:28.654550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d5880-7bc6-4afe-8929-31e3a19b975d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:28.657311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d5880-7bc6-4afe-8929-31e3a19b975d None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:28.657728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea50d9-19d5-47c4-a8d0-29034ce01167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:28.658715 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea50d9-19d5-47c4-a8d0-29034ce01167 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:28.659209 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea50d9-19d5-47c4-a8d0-29034ce01167 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:28.659664 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea50d9-19d5-47c4-a8d0-29034ce01167 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0/users/889aabf847434f87be99061a513f1b5c/roles/f25a1522772f4a8683f4c221dff1093a` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:28.662735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea50d9-19d5-47c4-a8d0-29034ce01167 None admin] RBAC: Authorizing `identity:create_grant(project_id=21d24ab37b7c4dbaa4794944fac657c0, user_id=889aabf847434f87be99061a513f1b5c, role_id=f25a1522772f4a8683f4c221dff1093a)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:28.664517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea50d9-19d5-47c4-a8d0-29034ce01167 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:28.700191 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 135/291] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:36:28 2022] PUT /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0/users/889aabf847434f87be99061a513f1b5c/roles/f25a1522772f4a8683f4c221dff1093a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:28.733597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:28.802995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 157/292] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:28.806275 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea50d9-19d5-47c4-a8d0-29034ce01167 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:28.833558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:28.922728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea50d9-19d5-47c4-a8d0-29034ce01167 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:28.960305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d13e84-c986-4757-8822-baac9321ef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:28.961215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d13e84-c986-4757-8822-baac9321ef8d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:28.961502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d13e84-c986-4757-8822-baac9321ef8d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:28.961777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d13e84-c986-4757-8822-baac9321ef8d None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:28.963362 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d13e84-c986-4757-8822-baac9321ef8d None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:28.964901 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d13e84-c986-4757-8822-baac9321ef8d None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:28.971862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 136/293] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:28 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:28.973394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d5880-7bc6-4afe-8929-31e3a19b975d None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:29.092165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d5880-7bc6-4afe-8929-31e3a19b975d None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:29.132689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5212ad-01cc-4613-848e-9efb127af955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:29.133368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5212ad-01cc-4613-848e-9efb127af955 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:29.133654 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5212ad-01cc-4613-848e-9efb127af955 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:29.133931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5212ad-01cc-4613-848e-9efb127af955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:29.134795 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5212ad-01cc-4613-848e-9efb127af955 None admin] RBAC: Adding query filter params (role.id=7df8c80cd6f643d6aa8ecd8281781a3f, scope.project.id=21d24ab37b7c4dbaa4794944fac657c0, user.id=7d8b99e6b5874ff28b529e8ba179d5d1) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:29.135107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5212ad-01cc-4613-848e-9efb127af955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:29.136672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5212ad-01cc-4613-848e-9efb127af955 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:29.144339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 158/294] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:28 2022] GET /identity/v3/role_assignments?user.id=7d8b99e6b5874ff28b529e8ba179d5d1&scope.project.id=21d24ab37b7c4dbaa4794944fac657c0&role.id=7df8c80cd6f643d6aa8ecd8281781a3f => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:29.481347 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ee46d-f061-4ffb-b319-4d22c1c92d3e None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:29.481693 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ee46d-f061-4ffb-b319-4d22c1c92d3e None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:29.482019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ee46d-f061-4ffb-b319-4d22c1c92d3e None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:29.483718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 137/295] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:29.489842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eab220-38af-450b-8014-7af3f51b6f81 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:29.490404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eab220-38af-450b-8014-7af3f51b6f81 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:29.490882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eab220-38af-450b-8014-7af3f51b6f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:29.512466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-42eab220-38af-450b-8014-7af3f51b6f81 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:29.513999 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-42eab220-38af-450b-8014-7af3f51b6f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:29.516455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:29.606934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 159/296] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:29.627268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8679dd-a4ed-4550-a2a9-1062befb9608 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:29.628200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8679dd-a4ed-4550-a2a9-1062befb9608 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:29.628774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8679dd-a4ed-4550-a2a9-1062befb9608 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:29.630458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 138/297] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:29.635353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e847f-e69b-47bb-b82b-3dfdc519c39b None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:29.635891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e847f-e69b-47bb-b82b-3dfdc519c39b None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:29.636176 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e847f-e69b-47bb-b82b-3dfdc519c39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:29.637916 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eab220-38af-450b-8014-7af3f51b6f81 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:29.658719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-604e847f-e69b-47bb-b82b-3dfdc519c39b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:29.660384 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-604e847f-e69b-47bb-b82b-3dfdc519c39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:29.737044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 139/298] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:29.760368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e847f-e69b-47bb-b82b-3dfdc519c39b None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:29.761175 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eab220-38af-450b-8014-7af3f51b6f81 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:29.777295 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:29.809856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5cdd3-5a32-405f-b143-1b5982f1115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:29.811154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5cdd3-5a32-405f-b143-1b5982f1115d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:29.811451 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5cdd3-5a32-405f-b143-1b5982f1115d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:29.811733 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5cdd3-5a32-405f-b143-1b5982f1115d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:29.821312 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:29.827937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5cdd3-5a32-405f-b143-1b5982f1115d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-5ad5cdd3-5a32-405f-b143-1b5982f1115d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:29.839361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:29.840229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:29.841340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:29.841340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:29.841340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:29.841340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:29.841340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:29.841340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:29.841340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:29.841340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:29.841340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:29.841340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:29.841340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:29.841340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:29.841340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 160/299] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:29.847364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5cdd3-5a32-405f-b143-1b5982f1115d None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:29.873623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e847f-e69b-47bb-b82b-3dfdc519c39b None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:29.911004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaa01d-c7f2-406d-81f2-ecfe163dc24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:29.912176 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaa01d-c7f2-406d-81f2-ecfe163dc24b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:29.912697 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaa01d-c7f2-406d-81f2-ecfe163dc24b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:29.913156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaa01d-c7f2-406d-81f2-ecfe163dc24b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:29.914692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aaa01d-c7f2-406d-81f2-ecfe163dc24b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:29.916730 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aaa01d-c7f2-406d-81f2-ecfe163dc24b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:29.923870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 140/300] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:29.925260 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaa01d-c7f2-406d-81f2-ecfe163dc24b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:29.983793 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5cdd3-5a32-405f-b143-1b5982f1115d None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:30.017010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:30.031628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25c090-190a-4fd6-8c09-9429d9b7d215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:30.032733 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25c090-190a-4fd6-8c09-9429d9b7d215 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:30.033037 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25c090-190a-4fd6-8c09-9429d9b7d215 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:30.033318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25c090-190a-4fd6-8c09-9429d9b7d215 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:30.034369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25c090-190a-4fd6-8c09-9429d9b7d215 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:30.034685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25c090-190a-4fd6-8c09-9429d9b7d215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:30.036768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25c090-190a-4fd6-8c09-9429d9b7d215 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:30.039847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaa01d-c7f2-406d-81f2-ecfe163dc24b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:30.047131 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 161/301] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:30.052848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25c090-190a-4fd6-8c09-9429d9b7d215 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:30.077558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c575146-aa9f-4971-95ee-579d66042775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:30.078773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c575146-aa9f-4971-95ee-579d66042775 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:30.079293 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c575146-aa9f-4971-95ee-579d66042775 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:30.079778 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c575146-aa9f-4971-95ee-579d66042775 None admin] PATH_INFO: `/v3/groups` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:30.080690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c575146-aa9f-4971-95ee-579d66042775 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:30.082530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c575146-aa9f-4971-95ee-579d66042775 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:30.101341 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 141/302] 10.222.0.26 () {60 vars in 1134 bytes} [Mon Jul 11 15:36:29 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:30.117091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:30.163385 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25c090-190a-4fd6-8c09-9429d9b7d215 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:30.213430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8c895-e76b-4cd5-bfef-de6a878d1310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:30.214344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8c895-e76b-4cd5-bfef-de6a878d1310 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:30.214625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8c895-e76b-4cd5-bfef-de6a878d1310 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:30.214905 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8c895-e76b-4cd5-bfef-de6a878d1310 None admin] PATH_INFO: `/v3/users/74193efeffe84cfdb7f1619821ce0930` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:30.232146 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8c895-e76b-4cd5-bfef-de6a878d1310 None admin] RBAC: Authorizing `identity:get_user(user_id=74193efeffe84cfdb7f1619821ce0930)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:30.233877 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8c895-e76b-4cd5-bfef-de6a878d1310 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:30.240453 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 162/303] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:30 2022] GET /identity/v3/users/74193efeffe84cfdb7f1619821ce0930 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:30.242605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c575146-aa9f-4971-95ee-579d66042775 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:30.349676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c575146-aa9f-4971-95ee-579d66042775 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:30.384707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40d8eb-aad4-4124-ac53-8f8ef9e14066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:30.385389 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40d8eb-aad4-4124-ac53-8f8ef9e14066 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:30.385671 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40d8eb-aad4-4124-ac53-8f8ef9e14066 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:30.385952 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40d8eb-aad4-4124-ac53-8f8ef9e14066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:30.386803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40d8eb-aad4-4124-ac53-8f8ef9e14066 None admin] RBAC: Adding query filter params (role.id=f25a1522772f4a8683f4c221dff1093a, user.id=74193efeffe84cfdb7f1619821ce0930, scope.system=all) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:30.387128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40d8eb-aad4-4124-ac53-8f8ef9e14066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:30.388631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40d8eb-aad4-4124-ac53-8f8ef9e14066 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:30.400448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 142/304] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Jul 11 15:36:30 2022] GET /identity/v3/role_assignments?user.id=74193efeffe84cfdb7f1619821ce0930&scope.system=all&role.id=f25a1522772f4a8683f4c221dff1093a => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:30.894937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5aeb4-e0e6-42cc-a5a0-f9da9d36712d None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:30.895509 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5aeb4-e0e6-42cc-a5a0-f9da9d36712d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:30.895509 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5aeb4-e0e6-42cc-a5a0-f9da9d36712d None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:30.897208 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 163/305] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:30.902892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be155e1e-8701-4d07-852c-6d65adf3d2e8 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:30.903357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be155e1e-8701-4d07-852c-6d65adf3d2e8 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:30.903543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be155e1e-8701-4d07-852c-6d65adf3d2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:30.915745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:30.924583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-be155e1e-8701-4d07-852c-6d65adf3d2e8 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:30.925792 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-be155e1e-8701-4d07-852c-6d65adf3d2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:30.994369 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 143/306] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:31.016998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5aeb4-e0e6-42cc-a5a0-f9da9d36712d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:31.122279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5aeb4-e0e6-42cc-a5a0-f9da9d36712d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:31.140026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:31.150049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf94c0-3e11-412c-a2ed-47dad4a8396c None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:31.150289 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf94c0-3e11-412c-a2ed-47dad4a8396c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:31.150542 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf94c0-3e11-412c-a2ed-47dad4a8396c None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:31.152203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 144/307] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:31.157186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58628a31-1f03-48e8-81ae-bf04a6b6c711 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:31.157479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58628a31-1f03-48e8-81ae-bf04a6b6c711 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:31.157767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58628a31-1f03-48e8-81ae-bf04a6b6c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:31.161636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb5c5a-a584-40b3-8a4d-5676986ca5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:31.162634 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5c5a-a584-40b3-8a4d-5676986ca5ee None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:31.163250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5c5a-a584-40b3-8a4d-5676986ca5ee None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:31.163693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5c5a-a584-40b3-8a4d-5676986ca5ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:31.174992 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb5c5a-a584-40b3-8a4d-5676986ca5ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:31.175276 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-58628a31-1f03-48e8-81ae-bf04a6b6c711 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:31.176506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-58628a31-1f03-48e8-81ae-bf04a6b6c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-dbbb5c5a-a584-40b3-8a4d-5676986ca5ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:31.184626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:31.185484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:31.186267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:31.186267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:31.186267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:31.186267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:31.186267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:31.186267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:31.186267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:31.186267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:31.186267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:31.186267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:31.186267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:31.186267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:31.189344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 164/308] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:36:31.199981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb5c5a-a584-40b3-8a4d-5676986ca5ee None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:31.265483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 145/309] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:31.287510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58628a31-1f03-48e8-81ae-bf04a6b6c711 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:31.316840 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb5c5a-a584-40b3-8a4d-5676986ca5ee None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:31.361256 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749090c3-b2a0-499e-8213-ae85d975f3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:31.362345 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749090c3-b2a0-499e-8213-ae85d975f3bd None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:31.363356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:31.363626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749090c3-b2a0-499e-8213-ae85d975f3bd None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:31.364104 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749090c3-b2a0-499e-8213-ae85d975f3bd None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:31.366248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749090c3-b2a0-499e-8213-ae85d975f3bd None admin] RBAC: Adding query filter params (name=member) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:31.366832 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749090c3-b2a0-499e-8213-ae85d975f3bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:31.368826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749090c3-b2a0-499e-8213-ae85d975f3bd None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:31.382369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 165/310] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:31.389721 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749090c3-b2a0-499e-8213-ae85d975f3bd None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:31.408706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58628a31-1f03-48e8-81ae-bf04a6b6c711 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:31.444131 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:31.446703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f2739-75ca-4107-a8ea-8232a89b5aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:31.447785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f2739-75ca-4107-a8ea-8232a89b5aed None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:31.448394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f2739-75ca-4107-a8ea-8232a89b5aed None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:31.448814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f2739-75ca-4107-a8ea-8232a89b5aed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:31.462762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f2739-75ca-4107-a8ea-8232a89b5aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-cb4f2739-75ca-4107-a8ea-8232a89b5aed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:31.471600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:31.472653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:31.473458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:31.473458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:31.473458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:31.473458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:31.473458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:31.473458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:31.473458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:31.473458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:31.473458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:31.473458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:31.473458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:31.473458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:31.476260 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 146/311] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:36:31.482243 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f2739-75ca-4107-a8ea-8232a89b5aed None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:31.527166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749090c3-b2a0-499e-8213-ae85d975f3bd None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:31.573872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051f37b-ba44-4c4d-8651-51ae9486dd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:31.575590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051f37b-ba44-4c4d-8651-51ae9486dd55 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:31.576108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051f37b-ba44-4c4d-8651-51ae9486dd55 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:31.576725 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051f37b-ba44-4c4d-8651-51ae9486dd55 None admin] PATH_INFO: `/v3/users/70f171af49b8493797704cacd4a844ff` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:31.578710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051f37b-ba44-4c4d-8651-51ae9486dd55 None admin] RBAC: Authorizing `identity:get_user(user_id=70f171af49b8493797704cacd4a844ff)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:31.581054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051f37b-ba44-4c4d-8651-51ae9486dd55 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:31.584148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 166/312] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:31 2022] GET /identity/v3/users/70f171af49b8493797704cacd4a844ff => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:31.590272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051f37b-ba44-4c4d-8651-51ae9486dd55 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:31.593751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f2739-75ca-4107-a8ea-8232a89b5aed None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:31.621227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:31.632049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b948584-e7e8-4678-a6b5-8f3df3a05d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:31.632786 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b948584-e7e8-4678-a6b5-8f3df3a05d81 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:31.633130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b948584-e7e8-4678-a6b5-8f3df3a05d81 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:31.633411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b948584-e7e8-4678-a6b5-8f3df3a05d81 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:31.634174 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b948584-e7e8-4678-a6b5-8f3df3a05d81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:31.634539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b948584-e7e8-4678-a6b5-8f3df3a05d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:31.636197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b948584-e7e8-4678-a6b5-8f3df3a05d81 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:31.649815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 147/313] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:31.651947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b948584-e7e8-4678-a6b5-8f3df3a05d81 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:31.726572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051f37b-ba44-4c4d-8651-51ae9486dd55 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:31.738691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:31.763464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b948584-e7e8-4678-a6b5-8f3df3a05d81 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:31.769379 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a71d5-3c52-43e6-85aa-1ab58d714335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:31.770410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a71d5-3c52-43e6-85aa-1ab58d714335 None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:31.770792 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a71d5-3c52-43e6-85aa-1ab58d714335 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:31.771166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a71d5-3c52-43e6-85aa-1ab58d714335 None admin] PATH_INFO: `/v3/system/users/70f171af49b8493797704cacd4a844ff/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:31.772826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a71d5-3c52-43e6-85aa-1ab58d714335 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=70f171af49b8493797704cacd4a844ff, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:31.774624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a71d5-3c52-43e6-85aa-1ab58d714335 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:31.786614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 167/314] 10.222.0.26 () {58 vars in 1334 bytes} [Mon Jul 11 15:36:31 2022] PUT /identity/v3/system/users/70f171af49b8493797704cacd4a844ff/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:31.809272 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce240e5d-2e6e-4c28-9015-ffced21fab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:31.810616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce240e5d-2e6e-4c28-9015-ffced21fab9b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:31.811178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce240e5d-2e6e-4c28-9015-ffced21fab9b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:31.811645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce240e5d-2e6e-4c28-9015-ffced21fab9b None admin] PATH_INFO: `/v3/users/889aabf847434f87be99061a513f1b5c` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:31.813512 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce240e5d-2e6e-4c28-9015-ffced21fab9b None admin] RBAC: Authorizing `identity:get_user(user_id=889aabf847434f87be99061a513f1b5c)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:31.815374 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce240e5d-2e6e-4c28-9015-ffced21fab9b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:31.817788 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 148/315] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:31 2022] GET /identity/v3/users/889aabf847434f87be99061a513f1b5c => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:31.823966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a71d5-3c52-43e6-85aa-1ab58d714335 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:31.939404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a71d5-3c52-43e6-85aa-1ab58d714335 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:31.980921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c6b43-7d57-4e17-9753-de0119701672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:31.981910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c6b43-7d57-4e17-9753-de0119701672 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:31.982206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c6b43-7d57-4e17-9753-de0119701672 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:31.982474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c6b43-7d57-4e17-9753-de0119701672 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.027947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:32.057656 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c6b43-7d57-4e17-9753-de0119701672 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:32.059136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c6b43-7d57-4e17-9753-de0119701672 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:32.160834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 168/316] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:32.166467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce240e5d-2e6e-4c28-9015-ffced21fab9b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:32.232438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:32.280111 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce240e5d-2e6e-4c28-9015-ffced21fab9b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:32.315936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c378b2-15b2-4137-ad95-eea9961ae0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:32.317181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c378b2-15b2-4137-ad95-eea9961ae0e6 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.320338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c378b2-15b2-4137-ad95-eea9961ae0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.320338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c378b2-15b2-4137-ad95-eea9961ae0e6 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.320338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c378b2-15b2-4137-ad95-eea9961ae0e6 None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:32.320562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8027431-a39e-4e6b-9555-491540b7ef1c None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.320562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8027431-a39e-4e6b-9555-491540b7ef1c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.320562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8027431-a39e-4e6b-9555-491540b7ef1c None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.320768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c378b2-15b2-4137-ad95-eea9961ae0e6 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:32.321955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 169/317] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:32.325760 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 149/318] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:32 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:32.327309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881d3e1-f019-4567-aea6-7881e8f5de91 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.327623 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881d3e1-f019-4567-aea6-7881e8f5de91 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.328090 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881d3e1-f019-4567-aea6-7881e8f5de91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.331886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c378b2-15b2-4137-ad95-eea9961ae0e6 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:32.349442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3881d3e1-f019-4567-aea6-7881e8f5de91 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:32.351300 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3881d3e1-f019-4567-aea6-7881e8f5de91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:32.429568 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 170/319] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:32.431086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cbac0-b2cf-41a3-97bf-57e6b47e1480 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.431386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cbac0-b2cf-41a3-97bf-57e6b47e1480 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.431662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cbac0-b2cf-41a3-97bf-57e6b47e1480 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.433136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 171/320] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:32.436169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c378b2-15b2-4137-ad95-eea9961ae0e6 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:32.438745 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934767a6-1f7c-4bc3-b4f8-f1cc2cbd9e50 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.438995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934767a6-1f7c-4bc3-b4f8-f1cc2cbd9e50 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.439270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934767a6-1f7c-4bc3-b4f8-f1cc2cbd9e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.444156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:32.460785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:32.461609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-934767a6-1f7c-4bc3-b4f8-f1cc2cbd9e50 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:32.463120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-934767a6-1f7c-4bc3-b4f8-f1cc2cbd9e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:32.473927 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa6e11-7097-46ac-975a-e1643b6e2e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:32.474816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6e11-7097-46ac-975a-e1643b6e2e89 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.475100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6e11-7097-46ac-975a-e1643b6e2e89 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.475375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6e11-7097-46ac-975a-e1643b6e2e89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.476218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa6e11-7097-46ac-975a-e1643b6e2e89 None admin] RBAC: Adding query filter params (role.id=f25a1522772f4a8683f4c221dff1093a, scope.project.id=21d24ab37b7c4dbaa4794944fac657c0, user.id=889aabf847434f87be99061a513f1b5c) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:32.476561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa6e11-7097-46ac-975a-e1643b6e2e89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:32.478008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa6e11-7097-46ac-975a-e1643b6e2e89 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:32.484106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 150/321] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:32 2022] GET /identity/v3/role_assignments?user.id=889aabf847434f87be99061a513f1b5c&scope.project.id=21d24ab37b7c4dbaa4794944fac657c0&role.id=f25a1522772f4a8683f4c221dff1093a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:32.493383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa6e11-7097-46ac-975a-e1643b6e2e89 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:32.544318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 172/322] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:32.561932 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934767a6-1f7c-4bc3-b4f8-f1cc2cbd9e50 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:32.653300 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa6e11-7097-46ac-975a-e1643b6e2e89 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:32.699641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7784b-2974-4246-8957-6ca4cd0916f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:32.700850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7784b-2974-4246-8957-6ca4cd0916f8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.701418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7784b-2974-4246-8957-6ca4cd0916f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.701695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7784b-2974-4246-8957-6ca4cd0916f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.703151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7784b-2974-4246-8957-6ca4cd0916f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:32.705533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7784b-2974-4246-8957-6ca4cd0916f8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:32.709768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934767a6-1f7c-4bc3-b4f8-f1cc2cbd9e50 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:32.710073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 151/323] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:32.713702 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7784b-2974-4246-8957-6ca4cd0916f8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:32.749476 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:32.755557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a30d86-1056-4164-b018-37041285e188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:32.756405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a30d86-1056-4164-b018-37041285e188 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.756700 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a30d86-1056-4164-b018-37041285e188 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.756962 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a30d86-1056-4164-b018-37041285e188 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.770411 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a30d86-1056-4164-b018-37041285e188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-60a30d86-1056-4164-b018-37041285e188 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:32.778212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:32.779261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:32.780501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:32.780501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:32.780501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:32.780501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:32.780501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:32.780501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:32.780501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:32.780501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:32.780501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:32.780501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:32.780501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:32.780501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:32.780501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 173/324] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:36:32.786559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a30d86-1056-4164-b018-37041285e188 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:32.801136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:32.856035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7784b-2974-4246-8957-6ca4cd0916f8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:32.892103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edae49-be6d-4ec5-bc8d-613db0364ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:32.892520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a30d86-1056-4164-b018-37041285e188 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:32.892820 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edae49-be6d-4ec5-bc8d-613db0364ba8 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.893104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edae49-be6d-4ec5-bc8d-613db0364ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.893379 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edae49-be6d-4ec5-bc8d-613db0364ba8 None admin] PATH_INFO: `/v3/groups` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.894071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edae49-be6d-4ec5-bc8d-613db0364ba8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:32.895529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edae49-be6d-4ec5-bc8d-613db0364ba8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:32.912735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 152/325] 10.222.0.26 () {60 vars in 1134 bytes} [Mon Jul 11 15:36:32 2022] POST /identity/v3/groups => generated 226 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:32.933695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c81f5-3518-4397-8699-b2ae91a207a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:32.934774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c81f5-3518-4397-8699-b2ae91a207a2 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:32.935314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c81f5-3518-4397-8699-b2ae91a207a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:32.935798 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c81f5-3518-4397-8699-b2ae91a207a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:32.936865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c81f5-3518-4397-8699-b2ae91a207a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:32.937560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c81f5-3518-4397-8699-b2ae91a207a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:32.939325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c81f5-3518-4397-8699-b2ae91a207a2 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:32.949576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 174/326] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:32.955461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edae49-be6d-4ec5-bc8d-613db0364ba8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:33.066226 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edae49-be6d-4ec5-bc8d-613db0364ba8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:33.084276 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:33.106121 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4505f8b-38e6-44ca-8eb6-574d6b54e52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:33.107422 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4505f8b-38e6-44ca-8eb6-574d6b54e52a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:33.107938 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4505f8b-38e6-44ca-8eb6-574d6b54e52a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:33.108221 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4505f8b-38e6-44ca-8eb6-574d6b54e52a None admin] PATH_INFO: `/v3/users/74193efeffe84cfdb7f1619821ce0930` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:33.110339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4505f8b-38e6-44ca-8eb6-574d6b54e52a None admin] RBAC: Authorizing `identity:get_user(user_id=74193efeffe84cfdb7f1619821ce0930)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:33.111809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4505f8b-38e6-44ca-8eb6-574d6b54e52a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:33.113860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 153/327] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:32 2022] GET /identity/v3/users/74193efeffe84cfdb7f1619821ce0930 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:33.119545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c81f5-3518-4397-8699-b2ae91a207a2 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:33.181589 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:33.231302 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c81f5-3518-4397-8699-b2ae91a207a2 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:33.265611 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a31cb-0d49-466b-a5d4-cc8550a2a1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:33.266491 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a31cb-0d49-466b-a5d4-cc8550a2a1e4 None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:33.266782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a31cb-0d49-466b-a5d4-cc8550a2a1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:33.267064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a31cb-0d49-466b-a5d4-cc8550a2a1e4 None admin] PATH_INFO: `/v3/system/users/74193efeffe84cfdb7f1619821ce0930/roles/f25a1522772f4a8683f4c221dff1093a` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:33.268620 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a31cb-0d49-466b-a5d4-cc8550a2a1e4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=74193efeffe84cfdb7f1619821ce0930, role_id=f25a1522772f4a8683f4c221dff1093a)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:33.270107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a31cb-0d49-466b-a5d4-cc8550a2a1e4 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:33.278745 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 175/328] 10.222.0.26 () {58 vars in 1334 bytes} [Mon Jul 11 15:36:33 2022] PUT /identity/v3/system/users/74193efeffe84cfdb7f1619821ce0930/roles/f25a1522772f4a8683f4c221dff1093a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:36:34.038758 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837de8fd-f388-4656-82e5-8abe61e8e8a5 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:34.039276 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837de8fd-f388-4656-82e5-8abe61e8e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:34.039351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837de8fd-f388-4656-82e5-8abe61e8e8a5 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:34.041025 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 154/329] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:34.046557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9d01c-c552-46b9-8dc4-9ccb2713ec73 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:34.047347 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9d01c-c552-46b9-8dc4-9ccb2713ec73 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:34.047633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9d01c-c552-46b9-8dc4-9ccb2713ec73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:34.065045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-b3d9d01c-c552-46b9-8dc4-9ccb2713ec73 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:34.066234 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b3d9d01c-c552-46b9-8dc4-9ccb2713ec73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:34.151844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 176/330] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:34.192622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837de8fd-f388-4656-82e5-8abe61e8e8a5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:34.331248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837de8fd-f388-4656-82e5-8abe61e8e8a5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:34.370370 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a53e39-571d-4612-b5bd-777df06d142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:34.371236 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a53e39-571d-4612-b5bd-777df06d142f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:34.371520 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a53e39-571d-4612-b5bd-777df06d142f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:34.371795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a53e39-571d-4612-b5bd-777df06d142f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:34.385518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a53e39-571d-4612-b5bd-777df06d142f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-62a53e39-571d-4612-b5bd-777df06d142f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:34.393991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:34.394892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:34.395698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:34.395698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:34.395698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:34.395698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:34.395698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:34.395698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:34.395698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:34.395698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:34.395698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:34.395698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:34.395698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:34.395698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:34.395698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 155/331] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:34.403570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9d01c-c552-46b9-8dc4-9ccb2713ec73 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:34.460750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:34.520607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9d01c-c552-46b9-8dc4-9ccb2713ec73 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:34.561675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a333f8a-f0d1-4b20-b460-6613ba464066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:34.563099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333f8a-f0d1-4b20-b460-6613ba464066 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:34.563387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333f8a-f0d1-4b20-b460-6613ba464066 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:34.563669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333f8a-f0d1-4b20-b460-6613ba464066 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:34.564473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a333f8a-f0d1-4b20-b460-6613ba464066 None admin] RBAC: Adding query filter params (name=member) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:34.564782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a333f8a-f0d1-4b20-b460-6613ba464066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:34.566197 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a333f8a-f0d1-4b20-b460-6613ba464066 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:34.575026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 177/332] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:34.581530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a53e39-571d-4612-b5bd-777df06d142f None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:34.630876 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:34.692314 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a53e39-571d-4612-b5bd-777df06d142f None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:34.731446 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870535cf-8325-4606-b757-5bd71432eb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:34.732430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870535cf-8325-4606-b757-5bd71432eb7f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:34.732718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870535cf-8325-4606-b757-5bd71432eb7f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:34.732991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870535cf-8325-4606-b757-5bd71432eb7f None admin] PATH_INFO: `/v3/users/70f171af49b8493797704cacd4a844ff` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:34.734900 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870535cf-8325-4606-b757-5bd71432eb7f None admin] RBAC: Authorizing `identity:get_user(user_id=70f171af49b8493797704cacd4a844ff)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:34.736405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870535cf-8325-4606-b757-5bd71432eb7f None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:34.740238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 156/333] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:34 2022] GET /identity/v3/users/70f171af49b8493797704cacd4a844ff => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:34.745357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a333f8a-f0d1-4b20-b460-6613ba464066 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:34.864484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a333f8a-f0d1-4b20-b460-6613ba464066 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:34.877814 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:34.901791 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfb15e-37e9-4752-aa5c-ea71a49a1e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:34.902500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfb15e-37e9-4752-aa5c-ea71a49a1e38 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:34.902784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfb15e-37e9-4752-aa5c-ea71a49a1e38 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:34.903053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfb15e-37e9-4752-aa5c-ea71a49a1e38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:34.903895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfb15e-37e9-4752-aa5c-ea71a49a1e38 None admin] RBAC: Adding query filter params (role.id=7df8c80cd6f643d6aa8ecd8281781a3f, user.id=70f171af49b8493797704cacd4a844ff, scope.system=all) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:34.904203 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfb15e-37e9-4752-aa5c-ea71a49a1e38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:34.905714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfb15e-37e9-4752-aa5c-ea71a49a1e38 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:34.924856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 178/334] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Jul 11 15:36:34 2022] GET /identity/v3/role_assignments?user.id=70f171af49b8493797704cacd4a844ff&scope.system=all&role.id=7df8c80cd6f643d6aa8ecd8281781a3f => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:35.946490 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06afa92-c99b-48db-b3fe-6546cc61b866 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:35.947018 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06afa92-c99b-48db-b3fe-6546cc61b866 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:35.947018 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06afa92-c99b-48db-b3fe-6546cc61b866 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:35.948476 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 157/335] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:35.954322 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3738ff-2cab-44a2-8706-8dfae7dae82f None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:35.954859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3738ff-2cab-44a2-8706-8dfae7dae82f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:35.954859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3738ff-2cab-44a2-8706-8dfae7dae82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:35.976669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-ee3738ff-2cab-44a2-8706-8dfae7dae82f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:35.977870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ee3738ff-2cab-44a2-8706-8dfae7dae82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:36.066166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 179/336] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:36.101376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06afa92-c99b-48db-b3fe-6546cc61b866 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:36.254124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06afa92-c99b-48db-b3fe-6546cc61b866 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:36.268217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:36.303909 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf2928-9d99-4eb0-b4ae-c55d1a1ca0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:36.304824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf2928-9d99-4eb0-b4ae-c55d1a1ca0c0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:36.305112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf2928-9d99-4eb0-b4ae-c55d1a1ca0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:36.305390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf2928-9d99-4eb0-b4ae-c55d1a1ca0c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:36.325900 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf2928-9d99-4eb0-b4ae-c55d1a1ca0c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:36.326307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2236-be59-4970-8fef-fc33061944e5 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:36.326602 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2236-be59-4970-8fef-fc33061944e5 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:36.326876 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2236-be59-4970-8fef-fc33061944e5 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:36.328593 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 180/337] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-e5cf2928-9d99-4eb0-b4ae-c55d1a1ca0c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:36.334065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:36.334942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:36.335748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:36.335748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:36.335748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:36.335748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:36.335748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:36.335748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:36.335748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:36.335748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:36.335748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:36.335748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:36.335748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:36.335748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:36.335748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 158/338] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:36.338200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b00638-9f41-4b4a-b8cc-e72753790eb3 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:36.338631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b00638-9f41-4b4a-b8cc-e72753790eb3 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:36.339043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b00638-9f41-4b4a-b8cc-e72753790eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:36.344311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf2928-9d99-4eb0-b4ae-c55d1a1ca0c0 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:36.372414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-96b00638-9f41-4b4a-b8cc-e72753790eb3 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:36.373978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-96b00638-9f41-4b4a-b8cc-e72753790eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:36.474661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 181/339] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:36.496641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf2928-9d99-4eb0-b4ae-c55d1a1ca0c0 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:36.497090 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7550e-bcad-4800-b021-09ee60af5dae None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:36.497376 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7550e-bcad-4800-b021-09ee60af5dae None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:36.497643 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7550e-bcad-4800-b021-09ee60af5dae None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:36.499398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 182/340] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:36:36.505860 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd452d2-71c3-4dc0-b167-e31408468339 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:36.506071 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd452d2-71c3-4dc0-b167-e31408468339 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:36.506504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd452d2-71c3-4dc0-b167-e31408468339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:36.524924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-ebd452d2-71c3-4dc0-b167-e31408468339 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:36.526735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ebd452d2-71c3-4dc0-b167-e31408468339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:36.559273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:36.562141 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e6e67-75cf-4812-bb93-041d41fb7e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:36.562817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e6e67-75cf-4812-bb93-041d41fb7e7a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:36.563098 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e6e67-75cf-4812-bb93-041d41fb7e7a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:36.563373 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e6e67-75cf-4812-bb93-041d41fb7e7a None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:36.564138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e6e67-75cf-4812-bb93-041d41fb7e7a None admin] RBAC: Adding query filter params (name=member) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:36.564467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e6e67-75cf-4812-bb93-041d41fb7e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:36.565859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e6e67-75cf-4812-bb93-041d41fb7e7a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:36.584385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 159/341] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:36.585237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e6e67-75cf-4812-bb93-041d41fb7e7a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:36.641181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:36.641745 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 183/342] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:36.642763 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd452d2-71c3-4dc0-b167-e31408468339 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:36.738824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e6e67-75cf-4812-bb93-041d41fb7e7a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:36.782430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd452d2-71c3-4dc0-b167-e31408468339 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:36.788430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416da7fe-4939-476c-8c2d-6e4a2a12ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:36.789530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416da7fe-4939-476c-8c2d-6e4a2a12ea6c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:36.790054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416da7fe-4939-476c-8c2d-6e4a2a12ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:36.791085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416da7fe-4939-476c-8c2d-6e4a2a12ea6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:36.811082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416da7fe-4939-476c-8c2d-6e4a2a12ea6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-416da7fe-4939-476c-8c2d-6e4a2a12ea6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:36.819592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:36.820561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:36.821331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:36.821331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:36.821331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:36.821331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:36.821331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:36.821331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:36.821331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:36.821331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:36.821331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:36.821331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:36.821331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:36.821331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:36.821331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 160/343] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:36:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:36.822053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5132e4f-e5b7-439d-b733-531681c1506c None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:36.822477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5132e4f-e5b7-439d-b733-531681c1506c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:36.822961 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5132e4f-e5b7-439d-b733-531681c1506c None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:36.824446 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 161/344] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:36.825332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5132e4f-e5b7-439d-b733-531681c1506c None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:36.845312 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5b61e-0e88-4f4d-9d33-88355cfd0892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:36.846233 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5b61e-0e88-4f4d-9d33-88355cfd0892 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:36.846513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5b61e-0e88-4f4d-9d33-88355cfd0892 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:36.846784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5b61e-0e88-4f4d-9d33-88355cfd0892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:36.887201 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:36.946511 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5b61e-0e88-4f4d-9d33-88355cfd0892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:36.948030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5b61e-0e88-4f4d-9d33-88355cfd0892 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:36.955524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:36.965681 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5132e4f-e5b7-439d-b733-531681c1506c None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:37.016224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76eba0-e8b9-4016-b3ce-1cec0d6a90e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:37.017334 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76eba0-e8b9-4016-b3ce-1cec0d6a90e0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:37.017756 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76eba0-e8b9-4016-b3ce-1cec0d6a90e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:37.020879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76eba0-e8b9-4016-b3ce-1cec0d6a90e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:37.031672 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76eba0-e8b9-4016-b3ce-1cec0d6a90e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-fd76eba0-e8b9-4016-b3ce-1cec0d6a90e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:37.047619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:37.048632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:37.049466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:37.049466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:37.049466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:37.049466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:37.049466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:37.049466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:37.049466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:37.049466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:37.049466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:37.049466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:37.049466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 15:36:37.049466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:37.049466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 162/345] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:37.050612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdbd4f-8d59-4150-97a7-1ad9cdda9dd0 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:37.051105 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdbd4f-8d59-4150-97a7-1ad9cdda9dd0 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:37.051542 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdbd4f-8d59-4150-97a7-1ad9cdda9dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:37.071032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-2ffdbd4f-8d59-4150-97a7-1ad9cdda9dd0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:37.072678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2ffdbd4f-8d59-4150-97a7-1ad9cdda9dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:37.086423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 184/346] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:37.086423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5b61e-0e88-4f4d-9d33-88355cfd0892 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:37.155333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:37.158860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 163/347] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:37.159842 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdbd4f-8d59-4150-97a7-1ad9cdda9dd0 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:37.235954 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5b61e-0e88-4f4d-9d33-88355cfd0892 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:37.267681 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:37.285662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed904d-5c53-4ad4-b830-6ba968fc8c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:37.286350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed904d-5c53-4ad4-b830-6ba968fc8c92 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:37.286601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdbd4f-8d59-4150-97a7-1ad9cdda9dd0 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:37.286719 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed904d-5c53-4ad4-b830-6ba968fc8c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:37.286901 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed904d-5c53-4ad4-b830-6ba968fc8c92 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:37.287665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed904d-5c53-4ad4-b830-6ba968fc8c92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:37.288077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed904d-5c53-4ad4-b830-6ba968fc8c92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:37.289492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed904d-5c53-4ad4-b830-6ba968fc8c92 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:37.301588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 185/348] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:37.302448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed904d-5c53-4ad4-b830-6ba968fc8c92 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:37.341978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9fe62-17b6-44b5-b344-a95259c1bf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:37.342765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9fe62-17b6-44b5-b344-a95259c1bf5e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:37.343047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9fe62-17b6-44b5-b344-a95259c1bf5e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:37.343426 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9fe62-17b6-44b5-b344-a95259c1bf5e None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:37.344202 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9fe62-17b6-44b5-b344-a95259c1bf5e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:37.344548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9fe62-17b6-44b5-b344-a95259c1bf5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:37.345944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9fe62-17b6-44b5-b344-a95259c1bf5e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:37.356106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 164/349] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:37.357781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcdf00-0b6c-4fc7-9785-18ce6ed0e3be None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:37.358069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcdf00-0b6c-4fc7-9785-18ce6ed0e3be None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:37.358340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcdf00-0b6c-4fc7-9785-18ce6ed0e3be None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:37.360180 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 165/350] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:37.360879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcdf00-0b6c-4fc7-9785-18ce6ed0e3be None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:37.436445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed904d-5c53-4ad4-b830-6ba968fc8c92 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:37.462696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:37.485656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcdf00-0b6c-4fc7-9785-18ce6ed0e3be None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:37.486755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe761d-0b97-4f71-9aa0-36d1f748c5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:37.487819 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe761d-0b97-4f71-9aa0-36d1f748c5de None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:37.488977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe761d-0b97-4f71-9aa0-36d1f748c5de None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:37.489257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe761d-0b97-4f71-9aa0-36d1f748c5de None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:37.490500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe761d-0b97-4f71-9aa0-36d1f748c5de None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:37.491942 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe761d-0b97-4f71-9aa0-36d1f748c5de None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:37.494464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 186/351] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:37 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:37.495813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe761d-0b97-4f71-9aa0-36d1f748c5de None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:37.528733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dea25d-2cdf-4336-8f94-58af1bb1439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:37.529810 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dea25d-2cdf-4336-8f94-58af1bb1439c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:37.530226 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dea25d-2cdf-4336-8f94-58af1bb1439c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:37.530709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dea25d-2cdf-4336-8f94-58af1bb1439c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:37.545895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dea25d-2cdf-4336-8f94-58af1bb1439c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-d1dea25d-2cdf-4336-8f94-58af1bb1439c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:37.554622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:37.555499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:37.556336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:37.556336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:37.556336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:37.556336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:37.556336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:37.556336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:37.556336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:37.556336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:37.556336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:37.556336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:37.556336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:37.556336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:37.556336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 166/352] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:37.557461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206cdef-a80e-4a65-bb9c-fbe960869b7d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:37.557461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206cdef-a80e-4a65-bb9c-fbe960869b7d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:37.557612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206cdef-a80e-4a65-bb9c-fbe960869b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:37.570643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:37.577131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-6206cdef-a80e-4a65-bb9c-fbe960869b7d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:37.578467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6206cdef-a80e-4a65-bb9c-fbe960869b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:37.643304 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe761d-0b97-4f71-9aa0-36d1f748c5de None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:37.656283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 167/353] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:37.657653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206cdef-a80e-4a65-bb9c-fbe960869b7d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:37.689893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56bf41-3ae4-46b3-9f08-cc2e52cfeabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:37.690608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56bf41-3ae4-46b3-9f08-cc2e52cfeabb None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:37.690896 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56bf41-3ae4-46b3-9f08-cc2e52cfeabb None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:37.691194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56bf41-3ae4-46b3-9f08-cc2e52cfeabb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:37.762338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:37.782769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56bf41-3ae4-46b3-9f08-cc2e52cfeabb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:37.784346 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56bf41-3ae4-46b3-9f08-cc2e52cfeabb None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:37.789145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206cdef-a80e-4a65-bb9c-fbe960869b7d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:37.833955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a797307-b1df-4362-a436-c70551ddedd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:37.834514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a797307-b1df-4362-a436-c70551ddedd9 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:37.834784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a797307-b1df-4362-a436-c70551ddedd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:37.835047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a797307-b1df-4362-a436-c70551ddedd9 None admin] PATH_INFO: `/v3/users/74193efeffe84cfdb7f1619821ce0930` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:37.836352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a797307-b1df-4362-a436-c70551ddedd9 None admin] RBAC: Authorizing `identity:get_user(user_id=74193efeffe84cfdb7f1619821ce0930)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:37.838375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a797307-b1df-4362-a436-c70551ddedd9 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:37.840495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 168/354] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:36:37 2022] GET /identity/v3/users/74193efeffe84cfdb7f1619821ce0930 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:37.841354 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a797307-b1df-4362-a436-c70551ddedd9 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:37.848668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:37.911151 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 187/355] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:37.912026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56bf41-3ae4-46b3-9f08-cc2e52cfeabb None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:37.959563 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a797307-b1df-4362-a436-c70551ddedd9 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:37.999013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5493-0696-4080-8277-da011e147c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:38.000710 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5493-0696-4080-8277-da011e147c42 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:38.001020 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5493-0696-4080-8277-da011e147c42 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:38.001297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5493-0696-4080-8277-da011e147c42 None admin] PATH_INFO: `/v3/groups/3ed32bd4cc714eca80f93e2298ef576f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:38.007487 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c5493-0696-4080-8277-da011e147c42 None admin] RBAC: Authorizing `identity:get_group(group_id=3ed32bd4cc714eca80f93e2298ef576f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:38.008992 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c5493-0696-4080-8277-da011e147c42 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:38.010692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 169/356] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:37 2022] GET /identity/v3/groups/3ed32bd4cc714eca80f93e2298ef576f => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:38.011459 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5493-0696-4080-8277-da011e147c42 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:38.012895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:38.025663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56bf41-3ae4-46b3-9f08-cc2e52cfeabb None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:38.066500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eae2a0-d076-48e5-a897-562afaac02e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:38.067187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eae2a0-d076-48e5-a897-562afaac02e9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:38.067473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eae2a0-d076-48e5-a897-562afaac02e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:38.067748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eae2a0-d076-48e5-a897-562afaac02e9 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:38.068543 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eae2a0-d076-48e5-a897-562afaac02e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:38.068851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eae2a0-d076-48e5-a897-562afaac02e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:38.070248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eae2a0-d076-48e5-a897-562afaac02e9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:38.081141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 188/357] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:38.082288 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eae2a0-d076-48e5-a897-562afaac02e9 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:38.085636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:38.131560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5493-0696-4080-8277-da011e147c42 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:38.176124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3645b03-a7b9-4e49-9349-392342c8ffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:38.176998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3645b03-a7b9-4e49-9349-392342c8ffdb None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:38.177279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3645b03-a7b9-4e49-9349-392342c8ffdb None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:38.177546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3645b03-a7b9-4e49-9349-392342c8ffdb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:38.190559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3645b03-a7b9-4e49-9349-392342c8ffdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-c3645b03-a7b9-4e49-9349-392342c8ffdb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:38.198698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:38.199605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:38.200743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:38.200743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:38.200743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:38.200743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:38.200743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:38.200743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:38.200743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:38.200743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:38.200743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:38.200743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:38.200743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:38.200743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:38.200743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 170/358] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:36:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:38.202201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67b6a3-84bd-4947-bc31-0e105ad18d17 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:38.202526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67b6a3-84bd-4947-bc31-0e105ad18d17 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:38.202983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67b6a3-84bd-4947-bc31-0e105ad18d17 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:38.204941 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 171/359] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:38.205905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67b6a3-84bd-4947-bc31-0e105ad18d17 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:38.217075 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eae2a0-d076-48e5-a897-562afaac02e9 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:38.257817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a2b92-deae-4e03-8e02-0bd1748163c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:38.258486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a2b92-deae-4e03-8e02-0bd1748163c6 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:38.258769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a2b92-deae-4e03-8e02-0bd1748163c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:38.259044 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a2b92-deae-4e03-8e02-0bd1748163c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:38.259898 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a2b92-deae-4e03-8e02-0bd1748163c6 None admin] RBAC: Adding query filter params (role.id=f25a1522772f4a8683f4c221dff1093a, user.id=74193efeffe84cfdb7f1619821ce0930, scope.system=all) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:38.260208 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a2b92-deae-4e03-8e02-0bd1748163c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:38.261751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a2b92-deae-4e03-8e02-0bd1748163c6 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:38.278033 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 189/360] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Jul 11 15:36:38 2022] GET /identity/v3/role_assignments?user.id=74193efeffe84cfdb7f1619821ce0930&scope.system=all&role.id=f25a1522772f4a8683f4c221dff1093a => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:38.281053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a2b92-deae-4e03-8e02-0bd1748163c6 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:38.294721 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:38.337963 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67b6a3-84bd-4947-bc31-0e105ad18d17 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:38.374564 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:38.386551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f06922-5041-41a2-b152-fc63bc126dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:38.387443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f06922-5041-41a2-b152-fc63bc126dc3 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:38.387721 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f06922-5041-41a2-b152-fc63bc126dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:38.387991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f06922-5041-41a2-b152-fc63bc126dc3 None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:38.389274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f06922-5041-41a2-b152-fc63bc126dc3 None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:38.390891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f06922-5041-41a2-b152-fc63bc126dc3 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:38.393420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 172/361] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:38 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:38.394566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f06922-5041-41a2-b152-fc63bc126dc3 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:38.430859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a2b92-deae-4e03-8e02-0bd1748163c6 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:38.478882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1a2d4-f4c7-49f4-9f59-64b9a635d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:38.479561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1a2d4-f4c7-49f4-9f59-64b9a635d6c9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:38.479844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1a2d4-f4c7-49f4-9f59-64b9a635d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:38.480116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1a2d4-f4c7-49f4-9f59-64b9a635d6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:38.481864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1a2d4-f4c7-49f4-9f59-64b9a635d6c9 None admin] RBAC: Adding query filter params (group.id=3ed32bd4cc714eca80f93e2298ef576f, role.id=7df8c80cd6f643d6aa8ecd8281781a3f, scope.project.id=8cacd9253675421d9d915794d90317e4) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:38.482180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1a2d4-f4c7-49f4-9f59-64b9a635d6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:38.483640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1a2d4-f4c7-49f4-9f59-64b9a635d6c9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:38.490484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 190/362] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Jul 11 15:36:38 2022] GET /identity/v3/role_assignments?group.id=3ed32bd4cc714eca80f93e2298ef576f&scope.project.id=8cacd9253675421d9d915794d90317e4&role.id=7df8c80cd6f643d6aa8ecd8281781a3f => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:38.491299 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1a2d4-f4c7-49f4-9f59-64b9a635d6c9 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:38.534012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f06922-5041-41a2-b152-fc63bc126dc3 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:38.589286 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5ab55-6e9a-4956-9f32-e48faf78460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:38.590076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5ab55-6e9a-4956-9f32-e48faf78460e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:38.590357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5ab55-6e9a-4956-9f32-e48faf78460e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:38.590630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5ab55-6e9a-4956-9f32-e48faf78460e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:38.594542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:38.629642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1a2d4-f4c7-49f4-9f59-64b9a635d6c9 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:38.677685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3271b-2292-457a-9f95-bd8657e707b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:38.678384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3271b-2292-457a-9f95-bd8657e707b7 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:38.678673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3271b-2292-457a-9f95-bd8657e707b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:38.678947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3271b-2292-457a-9f95-bd8657e707b7 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:38.679738 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3271b-2292-457a-9f95-bd8657e707b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:38.680584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3271b-2292-457a-9f95-bd8657e707b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:38.682323 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3271b-2292-457a-9f95-bd8657e707b7 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:38.692049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:38.693681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 191/363] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:38.694968 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210d36-4dcb-4b62-ad95-3a9b9102e4db None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:38.695292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210d36-4dcb-4b62-ad95-3a9b9102e4db None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:38.695529 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210d36-4dcb-4b62-ad95-3a9b9102e4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:38.700343 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5ab55-6e9a-4956-9f32-e48faf78460e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:38.700883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5ab55-6e9a-4956-9f32-e48faf78460e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:38.719403 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-7a210d36-4dcb-4b62-ad95-3a9b9102e4db None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:38.720963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7a210d36-4dcb-4b62-ad95-3a9b9102e4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:38.823744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 192/364] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:38.824773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a210d36-4dcb-4b62-ad95-3a9b9102e4db None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:38.839527 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 173/365] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:38.840636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5ab55-6e9a-4956-9f32-e48faf78460e None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:38.900487 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:38.959305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:38.959525 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a210d36-4dcb-4b62-ad95-3a9b9102e4db None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:38.967659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5ab55-6e9a-4956-9f32-e48faf78460e None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:39.006591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa126ff-411e-4ce6-904e-74cfc5ced65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:39.007257 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa126ff-411e-4ce6-904e-74cfc5ced65e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:39.007585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa126ff-411e-4ce6-904e-74cfc5ced65e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:39.007891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa126ff-411e-4ce6-904e-74cfc5ced65e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:39.011614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e19d3a-7627-4a2b-9d21-59584fb988bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:39.013631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e19d3a-7627-4a2b-9d21-59584fb988bb None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:39.014112 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e19d3a-7627-4a2b-9d21-59584fb988bb None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:39.014564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e19d3a-7627-4a2b-9d21-59584fb988bb None admin] PATH_INFO: `/v3/groups/3ed32bd4cc714eca80f93e2298ef576f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:39.015994 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e19d3a-7627-4a2b-9d21-59584fb988bb None admin] RBAC: Authorizing `identity:get_group(group_id=3ed32bd4cc714eca80f93e2298ef576f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:39.018134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e19d3a-7627-4a2b-9d21-59584fb988bb None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:39.025718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 193/366] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:38 2022] GET /identity/v3/groups/3ed32bd4cc714eca80f93e2298ef576f => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:39.025718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e19d3a-7627-4a2b-9d21-59584fb988bb None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:39.094028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa126ff-411e-4ce6-904e-74cfc5ced65e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:39.095423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa126ff-411e-4ce6-904e-74cfc5ced65e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:39.164055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e19d3a-7627-4a2b-9d21-59584fb988bb None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:39.206066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:39.213812 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bf0f0-29e4-4087-add9-a926685d787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:39.213812 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bf0f0-29e4-4087-add9-a926685d787b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:39.213812 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bf0f0-29e4-4087-add9-a926685d787b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:39.214156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bf0f0-29e4-4087-add9-a926685d787b None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:39.217639 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bf0f0-29e4-4087-add9-a926685d787b None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:39.217639 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bf0f0-29e4-4087-add9-a926685d787b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:39.219516 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 194/367] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:39 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:39.220281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bf0f0-29e4-4087-add9-a926685d787b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:39.225136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:39.234397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 174/368] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:39.235755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa126ff-411e-4ce6-904e-74cfc5ced65e None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:39.328886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bf0f0-29e4-4087-add9-a926685d787b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:39.356213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa126ff-411e-4ce6-904e-74cfc5ced65e None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:39.368141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a9754-b044-4b05-a046-e80a5a46cbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:39.368973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a9754-b044-4b05-a046-e80a5a46cbf7 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:39.369257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a9754-b044-4b05-a046-e80a5a46cbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:39.369533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a9754-b044-4b05-a046-e80a5a46cbf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:39.380841 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a9754-b044-4b05-a046-e80a5a46cbf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-cb8a9754-b044-4b05-a046-e80a5a46cbf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:39.390318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:39.391353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:39.392202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:39.392202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:39.392202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:39.392202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:39.392202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:39.392202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:39.392202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:39.392202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:39.392202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:39.392202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:39.392202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:39.392202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:39.392912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65110a65-9e98-41eb-a42d-cbc138b921a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:39.392912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110a65-9e98-41eb-a42d-cbc138b921a7 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:39.392912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110a65-9e98-41eb-a42d-cbc138b921a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:39.392912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110a65-9e98-41eb-a42d-cbc138b921a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:39.393180 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65110a65-9e98-41eb-a42d-cbc138b921a7 None admin] RBAC: Adding query filter params (group.id=3ed32bd4cc714eca80f93e2298ef576f, role.id=49eaa4df59ae423fa6913302fe982e4e, scope.project.id=8cacd9253675421d9d915794d90317e4) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:39.393797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65110a65-9e98-41eb-a42d-cbc138b921a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:39.394755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65110a65-9e98-41eb-a42d-cbc138b921a7 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:39.396440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 195/369] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:36:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:39.397455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a9754-b044-4b05-a046-e80a5a46cbf7 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:39.400630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 175/370] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Jul 11 15:36:39 2022] GET /identity/v3/role_assignments?group.id=3ed32bd4cc714eca80f93e2298ef576f&scope.project.id=8cacd9253675421d9d915794d90317e4&role.id=49eaa4df59ae423fa6913302fe982e4e => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:39.403144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65110a65-9e98-41eb-a42d-cbc138b921a7 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:39.480495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:39.487681 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:39.534979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a9754-b044-4b05-a046-e80a5a46cbf7 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:39.541923 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65110a65-9e98-41eb-a42d-cbc138b921a7 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:39.573265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a765f-bdf9-4df7-bcf3-367a91a5e710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:39.574523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a765f-bdf9-4df7-bcf3-367a91a5e710 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:39.574891 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a765f-bdf9-4df7-bcf3-367a91a5e710 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:39.575238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a765f-bdf9-4df7-bcf3-367a91a5e710 None admin] PATH_INFO: `/v3/groups/3ed32bd4cc714eca80f93e2298ef576f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:39.577290 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a765f-bdf9-4df7-bcf3-367a91a5e710 None admin] RBAC: Authorizing `identity:get_group(group_id=3ed32bd4cc714eca80f93e2298ef576f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:39.578934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a765f-bdf9-4df7-bcf3-367a91a5e710 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:39.579844 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718e504-d9e4-4399-b534-131396143b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:39.580755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718e504-d9e4-4399-b534-131396143b99 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:39.580981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 196/371] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:39 2022] GET /identity/v3/groups/3ed32bd4cc714eca80f93e2298ef576f => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:39.581090 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718e504-d9e4-4399-b534-131396143b99 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:39.581295 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718e504-d9e4-4399-b534-131396143b99 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:39.581683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a765f-bdf9-4df7-bcf3-367a91a5e710 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:39.585264 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718e504-d9e4-4399-b534-131396143b99 None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:39.587378 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718e504-d9e4-4399-b534-131396143b99 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:39.589496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 176/372] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:39 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:39.590571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718e504-d9e4-4399-b534-131396143b99 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:39.690779 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a765f-bdf9-4df7-bcf3-367a91a5e710 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:39.701510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718e504-d9e4-4399-b534-131396143b99 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:39.717401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:39.726705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae821873-689f-4c69-8ed8-fa22375af07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:39.727807 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821873-689f-4c69-8ed8-fa22375af07c None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:39.728188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821873-689f-4c69-8ed8-fa22375af07c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:39.728589 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821873-689f-4c69-8ed8-fa22375af07c None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:39.729444 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae821873-689f-4c69-8ed8-fa22375af07c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:39.729849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae821873-689f-4c69-8ed8-fa22375af07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:39.731335 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae821873-689f-4c69-8ed8-fa22375af07c None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:39.734610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:39.741003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 197/373] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:39.742125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae821873-689f-4c69-8ed8-fa22375af07c None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:39.744215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e7898-2ea0-4b81-bd4a-df09a92e3204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:39.745257 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e7898-2ea0-4b81-bd4a-df09a92e3204 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:39.745773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e7898-2ea0-4b81-bd4a-df09a92e3204 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:39.746228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e7898-2ea0-4b81-bd4a-df09a92e3204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:39.747232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e7898-2ea0-4b81-bd4a-df09a92e3204 None admin] RBAC: Adding query filter params (group.id=3ed32bd4cc714eca80f93e2298ef576f, role.id=7df8c80cd6f643d6aa8ecd8281781a3f, scope.project.id=21d24ab37b7c4dbaa4794944fac657c0) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:39.747783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e7898-2ea0-4b81-bd4a-df09a92e3204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:39.749681 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e7898-2ea0-4b81-bd4a-df09a92e3204 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:39.757003 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 177/374] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Jul 11 15:36:39 2022] GET /identity/v3/role_assignments?group.id=3ed32bd4cc714eca80f93e2298ef576f&scope.project.id=21d24ab37b7c4dbaa4794944fac657c0&role.id=7df8c80cd6f643d6aa8ecd8281781a3f => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:39.758216 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e7898-2ea0-4b81-bd4a-df09a92e3204 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:39.847064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae821873-689f-4c69-8ed8-fa22375af07c None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:39.873434 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e7898-2ea0-4b81-bd4a-df09a92e3204 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:39.883105 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8263cdb-c60c-4fd6-a0b2-aa78091cac2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:39.884055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8263cdb-c60c-4fd6-a0b2-aa78091cac2c None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:39.884430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8263cdb-c60c-4fd6-a0b2-aa78091cac2c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:39.884767 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8263cdb-c60c-4fd6-a0b2-aa78091cac2c None admin] PATH_INFO: `/v3/groups/3ed32bd4cc714eca80f93e2298ef576f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:39.886069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8263cdb-c60c-4fd6-a0b2-aa78091cac2c None admin] RBAC: Authorizing `identity:get_group(group_id=3ed32bd4cc714eca80f93e2298ef576f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:39.887624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8263cdb-c60c-4fd6-a0b2-aa78091cac2c None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:39.889478 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 198/375] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:39 2022] GET /identity/v3/groups/3ed32bd4cc714eca80f93e2298ef576f => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:39.895561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8263cdb-c60c-4fd6-a0b2-aa78091cac2c None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:39.914001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21356512-6f28-4afd-a4d8-e8fd5d92edf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:39.915127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21356512-6f28-4afd-a4d8-e8fd5d92edf4 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:39.915676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21356512-6f28-4afd-a4d8-e8fd5d92edf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:39.916126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21356512-6f28-4afd-a4d8-e8fd5d92edf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:39.958221 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:39.991489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:40.004777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8263cdb-c60c-4fd6-a0b2-aa78091cac2c None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:40.005156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21356512-6f28-4afd-a4d8-e8fd5d92edf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:40.006981 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21356512-6f28-4afd-a4d8-e8fd5d92edf4 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:40.041055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ceb8d-e1f4-4f4e-a520-4eee22ae8b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:40.041807 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ceb8d-e1f4-4f4e-a520-4eee22ae8b1b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:40.042167 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ceb8d-e1f4-4f4e-a520-4eee22ae8b1b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:40.042499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ceb8d-e1f4-4f4e-a520-4eee22ae8b1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:40.043419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ceb8d-e1f4-4f4e-a520-4eee22ae8b1b None admin] RBAC: Adding query filter params (group.id=3ed32bd4cc714eca80f93e2298ef576f, role.id=49eaa4df59ae423fa6913302fe982e4e, scope.project.id=21d24ab37b7c4dbaa4794944fac657c0) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:40.043797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ceb8d-e1f4-4f4e-a520-4eee22ae8b1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:40.045384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ceb8d-e1f4-4f4e-a520-4eee22ae8b1b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:40.051527 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 199/376] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Jul 11 15:36:39 2022] GET /identity/v3/role_assignments?group.id=3ed32bd4cc714eca80f93e2298ef576f&scope.project.id=21d24ab37b7c4dbaa4794944fac657c0&role.id=49eaa4df59ae423fa6913302fe982e4e => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:40.126424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 178/377] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:40.137649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ceb8d-e1f4-4f4e-a520-4eee22ae8b1b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:40.250104 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ceb8d-e1f4-4f4e-a520-4eee22ae8b1b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:40.273945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:40.286558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c5161-bff6-46a1-817c-9b9e693299fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:40.287950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c5161-bff6-46a1-817c-9b9e693299fc None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:40.288231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c5161-bff6-46a1-817c-9b9e693299fc None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:40.288534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c5161-bff6-46a1-817c-9b9e693299fc None admin] PATH_INFO: `/v3/projects/ea74c7f2a67041fea527ddf55a3384ec` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:40.289743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c5161-bff6-46a1-817c-9b9e693299fc None admin] RBAC: Authorizing `identity:get_project(project_id=ea74c7f2a67041fea527ddf55a3384ec)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:40.291207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c5161-bff6-46a1-817c-9b9e693299fc None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:40.293278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 200/378] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:40 2022] GET /identity/v3/projects/ea74c7f2a67041fea527ddf55a3384ec => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:40.298721 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21356512-6f28-4afd-a4d8-e8fd5d92edf4 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:40.436047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:40.445856 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21356512-6f28-4afd-a4d8-e8fd5d92edf4 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:40.496693 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b08b9-a4d3-4e02-a701-7d53ee51741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:40.497955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b08b9-a4d3-4e02-a701-7d53ee51741f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:40.498444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b08b9-a4d3-4e02-a701-7d53ee51741f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:40.498904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b08b9-a4d3-4e02-a701-7d53ee51741f None admin] PATH_INFO: `/v3/groups/9cb606f54bb7441194fef650ec739273` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:40.507551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b08b9-a4d3-4e02-a701-7d53ee51741f None admin] RBAC: Authorizing `identity:get_group(group_id=9cb606f54bb7441194fef650ec739273)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:40.509253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b08b9-a4d3-4e02-a701-7d53ee51741f None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:40.511204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 179/379] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:40 2022] GET /identity/v3/groups/9cb606f54bb7441194fef650ec739273 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:40.517184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c5161-bff6-46a1-817c-9b9e693299fc None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:40.657179 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c5161-bff6-46a1-817c-9b9e693299fc None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:40.713009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3356627-1abe-475e-b21c-2454808cc4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:40.713684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3356627-1abe-475e-b21c-2454808cc4e0 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:40.713970 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3356627-1abe-475e-b21c-2454808cc4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:40.714252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3356627-1abe-475e-b21c-2454808cc4e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:40.715108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3356627-1abe-475e-b21c-2454808cc4e0 None admin] RBAC: Adding query filter params (group.id=9cb606f54bb7441194fef650ec739273, role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=ea74c7f2a67041fea527ddf55a3384ec) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:40.715422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3356627-1abe-475e-b21c-2454808cc4e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:40.716909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3356627-1abe-475e-b21c-2454808cc4e0 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:40.723421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 201/380] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Jul 11 15:36:40 2022] GET /identity/v3/role_assignments?group.id=9cb606f54bb7441194fef650ec739273&scope.project.id=ea74c7f2a67041fea527ddf55a3384ec&role.id=32f5ce5800cf40d99d894960288d0155 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:40.946201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa607f-3a13-413c-9c45-5a5217a889f1 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:40.946890 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa607f-3a13-413c-9c45-5a5217a889f1 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:40.947383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa607f-3a13-413c-9c45-5a5217a889f1 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:40.949304 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 180/381] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:40.954820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a0e3c-89f7-4434-b43c-f7fbb39fa9f1 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:40.955121 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a0e3c-89f7-4434-b43c-f7fbb39fa9f1 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:40.955405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a0e3c-89f7-4434-b43c-f7fbb39fa9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:40.977560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-919a0e3c-89f7-4434-b43c-f7fbb39fa9f1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:40.979056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-919a0e3c-89f7-4434-b43c-f7fbb39fa9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:41.048508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:41.074213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 202/382] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:41.113832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa607f-3a13-413c-9c45-5a5217a889f1 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:41.267708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa607f-3a13-413c-9c45-5a5217a889f1 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:41.317116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f6085-aaf4-4697-bb9f-95485c20b239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:41.318302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f6085-aaf4-4697-bb9f-95485c20b239 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:41.318807 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f6085-aaf4-4697-bb9f-95485c20b239 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:41.319278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f6085-aaf4-4697-bb9f-95485c20b239 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:41.334800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f6085-aaf4-4697-bb9f-95485c20b239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-168f6085-aaf4-4697-bb9f-95485c20b239 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:41.343784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:41.344925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:41.345718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:41.345718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:41.345718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:41.345718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:41.345718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:41.345718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:41.345718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:41.345718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:41.345718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:41.345718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:41.345718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:41.345718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:41.348367 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 181/383] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:41.354675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a0e3c-89f7-4434-b43c-f7fbb39fa9f1 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:41.480625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a0e3c-89f7-4434-b43c-f7fbb39fa9f1 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:41.530635 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99abf86-c490-44fd-adfb-c7c1f66c9989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:41.531647 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99abf86-c490-44fd-adfb-c7c1f66c9989 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:41.532144 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99abf86-c490-44fd-adfb-c7c1f66c9989 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:41.532624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99abf86-c490-44fd-adfb-c7c1f66c9989 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:41.533648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99abf86-c490-44fd-adfb-c7c1f66c9989 None admin] RBAC: Adding query filter params (name=member) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:41.534143 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99abf86-c490-44fd-adfb-c7c1f66c9989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:41.535911 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99abf86-c490-44fd-adfb-c7c1f66c9989 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:41.549243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 203/384] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:41.555283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f6085-aaf4-4697-bb9f-95485c20b239 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:41.583411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:41.693974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f6085-aaf4-4697-bb9f-95485c20b239 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:41.734585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e30add-09f9-4f38-8c7c-38f6c4ad749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:41.735801 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30add-09f9-4f38-8c7c-38f6c4ad749c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:41.736283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30add-09f9-4f38-8c7c-38f6c4ad749c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:41.740095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30add-09f9-4f38-8c7c-38f6c4ad749c None admin] PATH_INFO: `/v3/groups/3ed32bd4cc714eca80f93e2298ef576f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:41.741582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e30add-09f9-4f38-8c7c-38f6c4ad749c None admin] RBAC: Authorizing `identity:get_group(group_id=3ed32bd4cc714eca80f93e2298ef576f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:41.743251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e30add-09f9-4f38-8c7c-38f6c4ad749c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:41.745496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 182/385] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:41 2022] GET /identity/v3/groups/3ed32bd4cc714eca80f93e2298ef576f => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:41.751560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99abf86-c490-44fd-adfb-c7c1f66c9989 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:41.811246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:41.875926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99abf86-c490-44fd-adfb-c7c1f66c9989 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:41.918111 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1710ac6-6d42-4f7f-94e9-ee85eb5d953b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:41.919357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1710ac6-6d42-4f7f-94e9-ee85eb5d953b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:41.919836 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1710ac6-6d42-4f7f-94e9-ee85eb5d953b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:41.920316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1710ac6-6d42-4f7f-94e9-ee85eb5d953b None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:41.921834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1710ac6-6d42-4f7f-94e9-ee85eb5d953b None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:41.923492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1710ac6-6d42-4f7f-94e9-ee85eb5d953b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:41.925571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 204/386] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:41 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:41.937148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e30add-09f9-4f38-8c7c-38f6c4ad749c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:42.044899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:42.070301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e30add-09f9-4f38-8c7c-38f6c4ad749c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:42.114394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ea4c4-51f8-41c7-98fd-64879d0e0a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:42.116072 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ea4c4-51f8-41c7-98fd-64879d0e0a29 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:42.116586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ea4c4-51f8-41c7-98fd-64879d0e0a29 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:42.117085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ea4c4-51f8-41c7-98fd-64879d0e0a29 None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4/groups/3ed32bd4cc714eca80f93e2298ef576f/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:42.119211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ea4c4-51f8-41c7-98fd-64879d0e0a29 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cacd9253675421d9d915794d90317e4, group_id=3ed32bd4cc714eca80f93e2298ef576f, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:42.120890 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ea4c4-51f8-41c7-98fd-64879d0e0a29 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:42.149330 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 183/387] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Jul 11 15:36:41 2022] PUT /identity/v3/projects/8cacd9253675421d9d915794d90317e4/groups/3ed32bd4cc714eca80f93e2298ef576f/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:42.223362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9bb1c-af6c-48c5-b645-063bf5efc4a5 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:42.223739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9bb1c-af6c-48c5-b645-063bf5efc4a5 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:42.223915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9bb1c-af6c-48c5-b645-063bf5efc4a5 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:42.225732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 205/388] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:36:42.231500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa99371-8646-4f2f-8c78-90086c7825aa None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:42.231791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa99371-8646-4f2f-8c78-90086c7825aa None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:42.232074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa99371-8646-4f2f-8c78-90086c7825aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:42.258174 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-9aa99371-8646-4f2f-8c78-90086c7825aa None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:42.259422 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9aa99371-8646-4f2f-8c78-90086c7825aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:42.360337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 184/389] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:42.367193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629e4b3-307d-4145-8d11-801c83f86479 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:42.367652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629e4b3-307d-4145-8d11-801c83f86479 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:42.367827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629e4b3-307d-4145-8d11-801c83f86479 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:42.369295 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 206/390] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:42.374338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bfdaa-5fba-4ce8-b9bc-35436777a43c None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:42.374630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bfdaa-5fba-4ce8-b9bc-35436777a43c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:42.375114 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bfdaa-5fba-4ce8-b9bc-35436777a43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:42.386922 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629e4b3-307d-4145-8d11-801c83f86479 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:42.392651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-a63bfdaa-5fba-4ce8-b9bc-35436777a43c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:42.393159 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a63bfdaa-5fba-4ce8-b9bc-35436777a43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:42.474990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 185/391] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:42.476508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d40e4-e805-4c79-b207-ef77cf7ef5ea None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:42.476823 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d40e4-e805-4c79-b207-ef77cf7ef5ea None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:42.477106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d40e4-e805-4c79-b207-ef77cf7ef5ea None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:42.479425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 186/392] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:42.487167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80895a-31c0-4a2a-b3d8-6fabda33ab7e None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:42.489023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80895a-31c0-4a2a-b3d8-6fabda33ab7e None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:42.489314 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80895a-31c0-4a2a-b3d8-6fabda33ab7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:42.500628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:42.513069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-5b80895a-31c0-4a2a-b3d8-6fabda33ab7e None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:42.515077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5b80895a-31c0-4a2a-b3d8-6fabda33ab7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:42.530132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629e4b3-307d-4145-8d11-801c83f86479 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:42.547925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:42.572558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60483bda-5aa8-4ab3-9b2c-f51e506ed0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:42.573623 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60483bda-5aa8-4ab3-9b2c-f51e506ed0ac None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:42.574118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60483bda-5aa8-4ab3-9b2c-f51e506ed0ac None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:42.574545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60483bda-5aa8-4ab3-9b2c-f51e506ed0ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:42.586635 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60483bda-5aa8-4ab3-9b2c-f51e506ed0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-60483bda-5aa8-4ab3-9b2c-f51e506ed0ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:42.594844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:42.595755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:42.596556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:42.596556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:42.596556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:42.596556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:42.596556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:42.596556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:42.596556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:42.596556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:42.596556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:42.596556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:42.596556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:42.596556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:42.596556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 207/393] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:42.597235 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60483bda-5aa8-4ab3-9b2c-f51e506ed0ac None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:42.597962 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 187/394] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:42.602131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80895a-31c0-4a2a-b3d8-6fabda33ab7e None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:42.719689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80895a-31c0-4a2a-b3d8-6fabda33ab7e None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:42.745534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60483bda-5aa8-4ab3-9b2c-f51e506ed0ac None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:42.759676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bf1aa-1121-4397-b2c6-c608dd5702a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:42.760476 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bf1aa-1121-4397-b2c6-c608dd5702a0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:42.760760 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bf1aa-1121-4397-b2c6-c608dd5702a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:42.761033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bf1aa-1121-4397-b2c6-c608dd5702a0 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:42.761802 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bf1aa-1121-4397-b2c6-c608dd5702a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:42.762109 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bf1aa-1121-4397-b2c6-c608dd5702a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:42.763679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bf1aa-1121-4397-b2c6-c608dd5702a0 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:42.765901 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:42.780714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 188/395] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:42.781817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bf1aa-1121-4397-b2c6-c608dd5702a0 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:42.792495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc695a-bba4-452d-b9ba-f8041812d39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:42.793624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc695a-bba4-452d-b9ba-f8041812d39a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:42.794527 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc695a-bba4-452d-b9ba-f8041812d39a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:42.795031 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc695a-bba4-452d-b9ba-f8041812d39a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:42.810419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc695a-bba4-452d-b9ba-f8041812d39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-d9cc695a-bba4-452d-b9ba-f8041812d39a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:42.823060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:42.823972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:42.824805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:42.824805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:42.824805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:42.824805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:42.824805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:42.824805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:42.824805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:42.824805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:42.824805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:42.824805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:42.824805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:42.824805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:42.832388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 208/396] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:36:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:42.833755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc695a-bba4-452d-b9ba-f8041812d39a None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:42.886903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:42.909266 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bf1aa-1121-4397-b2c6-c608dd5702a0 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:42.945467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb08f8-8980-40fc-9121-0bb8f96794a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:42.946791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb08f8-8980-40fc-9121-0bb8f96794a3 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:42.947287 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb08f8-8980-40fc-9121-0bb8f96794a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:42.947758 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb08f8-8980-40fc-9121-0bb8f96794a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:42.959268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb08f8-8980-40fc-9121-0bb8f96794a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:42.962966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc695a-bba4-452d-b9ba-f8041812d39a None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-37bb08f8-8980-40fc-9121-0bb8f96794a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:42.968932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:42.969974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:42.970773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:42.970773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:42.970773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:42.970773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:42.970773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:42.970773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:42.970773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:42.970773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:42.970773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:42.970773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:42.970773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:42.970773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:42.973554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 189/397] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:36:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:42.974566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb08f8-8980-40fc-9121-0bb8f96794a3 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:43.005079 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfbe38-efc5-4c32-a71f-3443301d00f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:43.006011 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbe38-efc5-4c32-a71f-3443301d00f3 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:43.006330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbe38-efc5-4c32-a71f-3443301d00f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:43.006616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbe38-efc5-4c32-a71f-3443301d00f3 None admin] PATH_INFO: `/v3/groups/3ed32bd4cc714eca80f93e2298ef576f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:43.007922 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfbe38-efc5-4c32-a71f-3443301d00f3 None admin] RBAC: Authorizing `identity:get_group(group_id=3ed32bd4cc714eca80f93e2298ef576f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:43.009569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfbe38-efc5-4c32-a71f-3443301d00f3 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:43.011457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 209/398] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:42 2022] GET /identity/v3/groups/3ed32bd4cc714eca80f93e2298ef576f => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:43.012415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfbe38-efc5-4c32-a71f-3443301d00f3 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:43.035974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:43.082988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb08f8-8980-40fc-9121-0bb8f96794a3 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:43.117920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cf39c-c79a-4f34-9f04-9b0dd7a206fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:43.119562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cf39c-c79a-4f34-9f04-9b0dd7a206fe None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:43.120058 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cf39c-c79a-4f34-9f04-9b0dd7a206fe None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:43.120645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cf39c-c79a-4f34-9f04-9b0dd7a206fe None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:43.121760 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cf39c-c79a-4f34-9f04-9b0dd7a206fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:43.122284 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cf39c-c79a-4f34-9f04-9b0dd7a206fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:43.123926 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cf39c-c79a-4f34-9f04-9b0dd7a206fe None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:43.126296 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfbe38-efc5-4c32-a71f-3443301d00f3 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:43.128061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:43.139121 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 190/399] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:43.140597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cf39c-c79a-4f34-9f04-9b0dd7a206fe None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:43.163827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b73932-db37-49ee-bb29-1f4d5b285ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:43.164587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b73932-db37-49ee-bb29-1f4d5b285ba1 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:43.164872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b73932-db37-49ee-bb29-1f4d5b285ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:43.165199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b73932-db37-49ee-bb29-1f4d5b285ba1 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:43.166120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b73932-db37-49ee-bb29-1f4d5b285ba1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:43.166374 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b73932-db37-49ee-bb29-1f4d5b285ba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:43.167757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b73932-db37-49ee-bb29-1f4d5b285ba1 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:43.177342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 210/400] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:43.177991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b73932-db37-49ee-bb29-1f4d5b285ba1 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:43.250801 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cf39c-c79a-4f34-9f04-9b0dd7a206fe None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:43.269018 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:43.285311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b73932-db37-49ee-bb29-1f4d5b285ba1 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:43.289178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ed686-f329-48a4-a748-bbd58dce2a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:43.290052 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed686-f329-48a4-a748-bbd58dce2a94 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:43.290340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed686-f329-48a4-a748-bbd58dce2a94 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:43.290618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed686-f329-48a4-a748-bbd58dce2a94 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:43.291819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ed686-f329-48a4-a748-bbd58dce2a94 None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:43.293419 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ed686-f329-48a4-a748-bbd58dce2a94 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:43.300620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 191/401] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:43 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:43.301314 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ed686-f329-48a4-a748-bbd58dce2a94 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:43.320685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8ecbb-f7a8-41cb-951c-a97d75990e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:43.321554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8ecbb-f7a8-41cb-951c-a97d75990e3a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:43.321818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8ecbb-f7a8-41cb-951c-a97d75990e3a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:43.322090 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8ecbb-f7a8-41cb-951c-a97d75990e3a None admin] PATH_INFO: `/v3/groups/3ed32bd4cc714eca80f93e2298ef576f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:43.323270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8ecbb-f7a8-41cb-951c-a97d75990e3a None admin] RBAC: Authorizing `identity:get_group(group_id=3ed32bd4cc714eca80f93e2298ef576f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:43.324754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8ecbb-f7a8-41cb-951c-a97d75990e3a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:43.331029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 211/402] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:43 2022] GET /identity/v3/groups/3ed32bd4cc714eca80f93e2298ef576f => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:43.331029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ff5eb-3e41-45f0-a9fc-edb751eca165 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:43.331029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ff5eb-3e41-45f0-a9fc-edb751eca165 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:43.331029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ff5eb-3e41-45f0-a9fc-edb751eca165 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:43.331029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 212/403] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:43.331029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ff5eb-3e41-45f0-a9fc-edb751eca165 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:43.364577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:43.413839 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ed686-f329-48a4-a748-bbd58dce2a94 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:43.442195 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ff5eb-3e41-45f0-a9fc-edb751eca165 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:43.450713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2739b6-b739-49e5-811d-0f1241f2b84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:43.451646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2739b6-b739-49e5-811d-0f1241f2b84f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:43.451932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2739b6-b739-49e5-811d-0f1241f2b84f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:43.452202 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2739b6-b739-49e5-811d-0f1241f2b84f None admin] PATH_INFO: `/v3/groups/3ed32bd4cc714eca80f93e2298ef576f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:43.453452 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2739b6-b739-49e5-811d-0f1241f2b84f None admin] RBAC: Authorizing `identity:get_group(group_id=3ed32bd4cc714eca80f93e2298ef576f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:43.454906 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2739b6-b739-49e5-811d-0f1241f2b84f None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:43.456936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 192/404] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:43 2022] GET /identity/v3/groups/3ed32bd4cc714eca80f93e2298ef576f => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:43.457790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2739b6-b739-49e5-811d-0f1241f2b84f None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:43.482482 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95f858-82c3-4a03-b5bf-5d099aaec8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:43.483676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95f858-82c3-4a03-b5bf-5d099aaec8d4 None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:43.483956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95f858-82c3-4a03-b5bf-5d099aaec8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:43.484230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95f858-82c3-4a03-b5bf-5d099aaec8d4 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0/groups/3ed32bd4cc714eca80f93e2298ef576f/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:43.486232 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95f858-82c3-4a03-b5bf-5d099aaec8d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=21d24ab37b7c4dbaa4794944fac657c0, group_id=3ed32bd4cc714eca80f93e2298ef576f, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:43.487698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95f858-82c3-4a03-b5bf-5d099aaec8d4 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:43.502318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 213/405] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Jul 11 15:36:43 2022] PUT /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0/groups/3ed32bd4cc714eca80f93e2298ef576f/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:43.503593 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689dbae-45b8-44e6-8635-123fd8eff1fb None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:43.503884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689dbae-45b8-44e6-8635-123fd8eff1fb None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:43.504153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689dbae-45b8-44e6-8635-123fd8eff1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:43.523339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-7689dbae-45b8-44e6-8635-123fd8eff1fb None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:43.524595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7689dbae-45b8-44e6-8635-123fd8eff1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:43.532663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:43.603155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2739b6-b739-49e5-811d-0f1241f2b84f None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:43.612707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 214/406] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:43.613992 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689dbae-45b8-44e6-8635-123fd8eff1fb None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:43.650304 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e514a7b-2ae5-474c-95d2-db0eb0f0cb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:43.651600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e514a7b-2ae5-474c-95d2-db0eb0f0cb88 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:43.651885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e514a7b-2ae5-474c-95d2-db0eb0f0cb88 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:43.652162 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e514a7b-2ae5-474c-95d2-db0eb0f0cb88 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:43.653516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e514a7b-2ae5-474c-95d2-db0eb0f0cb88 None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:43.655787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e514a7b-2ae5-474c-95d2-db0eb0f0cb88 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:43.660685 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 193/407] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:43 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:43.661847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e514a7b-2ae5-474c-95d2-db0eb0f0cb88 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:43.666379 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:43.761467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689dbae-45b8-44e6-8635-123fd8eff1fb None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:43.775518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e514a7b-2ae5-474c-95d2-db0eb0f0cb88 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:43.797335 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b7f2f-73b0-4503-8822-934a5d4d1262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:43.798227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7f2f-73b0-4503-8822-934a5d4d1262 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:43.798507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7f2f-73b0-4503-8822-934a5d4d1262 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:43.798783 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7f2f-73b0-4503-8822-934a5d4d1262 None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:43.799987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b7f2f-73b0-4503-8822-934a5d4d1262 None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:43.801470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b7f2f-73b0-4503-8822-934a5d4d1262 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:43.803531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 215/408] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:43 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:43.804491 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b7f2f-73b0-4503-8822-934a5d4d1262 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:43.806240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:43.825068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31447d-a39b-4e28-8066-463846ea4cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:43.826364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31447d-a39b-4e28-8066-463846ea4cb3 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:43.827270 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31447d-a39b-4e28-8066-463846ea4cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:43.827770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31447d-a39b-4e28-8066-463846ea4cb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:43.842375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31447d-a39b-4e28-8066-463846ea4cb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-1e31447d-a39b-4e28-8066-463846ea4cb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:43.852722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:43.853638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:43.854418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:43.854418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:43.854418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:43.854418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:43.854418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:43.854418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:43.854418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:43.854418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:43.854418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:43.854418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:43.854418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:43.854418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:43.854418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 194/409] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:43.855054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31447d-a39b-4e28-8066-463846ea4cb3 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:43.904727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:43.919820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b7f2f-73b0-4503-8822-934a5d4d1262 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:43.957167 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e1912-6c84-41d2-9b4f-3018e995bf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:43.958123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e1912-6c84-41d2-9b4f-3018e995bf26 None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:43.958419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e1912-6c84-41d2-9b4f-3018e995bf26 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:43.958687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e1912-6c84-41d2-9b4f-3018e995bf26 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0/groups/3ed32bd4cc714eca80f93e2298ef576f/roles/49eaa4df59ae423fa6913302fe982e4e` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:43.961710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e1912-6c84-41d2-9b4f-3018e995bf26 None admin] RBAC: Authorizing `identity:create_grant(project_id=21d24ab37b7c4dbaa4794944fac657c0, group_id=3ed32bd4cc714eca80f93e2298ef576f, role_id=49eaa4df59ae423fa6913302fe982e4e)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:43.962783 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e1912-6c84-41d2-9b4f-3018e995bf26 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:43.984423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 216/410] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Jul 11 15:36:43 2022] PUT /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0/groups/3ed32bd4cc714eca80f93e2298ef576f/roles/49eaa4df59ae423fa6913302fe982e4e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:43.984423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e1912-6c84-41d2-9b4f-3018e995bf26 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:44.012392 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31447d-a39b-4e28-8066-463846ea4cb3 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:44.079182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0fee6-6c49-450d-85b1-ab73d7fd4766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:44.080210 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0fee6-6c49-450d-85b1-ab73d7fd4766 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:44.080571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0fee6-6c49-450d-85b1-ab73d7fd4766 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:44.080906 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0fee6-6c49-450d-85b1-ab73d7fd4766 None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4/groups/3ed32bd4cc714eca80f93e2298ef576f/roles/49eaa4df59ae423fa6913302fe982e4e` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:44.086359 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0fee6-6c49-450d-85b1-ab73d7fd4766 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cacd9253675421d9d915794d90317e4, group_id=3ed32bd4cc714eca80f93e2298ef576f, role_id=49eaa4df59ae423fa6913302fe982e4e)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:44.088243 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0fee6-6c49-450d-85b1-ab73d7fd4766 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:44.105218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e1912-6c84-41d2-9b4f-3018e995bf26 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:44.119423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 195/411] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Jul 11 15:36:43 2022] PUT /identity/v3/projects/8cacd9253675421d9d915794d90317e4/groups/3ed32bd4cc714eca80f93e2298ef576f/roles/49eaa4df59ae423fa6913302fe982e4e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:44.162057 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb3d1b-33a6-4933-8723-c17fa8519106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:44.163012 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb3d1b-33a6-4933-8723-c17fa8519106 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:44.163474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb3d1b-33a6-4933-8723-c17fa8519106 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:44.163893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb3d1b-33a6-4933-8723-c17fa8519106 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:44.164911 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb3d1b-33a6-4933-8723-c17fa8519106 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:44.165364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb3d1b-33a6-4933-8723-c17fa8519106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:44.167024 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb3d1b-33a6-4933-8723-c17fa8519106 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:44.180868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 217/412] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:44.198627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0fee6-6c49-450d-85b1-ab73d7fd4766 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:44.272177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:44.348620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0fee6-6c49-450d-85b1-ab73d7fd4766 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:44.370590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25900988-532e-47a2-a358-93113cfdc6f4 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:44.370934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25900988-532e-47a2-a358-93113cfdc6f4 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:44.371145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25900988-532e-47a2-a358-93113cfdc6f4 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:44.372561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 218/413] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:36:44.378692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a5d87-8805-4bf6-8543-648cc4aaf2cd None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:44.378692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a5d87-8805-4bf6-8543-648cc4aaf2cd None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:44.378692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a5d87-8805-4bf6-8543-648cc4aaf2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:44.394154 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a447f-eca9-4724-8cbf-9047f97121dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:44.395071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a447f-eca9-4724-8cbf-9047f97121dd None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:44.395360 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a447f-eca9-4724-8cbf-9047f97121dd None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:44.395634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a447f-eca9-4724-8cbf-9047f97121dd None admin] PATH_INFO: `/v3/groups/9cb606f54bb7441194fef650ec739273` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:44.397393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a447f-eca9-4724-8cbf-9047f97121dd None admin] RBAC: Authorizing `identity:get_group(group_id=9cb606f54bb7441194fef650ec739273)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:44.398375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a447f-eca9-4724-8cbf-9047f97121dd None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:44.400188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 196/414] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:44 2022] GET /identity/v3/groups/9cb606f54bb7441194fef650ec739273 => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:44.404208 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-c55a5d87-8805-4bf6-8543-648cc4aaf2cd None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:44.405355 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a447f-eca9-4724-8cbf-9047f97121dd None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:44.406025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c55a5d87-8805-4bf6-8543-648cc4aaf2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:44.415056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:44.479839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 219/415] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:44.502797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a5d87-8805-4bf6-8543-648cc4aaf2cd None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:44.515320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a447f-eca9-4724-8cbf-9047f97121dd None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:44.526315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:44.551624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b7139-8de1-4d59-ba9f-21c5e9e5d7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:44.552879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7139-8de1-4d59-ba9f-21c5e9e5d7cf None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:44.553593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7139-8de1-4d59-ba9f-21c5e9e5d7cf None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:44.554062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7139-8de1-4d59-ba9f-21c5e9e5d7cf None admin] PATH_INFO: `/v3/projects/ea74c7f2a67041fea527ddf55a3384ec` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:44.555686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b7139-8de1-4d59-ba9f-21c5e9e5d7cf None admin] RBAC: Authorizing `identity:get_project(project_id=ea74c7f2a67041fea527ddf55a3384ec)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:44.558250 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b7139-8de1-4d59-ba9f-21c5e9e5d7cf None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:44.560555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 197/416] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:44 2022] GET /identity/v3/projects/ea74c7f2a67041fea527ddf55a3384ec => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:44.573258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b7139-8de1-4d59-ba9f-21c5e9e5d7cf None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:44.668645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a5d87-8805-4bf6-8543-648cc4aaf2cd None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:44.718562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b7139-8de1-4d59-ba9f-21c5e9e5d7cf None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:44.745018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a4bdc-689b-411b-801e-b6c31db210f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:44.745849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a4bdc-689b-411b-801e-b6c31db210f7 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:44.746336 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a4bdc-689b-411b-801e-b6c31db210f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:44.746441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a4bdc-689b-411b-801e-b6c31db210f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:44.757780 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e3b9b-021d-4e13-857f-ed00888f6408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:44.758966 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e3b9b-021d-4e13-857f-ed00888f6408 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:44.759428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e3b9b-021d-4e13-857f-ed00888f6408 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:44.759878 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e3b9b-021d-4e13-857f-ed00888f6408 None admin] PATH_INFO: `/v3/projects/ea74c7f2a67041fea527ddf55a3384ec/groups/9cb606f54bb7441194fef650ec739273/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:44.762316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e3b9b-021d-4e13-857f-ed00888f6408 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea74c7f2a67041fea527ddf55a3384ec, group_id=9cb606f54bb7441194fef650ec739273, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:44.764024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e3b9b-021d-4e13-857f-ed00888f6408 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:44.765800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a4bdc-689b-411b-801e-b6c31db210f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:44.781952 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 198/417] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Jul 11 15:36:44 2022] PUT /identity/v3/projects/ea74c7f2a67041fea527ddf55a3384ec/groups/9cb606f54bb7441194fef650ec739273/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-572a4bdc-689b-411b-801e-b6c31db210f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:44.782123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:44.783010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:44.783827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:44.783827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:44.783827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:44.783827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:44.783827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:44.783827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:44.783827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:44.783827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:44.783827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:44.783827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:44.783827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:44.783827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:44.783827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 220/418] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:36:44.793460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a4bdc-689b-411b-801e-b6c31db210f7 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:44.799137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:44.928662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a4bdc-689b-411b-801e-b6c31db210f7 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:44.971757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cf248-d7c7-400b-a5c3-7869855099e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:44.972855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cf248-d7c7-400b-a5c3-7869855099e9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:44.973355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cf248-d7c7-400b-a5c3-7869855099e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:44.973842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cf248-d7c7-400b-a5c3-7869855099e9 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:44.974801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cf248-d7c7-400b-a5c3-7869855099e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:44.975305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cf248-d7c7-400b-a5c3-7869855099e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:44.976981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cf248-d7c7-400b-a5c3-7869855099e9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:44.986393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 221/419] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:44.991580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e3b9b-021d-4e13-857f-ed00888f6408 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:45.044721 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:45.098657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e3b9b-021d-4e13-857f-ed00888f6408 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:45.133614 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4323727-3b05-4382-853b-be2659b4c23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:45.134270 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4323727-3b05-4382-853b-be2659b4c23a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:45.134553 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4323727-3b05-4382-853b-be2659b4c23a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:45.134831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4323727-3b05-4382-853b-be2659b4c23a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:45.215783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4323727-3b05-4382-853b-be2659b4c23a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:45.217307 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4323727-3b05-4382-853b-be2659b4c23a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:45.269499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:45.335072 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 199/420] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:45.340499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cf248-d7c7-400b-a5c3-7869855099e9 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:45.408348 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:45.449948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cf248-d7c7-400b-a5c3-7869855099e9 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:45.485969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10034e23-d955-49b9-a55c-69dd2e3a585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:45.486841 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10034e23-d955-49b9-a55c-69dd2e3a585b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:45.487123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10034e23-d955-49b9-a55c-69dd2e3a585b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:45.487395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10034e23-d955-49b9-a55c-69dd2e3a585b None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:45.488618 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10034e23-d955-49b9-a55c-69dd2e3a585b None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:45.490142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10034e23-d955-49b9-a55c-69dd2e3a585b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:45.492215 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 222/421] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:45 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:45.497348 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4323727-3b05-4382-853b-be2659b4c23a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:45.613060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4323727-3b05-4382-853b-be2659b4c23a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:45.648506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2e44d-031e-4581-b71d-c6192235bf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:45.649375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2e44d-031e-4581-b71d-c6192235bf99 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:45.649654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2e44d-031e-4581-b71d-c6192235bf99 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:45.649926 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2e44d-031e-4581-b71d-c6192235bf99 None admin] PATH_INFO: `/v3/groups/3ed32bd4cc714eca80f93e2298ef576f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:45.651106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2e44d-031e-4581-b71d-c6192235bf99 None admin] RBAC: Authorizing `identity:get_group(group_id=3ed32bd4cc714eca80f93e2298ef576f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:45.652601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2e44d-031e-4581-b71d-c6192235bf99 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:45.654914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 200/422] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:45 2022] GET /identity/v3/groups/3ed32bd4cc714eca80f93e2298ef576f => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:45.661400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10034e23-d955-49b9-a55c-69dd2e3a585b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:45.777130 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10034e23-d955-49b9-a55c-69dd2e3a585b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:45.807734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:45.813209 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e7404-1d81-457c-ad00-275f251d0e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:45.814206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e7404-1d81-457c-ad00-275f251d0e74 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:45.814495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e7404-1d81-457c-ad00-275f251d0e74 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:45.816703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e7404-1d81-457c-ad00-275f251d0e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:45.816703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e7404-1d81-457c-ad00-275f251d0e74 None admin] RBAC: Adding query filter params (group.id=3ed32bd4cc714eca80f93e2298ef576f, role.id=7df8c80cd6f643d6aa8ecd8281781a3f, scope.project.id=8cacd9253675421d9d915794d90317e4) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:45.816703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e7404-1d81-457c-ad00-275f251d0e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:45.817421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e7404-1d81-457c-ad00-275f251d0e74 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:45.825005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 223/423] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Jul 11 15:36:45 2022] GET /identity/v3/role_assignments?group.id=3ed32bd4cc714eca80f93e2298ef576f&scope.project.id=8cacd9253675421d9d915794d90317e4&role.id=7df8c80cd6f643d6aa8ecd8281781a3f => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:45.862798 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d20fe4-b730-465b-a10a-3f2b2aaf0bf7 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:45.863305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d20fe4-b730-465b-a10a-3f2b2aaf0bf7 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:45.863642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d20fe4-b730-465b-a10a-3f2b2aaf0bf7 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:45.865476 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 201/424] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:45.871115 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba242c-2d1c-42b8-bf7d-e7326c00a0a0 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:45.871587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba242c-2d1c-42b8-bf7d-e7326c00a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:45.872004 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba242c-2d1c-42b8-bf7d-e7326c00a0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:45.897482 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-e3ba242c-2d1c-42b8-bf7d-e7326c00a0a0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:45.898934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e3ba242c-2d1c-42b8-bf7d-e7326c00a0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:45.994338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 224/425] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:46.029706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d20fe4-b730-465b-a10a-3f2b2aaf0bf7 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:46.042201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:46.161056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d20fe4-b730-465b-a10a-3f2b2aaf0bf7 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:46.201499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e4c9-29be-4f7c-a970-b502faba9b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:46.202512 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e4c9-29be-4f7c-a970-b502faba9b7b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:46.203474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e4c9-29be-4f7c-a970-b502faba9b7b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:46.203759 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e4c9-29be-4f7c-a970-b502faba9b7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:46.215181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385e4c9-29be-4f7c-a970-b502faba9b7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-6385e4c9-29be-4f7c-a970-b502faba9b7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:46.223554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:46.224473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:46.225401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:46.225401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:46.225401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:46.225401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:46.225401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:46.225401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:46.225401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:46.225401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:46.225401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:46.225401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:46.225401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 15:36:46.225401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:46.225401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 202/426] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:46.232670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba242c-2d1c-42b8-bf7d-e7326c00a0a0 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:46.346335 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba242c-2d1c-42b8-bf7d-e7326c00a0a0 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:46.373556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:46.382908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68387beb-d042-4cf9-ace0-b08c6fe64e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:46.383589 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68387beb-d042-4cf9-ace0-b08c6fe64e1e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:46.383876 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68387beb-d042-4cf9-ace0-b08c6fe64e1e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:46.384149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68387beb-d042-4cf9-ace0-b08c6fe64e1e None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:46.385010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68387beb-d042-4cf9-ace0-b08c6fe64e1e None admin] RBAC: Adding query filter params (name=member) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:46.385318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68387beb-d042-4cf9-ace0-b08c6fe64e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:46.386771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68387beb-d042-4cf9-ace0-b08c6fe64e1e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:46.396370 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 225/427] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:36:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:46.403451 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e4c9-29be-4f7c-a970-b502faba9b7b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:46.486520 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:46.526795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e4c9-29be-4f7c-a970-b502faba9b7b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:46.570612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838ca60-7ac8-489a-b9ed-1ded988758b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:46.571275 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838ca60-7ac8-489a-b9ed-1ded988758b7 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:46.571559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838ca60-7ac8-489a-b9ed-1ded988758b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:46.571836 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838ca60-7ac8-489a-b9ed-1ded988758b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:46.652315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838ca60-7ac8-489a-b9ed-1ded988758b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:46.653801 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838ca60-7ac8-489a-b9ed-1ded988758b7 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:46.729920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:46.770213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 203/428] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 15:36:46.776191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68387beb-d042-4cf9-ace0-b08c6fe64e1e None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:46.824090 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794464b-8448-4113-a9fa-6fa41651aada None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:46.824742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794464b-8448-4113-a9fa-6fa41651aada None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:46.825308 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794464b-8448-4113-a9fa-6fa41651aada None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:46.828520 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 204/429] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:36:46.833006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60781-0a1d-441a-9ec9-2e3a75edbc2c None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:46.833559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60781-0a1d-441a-9ec9-2e3a75edbc2c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:46.834079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60781-0a1d-441a-9ec9-2e3a75edbc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:46.868351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-ece60781-0a1d-441a-9ec9-2e3a75edbc2c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:46.869960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ece60781-0a1d-441a-9ec9-2e3a75edbc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:46.902875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68387beb-d042-4cf9-ace0-b08c6fe64e1e None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:46.948180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d00abb-88ee-4a05-a1dd-d095b5e48334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:46.949077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d00abb-88ee-4a05-a1dd-d095b5e48334 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:46.949472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d00abb-88ee-4a05-a1dd-d095b5e48334 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:46.949729 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d00abb-88ee-4a05-a1dd-d095b5e48334 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:46.952324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d00abb-88ee-4a05-a1dd-d095b5e48334 None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:46.953451 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d00abb-88ee-4a05-a1dd-d095b5e48334 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:46.955435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 226/430] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:46 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:46.956438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 205/431] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 11 15:36:46.956546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e950041-3bec-44b4-938e-35c9e7c17a57 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:46.956753 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e950041-3bec-44b4-938e-35c9e7c17a57 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:46.957040 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e950041-3bec-44b4-938e-35c9e7c17a57 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:46.958251 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 227/432] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:46.964263 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809db70-7e1c-4d9f-b84c-606bd16f9a54 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:46.964624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809db70-7e1c-4d9f-b84c-606bd16f9a54 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:46.964905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809db70-7e1c-4d9f-b84c-606bd16f9a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:46.971438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e950041-3bec-44b4-938e-35c9e7c17a57 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:46.985008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-b809db70-7e1c-4d9f-b84c-606bd16f9a54 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:46.986207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b809db70-7e1c-4d9f-b84c-606bd16f9a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:47.040582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:47.065577 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 206/433] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:47.066305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809db70-7e1c-4d9f-b84c-606bd16f9a54 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:47.093175 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:47.093722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e950041-3bec-44b4-938e-35c9e7c17a57 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:47.130928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a26a20-657c-4cac-afba-9953306b5751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:47.131903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a26a20-657c-4cac-afba-9953306b5751 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:47.132191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a26a20-657c-4cac-afba-9953306b5751 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:47.132492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a26a20-657c-4cac-afba-9953306b5751 None admin] PATH_INFO: `/v3/groups/3ed32bd4cc714eca80f93e2298ef576f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:47.133665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a26a20-657c-4cac-afba-9953306b5751 None admin] RBAC: Authorizing `identity:get_group(group_id=3ed32bd4cc714eca80f93e2298ef576f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:47.135123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a26a20-657c-4cac-afba-9953306b5751 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:47.141417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 228/434] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:46 2022] GET /identity/v3/groups/3ed32bd4cc714eca80f93e2298ef576f => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:47.141417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a26a20-657c-4cac-afba-9953306b5751 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:47.176234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809db70-7e1c-4d9f-b84c-606bd16f9a54 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:47.209469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b604b23-c3a4-4ffc-a231-05f108b735ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:47.210287 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b604b23-c3a4-4ffc-a231-05f108b735ff None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:47.210560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b604b23-c3a4-4ffc-a231-05f108b735ff None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:47.210830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b604b23-c3a4-4ffc-a231-05f108b735ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:47.221082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b604b23-c3a4-4ffc-a231-05f108b735ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-2b604b23-c3a4-4ffc-a231-05f108b735ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:47.229019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:47.230026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:47.231033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:47.231033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:47.231033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:47.231033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:47.231033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:47.231033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:47.231033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:47.231033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:47.231033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:47.231033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:47.231033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:47.231033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:47.231033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 207/435] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:36:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:47.231033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b604b23-c3a4-4ffc-a231-05f108b735ff None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:47.244230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a26a20-657c-4cac-afba-9953306b5751 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:47.268176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:47.281041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5b244-78c3-4094-a348-6f81e95f30b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:47.281864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5b244-78c3-4094-a348-6f81e95f30b2 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:47.282146 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5b244-78c3-4094-a348-6f81e95f30b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:47.282418 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5b244-78c3-4094-a348-6f81e95f30b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:47.292538 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5b244-78c3-4094-a348-6f81e95f30b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-7be5b244-78c3-4094-a348-6f81e95f30b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:47.301005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:47.301887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:47.302669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:47.302669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:47.302669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:47.302669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:47.302669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:47.302669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:47.302669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:47.302669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:47.302669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:47.302669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:47.302669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:47.302669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:47.302669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 229/436] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:36:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:47.303796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e90e1c-0599-49aa-814a-aa17b41a0951 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:47.303796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e90e1c-0599-49aa-814a-aa17b41a0951 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:47.303948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e90e1c-0599-49aa-814a-aa17b41a0951 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:47.305204 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 230/437] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:47.306541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e90e1c-0599-49aa-814a-aa17b41a0951 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:47.326843 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:47.343168 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b604b23-c3a4-4ffc-a231-05f108b735ff None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:47.378317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a513179-36ac-4564-ae1e-404fd161dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:47.378978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a513179-36ac-4564-ae1e-404fd161dd82 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:47.379268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a513179-36ac-4564-ae1e-404fd161dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:47.379545 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a513179-36ac-4564-ae1e-404fd161dd82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:47.380423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a513179-36ac-4564-ae1e-404fd161dd82 None admin] RBAC: Adding query filter params (group.id=3ed32bd4cc714eca80f93e2298ef576f, role.id=7df8c80cd6f643d6aa8ecd8281781a3f, scope.project.id=21d24ab37b7c4dbaa4794944fac657c0) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:47.380737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a513179-36ac-4564-ae1e-404fd161dd82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:47.382199 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a513179-36ac-4564-ae1e-404fd161dd82 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:47.388004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 208/438] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Jul 11 15:36:47 2022] GET /identity/v3/role_assignments?group.id=3ed32bd4cc714eca80f93e2298ef576f&scope.project.id=21d24ab37b7c4dbaa4794944fac657c0&role.id=7df8c80cd6f643d6aa8ecd8281781a3f => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:47.388796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a513179-36ac-4564-ae1e-404fd161dd82 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:47.409571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e90e1c-0599-49aa-814a-aa17b41a0951 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:47.452852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07a27d-3521-4b52-9e02-8218115766dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:47.453966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07a27d-3521-4b52-9e02-8218115766dd None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:47.454316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07a27d-3521-4b52-9e02-8218115766dd None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:47.454680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07a27d-3521-4b52-9e02-8218115766dd None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:47.455570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07a27d-3521-4b52-9e02-8218115766dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:47.455825 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07a27d-3521-4b52-9e02-8218115766dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:47.457238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07a27d-3521-4b52-9e02-8218115766dd None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:47.466685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 231/439] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:47.468075 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4357ab-3e05-41c1-aec3-5cef51b76a16 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:47.468425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4357ab-3e05-41c1-aec3-5cef51b76a16 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:47.468712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4357ab-3e05-41c1-aec3-5cef51b76a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:47.487453 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3a4357ab-3e05-41c1-aec3-5cef51b76a16 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:47.488964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3a4357ab-3e05-41c1-aec3-5cef51b76a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:47.511904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a513179-36ac-4564-ae1e-404fd161dd82 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:47.540539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:47.552713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990358b-dfed-46c8-9f47-c2d099cf917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:47.553347 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990358b-dfed-46c8-9f47-c2d099cf917d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:47.554723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990358b-dfed-46c8-9f47-c2d099cf917d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:47.554723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990358b-dfed-46c8-9f47-c2d099cf917d None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:47.555168 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990358b-dfed-46c8-9f47-c2d099cf917d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:47.556235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990358b-dfed-46c8-9f47-c2d099cf917d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:47.556917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990358b-dfed-46c8-9f47-c2d099cf917d None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:47.567739 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 209/440] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:47.568553 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990358b-dfed-46c8-9f47-c2d099cf917d None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:47.572854 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 232/441] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:47.574620 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4357ab-3e05-41c1-aec3-5cef51b76a16 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:47.586424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:47.678490 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990358b-dfed-46c8-9f47-c2d099cf917d None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:47.679800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4357ab-3e05-41c1-aec3-5cef51b76a16 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:47.714225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ad8e5-4757-473f-8c10-83bbcfa84721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:47.714890 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ad8e5-4757-473f-8c10-83bbcfa84721 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:47.715153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ad8e5-4757-473f-8c10-83bbcfa84721 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:47.715429 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ad8e5-4757-473f-8c10-83bbcfa84721 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:47.719102 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c4f51-6082-44a7-916d-fa6e7b437042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:47.719789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c4f51-6082-44a7-916d-fa6e7b437042 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:47.720064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c4f51-6082-44a7-916d-fa6e7b437042 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:47.720345 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c4f51-6082-44a7-916d-fa6e7b437042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:47.768079 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:47.784728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ad8e5-4757-473f-8c10-83bbcfa84721 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:47.786220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ad8e5-4757-473f-8c10-83bbcfa84721 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:47.792248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c4f51-6082-44a7-916d-fa6e7b437042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:47.793736 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c4f51-6082-44a7-916d-fa6e7b437042 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:47.799497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:47.884150 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 210/442] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:47.885024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ad8e5-4757-473f-8c10-83bbcfa84721 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:47.902141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 233/443] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 15:36:47.902141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c4f51-6082-44a7-916d-fa6e7b437042 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:47.978235 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:47.988967 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ad8e5-4757-473f-8c10-83bbcfa84721 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:48.001345 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c4f51-6082-44a7-916d-fa6e7b437042 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:48.002529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:48.023088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406dba1-5bcf-44b7-8f5c-d3b692c55fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:48.023879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406dba1-5bcf-44b7-8f5c-d3b692c55fbc None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:48.024158 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406dba1-5bcf-44b7-8f5c-d3b692c55fbc None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:48.024458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406dba1-5bcf-44b7-8f5c-d3b692c55fbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:48.034654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406dba1-5bcf-44b7-8f5c-d3b692c55fbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:48.035744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf04b4-7475-4f1c-8b8e-d27c91115fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:48.036653 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf04b4-7475-4f1c-8b8e-d27c91115fc6 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:48.036941 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf04b4-7475-4f1c-8b8e-d27c91115fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:48.037217 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf04b4-7475-4f1c-8b8e-d27c91115fc6 None admin] PATH_INFO: `/v3/projects/21d24ab37b7c4dbaa4794944fac657c0` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:48.038438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf04b4-7475-4f1c-8b8e-d27c91115fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=21d24ab37b7c4dbaa4794944fac657c0)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:48.039895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf04b4-7475-4f1c-8b8e-d27c91115fc6 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:48.041651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 234/444] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:47 2022] GET /identity/v3/projects/21d24ab37b7c4dbaa4794944fac657c0 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-0406dba1-5bcf-44b7-8f5c-d3b692c55fbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:48.042120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:48.043153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:48.044095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:48.044095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:48.044095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:48.044095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:48.044095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:48.044095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:48.044095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:48.044095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:48.044095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:48.044095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:48.044095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:36:48.044095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:48.044898 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf04b4-7475-4f1c-8b8e-d27c91115fc6 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:48.044965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 211/445] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:36:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:48.047173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406dba1-5bcf-44b7-8f5c-d3b692c55fbc None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:48.155156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf04b4-7475-4f1c-8b8e-d27c91115fc6 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:48.166730 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406dba1-5bcf-44b7-8f5c-d3b692c55fbc None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:48.192591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d3445-c7a3-4c2b-9173-c34cc7923f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:48.193350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d3445-c7a3-4c2b-9173-c34cc7923f69 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:48.193639 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d3445-c7a3-4c2b-9173-c34cc7923f69 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:48.193919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d3445-c7a3-4c2b-9173-c34cc7923f69 None admin] PATH_INFO: `/v3/projects/8cacd9253675421d9d915794d90317e4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:48.195166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d3445-c7a3-4c2b-9173-c34cc7923f69 None admin] RBAC: Authorizing `identity:get_project(project_id=8cacd9253675421d9d915794d90317e4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:48.196659 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d3445-c7a3-4c2b-9173-c34cc7923f69 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:48.198406 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 235/446] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:48 2022] GET /identity/v3/projects/8cacd9253675421d9d915794d90317e4 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:48.199210 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d3445-c7a3-4c2b-9173-c34cc7923f69 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:48.205690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ae424-0aba-40b3-930e-b6a97c9508cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:48.206560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ae424-0aba-40b3-930e-b6a97c9508cc None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:48.206839 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ae424-0aba-40b3-930e-b6a97c9508cc None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:48.207115 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ae424-0aba-40b3-930e-b6a97c9508cc None admin] PATH_INFO: `/v3/groups/3ed32bd4cc714eca80f93e2298ef576f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:48.208324 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ae424-0aba-40b3-930e-b6a97c9508cc None admin] RBAC: Authorizing `identity:get_group(group_id=3ed32bd4cc714eca80f93e2298ef576f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:48.209830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ae424-0aba-40b3-930e-b6a97c9508cc None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:48.211459 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 212/447] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:48 2022] GET /identity/v3/groups/3ed32bd4cc714eca80f93e2298ef576f => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:36:48.212554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ae424-0aba-40b3-930e-b6a97c9508cc None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:48.219566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:48.253239 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:48.303132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d3445-c7a3-4c2b-9173-c34cc7923f69 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:48.310274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ae424-0aba-40b3-930e-b6a97c9508cc None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:48.338042 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0576d-34c1-41ba-a05d-4f7857b24c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:48.338711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0576d-34c1-41ba-a05d-4f7857b24c70 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:48.338995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0576d-34c1-41ba-a05d-4f7857b24c70 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:48.339270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0576d-34c1-41ba-a05d-4f7857b24c70 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:48.340034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0576d-34c1-41ba-a05d-4f7857b24c70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:48.340372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0576d-34c1-41ba-a05d-4f7857b24c70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:48.341777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0576d-34c1-41ba-a05d-4f7857b24c70 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:48.344596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493de0ed-7c0f-4504-aac7-ddfb624391ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:48.345456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493de0ed-7c0f-4504-aac7-ddfb624391ab None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:48.345743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493de0ed-7c0f-4504-aac7-ddfb624391ab None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:48.346020 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493de0ed-7c0f-4504-aac7-ddfb624391ab None admin] PATH_INFO: `/v3/groups/3ed32bd4cc714eca80f93e2298ef576f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:48.347322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493de0ed-7c0f-4504-aac7-ddfb624391ab None admin] RBAC: Authorizing `identity:get_group(group_id=3ed32bd4cc714eca80f93e2298ef576f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:48.348823 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493de0ed-7c0f-4504-aac7-ddfb624391ab None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:48.349928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 236/448] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:48.355368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 213/449] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:48 2022] GET /identity/v3/groups/3ed32bd4cc714eca80f93e2298ef576f => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:48.355498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0576d-34c1-41ba-a05d-4f7857b24c70 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:48.355586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493de0ed-7c0f-4504-aac7-ddfb624391ab None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:48.425778 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:48.451375 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0576d-34c1-41ba-a05d-4f7857b24c70 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:48.453812 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493de0ed-7c0f-4504-aac7-ddfb624391ab None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:48.462894 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:48.487200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d221358-d272-425c-9c0d-c1319fc5ff19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:48.487840 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d221358-d272-425c-9c0d-c1319fc5ff19 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:48.488140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d221358-d272-425c-9c0d-c1319fc5ff19 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:48.488445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d221358-d272-425c-9c0d-c1319fc5ff19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:48.489322 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d221358-d272-425c-9c0d-c1319fc5ff19 None admin] RBAC: Adding query filter params (group.id=3ed32bd4cc714eca80f93e2298ef576f, role.id=49eaa4df59ae423fa6913302fe982e4e, scope.project.id=21d24ab37b7c4dbaa4794944fac657c0) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:48.489628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d221358-d272-425c-9c0d-c1319fc5ff19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:48.490384 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99f23a-2316-45ba-b908-169346cda21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:48.491036 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99f23a-2316-45ba-b908-169346cda21a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:48.491122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d221358-d272-425c-9c0d-c1319fc5ff19 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:48.491321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99f23a-2316-45ba-b908-169346cda21a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:48.491600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99f23a-2316-45ba-b908-169346cda21a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:48.496954 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 237/450] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Jul 11 15:36:48 2022] GET /identity/v3/role_assignments?group.id=3ed32bd4cc714eca80f93e2298ef576f&scope.project.id=21d24ab37b7c4dbaa4794944fac657c0&role.id=49eaa4df59ae423fa6913302fe982e4e => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:48.497744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d221358-d272-425c-9c0d-c1319fc5ff19 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:48.571729 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99f23a-2316-45ba-b908-169346cda21a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:48.573239 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99f23a-2316-45ba-b908-169346cda21a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:48.614968 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d221358-d272-425c-9c0d-c1319fc5ff19 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:48.653396 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ce6d3-f0f3-4a09-a0f8-d5caf912a2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:48.654775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ce6d3-f0f3-4a09-a0f8-d5caf912a2f1 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:48.654775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ce6d3-f0f3-4a09-a0f8-d5caf912a2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:48.654775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ce6d3-f0f3-4a09-a0f8-d5caf912a2f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:48.655495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ce6d3-f0f3-4a09-a0f8-d5caf912a2f1 None admin] RBAC: Adding query filter params (group.id=3ed32bd4cc714eca80f93e2298ef576f, role.id=49eaa4df59ae423fa6913302fe982e4e, scope.project.id=8cacd9253675421d9d915794d90317e4) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:48.655802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ce6d3-f0f3-4a09-a0f8-d5caf912a2f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:48.657366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ce6d3-f0f3-4a09-a0f8-d5caf912a2f1 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:48.663764 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 238/451] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Jul 11 15:36:48 2022] GET /identity/v3/role_assignments?group.id=3ed32bd4cc714eca80f93e2298ef576f&scope.project.id=8cacd9253675421d9d915794d90317e4&role.id=49eaa4df59ae423fa6913302fe982e4e => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:48.688985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 214/452] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 15:36:48.694999 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ce6d3-f0f3-4a09-a0f8-d5caf912a2f1 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:48.698341 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:48.803054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ce6d3-f0f3-4a09-a0f8-d5caf912a2f1 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:48.838891 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687b93d-6a7f-4b1b-b607-5322c13224ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:48.839759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687b93d-6a7f-4b1b-b607-5322c13224ad None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:48.840036 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687b93d-6a7f-4b1b-b607-5322c13224ad None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:48.840333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687b93d-6a7f-4b1b-b607-5322c13224ad None admin] PATH_INFO: `/v3/projects/ea74c7f2a67041fea527ddf55a3384ec` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:48.841560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687b93d-6a7f-4b1b-b607-5322c13224ad None admin] RBAC: Authorizing `identity:get_project(project_id=ea74c7f2a67041fea527ddf55a3384ec)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:48.843027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687b93d-6a7f-4b1b-b607-5322c13224ad None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:48.844869 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 239/453] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:36:48 2022] GET /identity/v3/projects/ea74c7f2a67041fea527ddf55a3384ec => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:48.851830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99f23a-2316-45ba-b908-169346cda21a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:48.863087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:48.959502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99f23a-2316-45ba-b908-169346cda21a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:48.993138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea7910-ec77-4ca2-bedc-2ebbbbd1305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:48.994005 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7910-ec77-4ca2-bedc-2ebbbbd1305c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:48.994284 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7910-ec77-4ca2-bedc-2ebbbbd1305c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:48.994557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7910-ec77-4ca2-bedc-2ebbbbd1305c None admin] PATH_INFO: `/v3/groups/9cb606f54bb7441194fef650ec739273` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:48.995741 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea7910-ec77-4ca2-bedc-2ebbbbd1305c None admin] RBAC: Authorizing `identity:get_group(group_id=9cb606f54bb7441194fef650ec739273)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:48.997251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea7910-ec77-4ca2-bedc-2ebbbbd1305c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:48.998876 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 215/454] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Jul 11 15:36:48 2022] GET /identity/v3/groups/9cb606f54bb7441194fef650ec739273 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:49.004901 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687b93d-6a7f-4b1b-b607-5322c13224ad None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:49.078187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:49.114716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687b93d-6a7f-4b1b-b607-5322c13224ad None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:49.148666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501b735-a1af-4087-954e-b5b4b803bb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:49.149315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501b735-a1af-4087-954e-b5b4b803bb12 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:49.149602 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501b735-a1af-4087-954e-b5b4b803bb12 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:49.149882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501b735-a1af-4087-954e-b5b4b803bb12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:49.150727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501b735-a1af-4087-954e-b5b4b803bb12 None admin] RBAC: Adding query filter params (group.id=9cb606f54bb7441194fef650ec739273, role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=ea74c7f2a67041fea527ddf55a3384ec) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:49.151038 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501b735-a1af-4087-954e-b5b4b803bb12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:49.152519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501b735-a1af-4087-954e-b5b4b803bb12 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:49.158916 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 240/455] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Jul 11 15:36:49 2022] GET /identity/v3/role_assignments?group.id=9cb606f54bb7441194fef650ec739273&scope.project.id=ea74c7f2a67041fea527ddf55a3384ec&role.id=32f5ce5800cf40d99d894960288d0155 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:51.653545 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9cfc4-5235-4a84-9c88-ce1d4dda39ac None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:51.654556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9cfc4-5235-4a84-9c88-ce1d4dda39ac None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:51.655030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9cfc4-5235-4a84-9c88-ce1d4dda39ac None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:51.657026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 216/456] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:51.662805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8408ff0-0ed2-4483-ab2d-d2bd1ba16ca6 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:51.663698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8408ff0-0ed2-4483-ab2d-d2bd1ba16ca6 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:51.664172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8408ff0-0ed2-4483-ab2d-d2bd1ba16ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:51.693312 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-d8408ff0-0ed2-4483-ab2d-d2bd1ba16ca6 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:51.694858 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d8408ff0-0ed2-4483-ab2d-d2bd1ba16ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:51.695325 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad8208-b052-475f-b42c-1f100a160ad2 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:51.695873 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad8208-b052-475f-b42c-1f100a160ad2 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:51.696377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad8208-b052-475f-b42c-1f100a160ad2 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:51.698237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 217/457] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:51.703004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943326b5-7f62-47b9-bb20-20c40e02b9ee None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:51.703549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943326b5-7f62-47b9-bb20-20c40e02b9ee None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:51.704038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943326b5-7f62-47b9-bb20-20c40e02b9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:51.735326 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-943326b5-7f62-47b9-bb20-20c40e02b9ee None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:51.738156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-943326b5-7f62-47b9-bb20-20c40e02b9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:51.797178 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 241/458] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:51.799745 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dff8d-5412-469f-85b4-a6141c367ece None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:51.800770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dff8d-5412-469f-85b4-a6141c367ece None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:51.801711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dff8d-5412-469f-85b4-a6141c367ece None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:51.805599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 242/459] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:51.817829 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aec12-49bf-4e5d-8ce1-2fd3960c706f None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:51.818388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aec12-49bf-4e5d-8ce1-2fd3960c706f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:51.818888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aec12-49bf-4e5d-8ce1-2fd3960c706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:51.838683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-543aec12-49bf-4e5d-8ce1-2fd3960c706f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:51.840206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-543aec12-49bf-4e5d-8ce1-2fd3960c706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:51.862033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 218/460] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:51.863200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943326b5-7f62-47b9-bb20-20c40e02b9ee None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:51.884903 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:51.917156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:51.929276 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 243/461] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:51.930540 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aec12-49bf-4e5d-8ce1-2fd3960c706f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:51.996557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943326b5-7f62-47b9-bb20-20c40e02b9ee None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:52.037024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b822a6d-19e8-4e18-90fc-9f9a14181335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:52.038774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b822a6d-19e8-4e18-90fc-9f9a14181335 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:52.039383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b822a6d-19e8-4e18-90fc-9f9a14181335 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:52.040817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b822a6d-19e8-4e18-90fc-9f9a14181335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:52.048048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aec12-49bf-4e5d-8ce1-2fd3960c706f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:52.053707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b822a6d-19e8-4e18-90fc-9f9a14181335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:52.055384 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b822a6d-19e8-4e18-90fc-9f9a14181335 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-5b822a6d-19e8-4e18-90fc-9f9a14181335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:36:52.076305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:52.077274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:52.078448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:36:52.078448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:36:52.078448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:52.078448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:52.078448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 219/462] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:52.080956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b822a6d-19e8-4e18-90fc-9f9a14181335 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:52.098691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb1602-f950-4b44-8c24-8ba58ad2f25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:52.099780 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb1602-f950-4b44-8c24-8ba58ad2f25a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:52.100241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb1602-f950-4b44-8c24-8ba58ad2f25a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:52.100720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb1602-f950-4b44-8c24-8ba58ad2f25a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:52.113354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb1602-f950-4b44-8c24-8ba58ad2f25a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:52.115184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb1602-f950-4b44-8c24-8ba58ad2f25a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-4ddb1602-f950-4b44-8c24-8ba58ad2f25a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:36:52.134539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:52.135493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:52.136373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:36:52.136373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:36:52.136373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:52.136373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:52.138968 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 244/463] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:52.140360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb1602-f950-4b44-8c24-8ba58ad2f25a None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:52.164770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:52.202698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:52.222562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b822a6d-19e8-4e18-90fc-9f9a14181335 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:52.267505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c9543-3c96-4152-9a50-dd413c8cb393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:52.268884 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c9543-3c96-4152-9a50-dd413c8cb393 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:52.269365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c9543-3c96-4152-9a50-dd413c8cb393 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:52.269830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c9543-3c96-4152-9a50-dd413c8cb393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:52.270667 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb1602-f950-4b44-8c24-8ba58ad2f25a None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:52.281606 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c9543-3c96-4152-9a50-dd413c8cb393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:52.283456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c9543-3c96-4152-9a50-dd413c8cb393 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-da8c9543-3c96-4152-9a50-dd413c8cb393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:36:52.303054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:52.303944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:52.304819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:36:52.304819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:36:52.304819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:52.304819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:52.307078 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 220/464] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:52.308223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c9543-3c96-4152-9a50-dd413c8cb393 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:52.312745 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb41e2-48b7-469f-bf7b-f33569d53747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:52.314365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb41e2-48b7-469f-bf7b-f33569d53747 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:52.314652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb41e2-48b7-469f-bf7b-f33569d53747 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:52.314928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb41e2-48b7-469f-bf7b-f33569d53747 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:52.315679 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb41e2-48b7-469f-bf7b-f33569d53747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:52.315989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb41e2-48b7-469f-bf7b-f33569d53747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:52.317432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb41e2-48b7-469f-bf7b-f33569d53747 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:52.336438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 245/465] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:52.339034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb41e2-48b7-469f-bf7b-f33569d53747 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:52.417996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c9543-3c96-4152-9a50-dd413c8cb393 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:52.428483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:52.450450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb41e2-48b7-469f-bf7b-f33569d53747 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:52.453847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2488e44-814a-4ff2-8aa6-52b834017e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:52.454516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2488e44-814a-4ff2-8aa6-52b834017e28 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:52.454798 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2488e44-814a-4ff2-8aa6-52b834017e28 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:52.455067 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2488e44-814a-4ff2-8aa6-52b834017e28 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:52.455784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2488e44-814a-4ff2-8aa6-52b834017e28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:52.456086 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2488e44-814a-4ff2-8aa6-52b834017e28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:52.457508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2488e44-814a-4ff2-8aa6-52b834017e28 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:52.458521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:52.475653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 221/466] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:52.475653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2488e44-814a-4ff2-8aa6-52b834017e28 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:52.485726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a547a46-28a2-4665-84ef-97d3635db0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:52.486497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a547a46-28a2-4665-84ef-97d3635db0f8 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:52.486829 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a547a46-28a2-4665-84ef-97d3635db0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:52.487170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a547a46-28a2-4665-84ef-97d3635db0f8 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:52.488004 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a547a46-28a2-4665-84ef-97d3635db0f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:52.488395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a547a46-28a2-4665-84ef-97d3635db0f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:52.489849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a547a46-28a2-4665-84ef-97d3635db0f8 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:52.502133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 246/467] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:52.503501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db2e5-8865-496d-8de2-5cfcefd7fe5e None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:52.503859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db2e5-8865-496d-8de2-5cfcefd7fe5e None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:52.504206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db2e5-8865-496d-8de2-5cfcefd7fe5e None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:52.508386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 247/468] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:52.508386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363db2e5-8865-496d-8de2-5cfcefd7fe5e None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:52.593424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2488e44-814a-4ff2-8aa6-52b834017e28 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:52.627811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363db2e5-8865-496d-8de2-5cfcefd7fe5e None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:52.629719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cd044-b299-4a8b-99e8-9ef3989af309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:52.630398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cd044-b299-4a8b-99e8-9ef3989af309 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:52.630678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cd044-b299-4a8b-99e8-9ef3989af309 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:52.630973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cd044-b299-4a8b-99e8-9ef3989af309 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:52.631683 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cd044-b299-4a8b-99e8-9ef3989af309 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:52.633183 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cd044-b299-4a8b-99e8-9ef3989af309 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:52.656644 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 222/469] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:36:52 2022] POST /identity/v3/users => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:52.658224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cd044-b299-4a8b-99e8-9ef3989af309 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:52.675499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7a908-12aa-42a0-891f-7a974d43a4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:52.676247 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7a908-12aa-42a0-891f-7a974d43a4ce None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:52.676570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7a908-12aa-42a0-891f-7a974d43a4ce None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:52.676846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7a908-12aa-42a0-891f-7a974d43a4ce None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:52.677825 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7a908-12aa-42a0-891f-7a974d43a4ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:52.680183 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7a908-12aa-42a0-891f-7a974d43a4ce None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:52.694385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:52.712481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 248/470] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:36:52 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:52.712481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35742db2-5d8a-4241-9b7d-ca249b5447d4 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:52.712481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35742db2-5d8a-4241-9b7d-ca249b5447d4 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:52.712481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35742db2-5d8a-4241-9b7d-ca249b5447d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:52.750359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-35742db2-5d8a-4241-9b7d-ca249b5447d4 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:52.751949 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-35742db2-5d8a-4241-9b7d-ca249b5447d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:52.796791 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:52.833535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cd044-b299-4a8b-99e8-9ef3989af309 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:52.885946 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b8641-b020-4543-8bc4-22614bd89342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:52.886636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b8641-b020-4543-8bc4-22614bd89342 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:52.886919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b8641-b020-4543-8bc4-22614bd89342 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:52.887193 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b8641-b020-4543-8bc4-22614bd89342 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:52.887913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b8641-b020-4543-8bc4-22614bd89342 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:52.890923 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b8641-b020-4543-8bc4-22614bd89342 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:52.893813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 249/471] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:52.917681 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 223/472] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:36:52 2022] POST /identity/v3/users => generated 248 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:52.922643 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35742db2-5d8a-4241-9b7d-ca249b5447d4 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:53.039996 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35742db2-5d8a-4241-9b7d-ca249b5447d4 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:53.078931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aa222-fb76-4db6-8b31-4cd6b9605c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:53.079996 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aa222-fb76-4db6-8b31-4cd6b9605c7b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:53.080464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aa222-fb76-4db6-8b31-4cd6b9605c7b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:53.080879 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0aa222-fb76-4db6-8b31-4cd6b9605c7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:53.093093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0aa222-fb76-4db6-8b31-4cd6b9605c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:53.094838 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0aa222-fb76-4db6-8b31-4cd6b9605c7b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:53.110564 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2814f-d986-430c-ba55-b8e9f6d93be5 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:53.111081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2814f-d986-430c-ba55-b8e9f6d93be5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:53.111504 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2814f-d986-430c-ba55-b8e9f6d93be5 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:53.113062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 224/473] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:36:53.118612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b40e9-ad75-4c79-a7a6-83a2dcc4db35 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-6b0aa222-fb76-4db6-8b31-4cd6b9605c7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:36:53.118751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:53.119714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:53.120812 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:36:53.120812 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:36:53.120812 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:53.120812 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:53.121068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b40e9-ad75-4c79-a7a6-83a2dcc4db35 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:53.121443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b40e9-ad75-4c79-a7a6-83a2dcc4db35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:53.122859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 250/474] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:53.128577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aa222-fb76-4db6-8b31-4cd6b9605c7b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:53.132700 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:53.141434 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e10b40e9-ad75-4c79-a7a6-83a2dcc4db35 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:53.142647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e10b40e9-ad75-4c79-a7a6-83a2dcc4db35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:53.234656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 225/475] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:53.251822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0aa222-fb76-4db6-8b31-4cd6b9605c7b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:53.259416 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b40e9-ad75-4c79-a7a6-83a2dcc4db35 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:53.287201 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f57765-8827-49a0-8cd6-2f01176c6d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:53.288021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f57765-8827-49a0-8cd6-2f01176c6d6c None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:53.288435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f57765-8827-49a0-8cd6-2f01176c6d6c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:53.288828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f57765-8827-49a0-8cd6-2f01176c6d6c None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:53.289662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f57765-8827-49a0-8cd6-2f01176c6d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:53.290113 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:53.290227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f57765-8827-49a0-8cd6-2f01176c6d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:53.291633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f57765-8827-49a0-8cd6-2f01176c6d6c None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:53.305094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 251/476] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:53.310232 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f57765-8827-49a0-8cd6-2f01176c6d6c None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:53.424699 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:53.451646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b40e9-ad75-4c79-a7a6-83a2dcc4db35 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:53.484003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f57765-8827-49a0-8cd6-2f01176c6d6c None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:53.520779 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfd5ca-bc1a-481c-9360-2db77e947014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:53.521660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfd5ca-bc1a-481c-9360-2db77e947014 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:53.521940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfd5ca-bc1a-481c-9360-2db77e947014 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:53.522209 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfd5ca-bc1a-481c-9360-2db77e947014 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:53.522960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfd5ca-bc1a-481c-9360-2db77e947014 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:53.524397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfd5ca-bc1a-481c-9360-2db77e947014 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:53.533526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.sql.core [None req-dbdfd5ca-bc1a-481c-9360-2db77e947014 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 15:36:53.533526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 15:36:53.533526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [parameters: {'id': '38c5f5e4e9f8451ab90b2739fcac23ab', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 15:36:53.533526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86734) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-dbdfd5ca-bc1a-481c-9360-2db77e947014 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application result.read() Jul 11 15:36:53.551735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return ref.to_dict() Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:36:53.552754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application yield resource Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise self.value Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application session.commit() Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 15:36:53.553676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self.session.flush() Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application compat.raise_( Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 15:36:53.554515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:36:53.555406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application result.read() Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:36:53.556208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [parameters: {'id': '38c5f5e4e9f8451ab90b2739fcac23ab', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:53.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 15:36:53.560997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:53.568532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 226/477] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Jul 11 15:36:53 2022] POST /identity/v3/roles => generated 144 bytes in 294 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:36:53.568705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558561cd-91e6-49ce-b3d5-5b5705b5759b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:53.568705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558561cd-91e6-49ce-b3d5-5b5705b5759b None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:53.568705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558561cd-91e6-49ce-b3d5-5b5705b5759b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:53.568705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558561cd-91e6-49ce-b3d5-5b5705b5759b None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:53.569267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558561cd-91e6-49ce-b3d5-5b5705b5759b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:53.569267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558561cd-91e6-49ce-b3d5-5b5705b5759b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:53.569533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfd5ca-bc1a-481c-9360-2db77e947014 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:53.604579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 252/478] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:36:53 2022] POST /identity/v3/users => generated 249 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:53.666812 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:53.699043 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfd5ca-bc1a-481c-9360-2db77e947014 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:53.743259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35489494-ae08-4e99-86cd-7261c810f5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:53.744083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35489494-ae08-4e99-86cd-7261c810f5de None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:53.744387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35489494-ae08-4e99-86cd-7261c810f5de None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:53.744660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35489494-ae08-4e99-86cd-7261c810f5de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:53.756241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35489494-ae08-4e99-86cd-7261c810f5de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-35489494-ae08-4e99-86cd-7261c810f5de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:53.764443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:53.765412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:53.766211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:53.766211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:53.766211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:53.766211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:53.766211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:53.766211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:53.766211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:53.766211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:53.766211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:53.766211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:53.766211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 15:36:53.766211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:53.766816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 227/479] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:36:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:53.772153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558561cd-91e6-49ce-b3d5-5b5705b5759b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:53.908459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558561cd-91e6-49ce-b3d5-5b5705b5759b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:53.936052 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:53.953918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b80b9-5edc-495c-91b3-241d6ee191f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:53.954618 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b80b9-5edc-495c-91b3-241d6ee191f6 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:53.954884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b80b9-5edc-495c-91b3-241d6ee191f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:53.955156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b80b9-5edc-495c-91b3-241d6ee191f6 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:53.955922 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b80b9-5edc-495c-91b3-241d6ee191f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:53.956229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b80b9-5edc-495c-91b3-241d6ee191f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:53.957647 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b80b9-5edc-495c-91b3-241d6ee191f6 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:53.966546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 253/480] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:55.082452 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52235d21-98fd-494d-8054-f2184719a553 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:55.083159 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52235d21-98fd-494d-8054-f2184719a553 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:55.083159 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52235d21-98fd-494d-8054-f2184719a553 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:55.084675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 228/481] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:55.089869 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d4194-6575-47aa-93fa-cc3a6a4401ee None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:55.090368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d4194-6575-47aa-93fa-cc3a6a4401ee None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:55.090522 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d4194-6575-47aa-93fa-cc3a6a4401ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:55.117636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-a07d4194-6575-47aa-93fa-cc3a6a4401ee None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:55.118831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a07d4194-6575-47aa-93fa-cc3a6a4401ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:55.212959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 254/482] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 11 15:36:55.244328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52235d21-98fd-494d-8054-f2184719a553 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:55.413642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52235d21-98fd-494d-8054-f2184719a553 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:55.449604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ce8b4-ab91-4a52-b9c4-83d04150a028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:55.450787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ce8b4-ab91-4a52-b9c4-83d04150a028 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:55.451285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ce8b4-ab91-4a52-b9c4-83d04150a028 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:55.451754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ce8b4-ab91-4a52-b9c4-83d04150a028 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:55.455095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:55.465772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ce8b4-ab91-4a52-b9c4-83d04150a028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-0a8ce8b4-ab91-4a52-b9c4-83d04150a028 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:55.474686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:55.475682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:55.476515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:55.476515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:55.476515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:55.476515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:55.476515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:55.476515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:55.476515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:55.476515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:55.476515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:55.476515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:55.476515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:36:55.476515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:55.477613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0921997-141d-47cb-bb63-547bdae25db9 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:55.477613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0921997-141d-47cb-bb63-547bdae25db9 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:55.477859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0921997-141d-47cb-bb63-547bdae25db9 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:55.479520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 255/484] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:55.479724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 229/484] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:36:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:55.488333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa466-a10c-4ef5-9914-1c19bf6f9e0d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:55.488333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa466-a10c-4ef5-9914-1c19bf6f9e0d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:55.488333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa466-a10c-4ef5-9914-1c19bf6f9e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:55.488599 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ce8b4-ab91-4a52-b9c4-83d04150a028 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:55.512749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-9faaa466-a10c-4ef5-9914-1c19bf6f9e0d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:55.514065 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9faaa466-a10c-4ef5-9914-1c19bf6f9e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:55.604314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 256/485] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:36:55.604314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c4425-5fb6-45b6-a670-910ed580f8ca None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:55.604314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c4425-5fb6-45b6-a670-910ed580f8ca None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:55.604314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c4425-5fb6-45b6-a670-910ed580f8ca None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:55.608844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 257/486] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:55.611534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba0937-f33f-4cf5-97b6-c9b1822f29e3 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:55.611820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba0937-f33f-4cf5-97b6-c9b1822f29e3 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:55.612100 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba0937-f33f-4cf5-97b6-c9b1822f29e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:55.630457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-ffba0937-f33f-4cf5-97b6-c9b1822f29e3 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:55.631022 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ce8b4-ab91-4a52-b9c4-83d04150a028 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:55.631705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ffba0937-f33f-4cf5-97b6-c9b1822f29e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:55.672116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:55.676356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986435aa-60f4-4667-aaaa-9204a99a7f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:55.677474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986435aa-60f4-4667-aaaa-9204a99a7f4e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:55.677975 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986435aa-60f4-4667-aaaa-9204a99a7f4e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:55.678438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986435aa-60f4-4667-aaaa-9204a99a7f4e None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:55.680609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986435aa-60f4-4667-aaaa-9204a99a7f4e None admin] RBAC: Adding query filter params (name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:55.681134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986435aa-60f4-4667-aaaa-9204a99a7f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:55.683559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986435aa-60f4-4667-aaaa-9204a99a7f4e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:55.695118 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 230/487] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:36:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:55.696518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986435aa-60f4-4667-aaaa-9204a99a7f4e None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:55.717452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 258/488] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:55.718361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba0937-f33f-4cf5-97b6-c9b1822f29e3 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:55.768666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:55.820707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986435aa-60f4-4667-aaaa-9204a99a7f4e None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:55.842144 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba0937-f33f-4cf5-97b6-c9b1822f29e3 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:55.857748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffefd0-56ba-44f7-853f-4ff1ff1c84c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:55.858960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffefd0-56ba-44f7-853f-4ff1ff1c84c7 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:55.859438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffefd0-56ba-44f7-853f-4ff1ff1c84c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:55.859899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffefd0-56ba-44f7-853f-4ff1ff1c84c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:55.873322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffefd0-56ba-44f7-853f-4ff1ff1c84c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:55.879081 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ebcb8-400c-40a5-82e6-d49bfb4577bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:55.879891 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ebcb8-400c-40a5-82e6-d49bfb4577bb None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:55.880174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ebcb8-400c-40a5-82e6-d49bfb4577bb None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:55.880479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ebcb8-400c-40a5-82e6-d49bfb4577bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-c2ffefd0-56ba-44f7-853f-4ff1ff1c84c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:55.884621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:55.885502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:55.886294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:55.886294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:55.886294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:55.886294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:55.886294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:55.886294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:55.886294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:55.886294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:55.886294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:55.886294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:55.886294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:36:55.886294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:55.893672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ebcb8-400c-40a5-82e6-d49bfb4577bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:55.893672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ebcb8-400c-40a5-82e6-d49bfb4577bb None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:55.894027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 231/489] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:36:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:55.895219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffefd0-56ba-44f7-853f-4ff1ff1c84c7 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-527ebcb8-400c-40a5-82e6-d49bfb4577bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:36:55.912483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:55.913438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:55.914286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:36:55.914286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:36:55.914286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:55.914286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:55.914286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 259/490] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:55.915189 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ebcb8-400c-40a5-82e6-d49bfb4577bb None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:55.945716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:56.009033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffefd0-56ba-44f7-853f-4ff1ff1c84c7 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:56.027249 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ebcb8-400c-40a5-82e6-d49bfb4577bb None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:56.028126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:56.047045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9246f2-f791-4ed9-8330-0c8c04bd4381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:56.048261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9246f2-f791-4ed9-8330-0c8c04bd4381 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.048812 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9246f2-f791-4ed9-8330-0c8c04bd4381 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.049287 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9246f2-f791-4ed9-8330-0c8c04bd4381 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.060633 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9246f2-f791-4ed9-8330-0c8c04bd4381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:56.068027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05c68c-2223-4b54-9388-0b27dcf537f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:56.068751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c68c-2223-4b54-9388-0b27dcf537f4 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.069036 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c68c-2223-4b54-9388-0b27dcf537f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.069311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c68c-2223-4b54-9388-0b27dcf537f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.070080 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05c68c-2223-4b54-9388-0b27dcf537f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:56.070389 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05c68c-2223-4b54-9388-0b27dcf537f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-ec9246f2-f791-4ed9-8330-0c8c04bd4381 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:56.070669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:56.071529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:56.072321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:56.072321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:56.072321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:56.072321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:56.072321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:56.072321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:56.072321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:56.072321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:56.072321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:56.072321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:56.072321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:36:56.072321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:56.072930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05c68c-2223-4b54-9388-0b27dcf537f4 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:56.075062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 232/491] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:36:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:56.076040 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9246f2-f791-4ed9-8330-0c8c04bd4381 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:56.090738 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 260/492] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:36:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:56.090738 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05c68c-2223-4b54-9388-0b27dcf537f4 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:56.177749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:56.196448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05c68c-2223-4b54-9388-0b27dcf537f4 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:56.212997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9246f2-f791-4ed9-8330-0c8c04bd4381 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:56.234179 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c5f14-cd59-4881-96ff-90efec716697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:56.235184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c5f14-cd59-4881-96ff-90efec716697 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.235626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c5f14-cd59-4881-96ff-90efec716697 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.236065 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c5f14-cd59-4881-96ff-90efec716697 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.237088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c5f14-cd59-4881-96ff-90efec716697 None admin] RBAC: Adding query filter params (name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:56.237533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c5f14-cd59-4881-96ff-90efec716697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:56.239051 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c5f14-cd59-4881-96ff-90efec716697 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:56.252399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 261/493] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:36:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:56.253626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c5f14-cd59-4881-96ff-90efec716697 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:56.259859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd78eb9-3b19-4835-a8bb-b2289eb09fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:56.260572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd78eb9-3b19-4835-a8bb-b2289eb09fcc None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.261032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd78eb9-3b19-4835-a8bb-b2289eb09fcc None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.261409 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd78eb9-3b19-4835-a8bb-b2289eb09fcc None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.262254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd78eb9-3b19-4835-a8bb-b2289eb09fcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:56.262661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd78eb9-3b19-4835-a8bb-b2289eb09fcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:56.264154 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd78eb9-3b19-4835-a8bb-b2289eb09fcc None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:56.277000 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 233/494] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:56.278059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd78eb9-3b19-4835-a8bb-b2289eb09fcc None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:56.324821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:56.368946 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c5f14-cd59-4881-96ff-90efec716697 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:56.388698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd78eb9-3b19-4835-a8bb-b2289eb09fcc None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:56.403584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33767a-064d-4a74-aa7d-2bd42fa37d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:56.404412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33767a-064d-4a74-aa7d-2bd42fa37d20 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.404694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33767a-064d-4a74-aa7d-2bd42fa37d20 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.404963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33767a-064d-4a74-aa7d-2bd42fa37d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.416063 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33767a-064d-4a74-aa7d-2bd42fa37d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:56.417710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33767a-064d-4a74-aa7d-2bd42fa37d20 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:56.423690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ffeed-4838-4891-813d-ac95e0162eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:56.424916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ffeed-4838-4891-813d-ac95e0162eae None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.425208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ffeed-4838-4891-813d-ac95e0162eae None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.425479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ffeed-4838-4891-813d-ac95e0162eae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.426320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:56.435820 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ffeed-4838-4891-813d-ac95e0162eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:56.437354 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ffeed-4838-4891-813d-ac95e0162eae None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-9c33767a-064d-4a74-aa7d-2bd42fa37d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:36:56.438305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:56.439283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:56.440361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:36:56.440361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:36:56.440361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:56.440361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:56.442314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 262/495] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:56.443291 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33767a-064d-4a74-aa7d-2bd42fa37d20 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-7a7ffeed-4838-4891-813d-ac95e0162eae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:36:56.459885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:56.460959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:56.466675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:36:56.466675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:36:56.466675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:56.466675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:56.466675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 234/496] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:56.466675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdec4b-43a0-447e-a4bf-cd54e0282ea5 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.466675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdec4b-43a0-447e-a4bf-cd54e0282ea5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.466675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdec4b-43a0-447e-a4bf-cd54e0282ea5 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.466675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 235/497] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:56.467885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdec4b-43a0-447e-a4bf-cd54e0282ea5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:56.554628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33767a-064d-4a74-aa7d-2bd42fa37d20 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:56.562261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:56.573333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdec4b-43a0-447e-a4bf-cd54e0282ea5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:56.588281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb760a22-1c46-448a-aa3d-5c42ca6484ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:56.589138 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb760a22-1c46-448a-aa3d-5c42ca6484ab None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.589538 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb760a22-1c46-448a-aa3d-5c42ca6484ab None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.589656 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb760a22-1c46-448a-aa3d-5c42ca6484ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.601274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb760a22-1c46-448a-aa3d-5c42ca6484ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:56.602754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb760a22-1c46-448a-aa3d-5c42ca6484ab None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:56.607710 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c706bd-b6c5-4056-b69a-a381e48a7af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:56.608539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c706bd-b6c5-4056-b69a-a381e48a7af7 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.608934 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c706bd-b6c5-4056-b69a-a381e48a7af7 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.609204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c706bd-b6c5-4056-b69a-a381e48a7af7 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.609919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c706bd-b6c5-4056-b69a-a381e48a7af7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:56.610223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c706bd-b6c5-4056-b69a-a381e48a7af7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:56.611584 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c706bd-b6c5-4056-b69a-a381e48a7af7 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-cb760a22-1c46-448a-aa3d-5c42ca6484ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:36:56.618749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:56.619785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:56.620710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:56.620710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:56.620710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:36:56.620710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:36:56.620710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:36:56.620710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:36:56.620710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:36:56.620710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:36:56.620710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:36:56.620710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:56.620710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 263/498] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Jul 11 15:36:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:56.620710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb760a22-1c46-448a-aa3d-5c42ca6484ab None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:56.627023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 236/499] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:56.628133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237331a-c4ae-40b0-85ac-04e91617956d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.628413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237331a-c4ae-40b0-85ac-04e91617956d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.628722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237331a-c4ae-40b0-85ac-04e91617956d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.645814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-c237331a-c4ae-40b0-85ac-04e91617956d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:56.647065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-c237331a-c4ae-40b0-85ac-04e91617956d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:56.680181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:56.714335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 237/500] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:56.715814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637d2c-441d-4f74-aecf-99a384af3e5c None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.716330 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637d2c-441d-4f74-aecf-99a384af3e5c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.716455 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637d2c-441d-4f74-aecf-99a384af3e5c None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.717850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 238/501] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:36:56.718501 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49637d2c-441d-4f74-aecf-99a384af3e5c None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:56.722229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb760a22-1c46-448a-aa3d-5c42ca6484ab None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:56.756367 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4ac1c-fe15-487e-8371-1cdb044235e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:56.757017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4ac1c-fe15-487e-8371-1cdb044235e2 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.757296 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4ac1c-fe15-487e-8371-1cdb044235e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.757570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4ac1c-fe15-487e-8371-1cdb044235e2 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.758298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4ac1c-fe15-487e-8371-1cdb044235e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:56.758601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4ac1c-fe15-487e-8371-1cdb044235e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:56.760000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4ac1c-fe15-487e-8371-1cdb044235e2 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:56.771421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 264/502] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:56.772200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4ac1c-fe15-487e-8371-1cdb044235e2 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:56.809132 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:56.828939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49637d2c-441d-4f74-aecf-99a384af3e5c None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:56.871124 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4ac1c-fe15-487e-8371-1cdb044235e2 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:56.875183 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef595d-0415-46f5-9d2a-d2ab464e3823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:56.875876 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef595d-0415-46f5-9d2a-d2ab464e3823 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.876160 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef595d-0415-46f5-9d2a-d2ab464e3823 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.876464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef595d-0415-46f5-9d2a-d2ab464e3823 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.877328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef595d-0415-46f5-9d2a-d2ab464e3823 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:56.877637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef595d-0415-46f5-9d2a-d2ab464e3823 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:56.879346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef595d-0415-46f5-9d2a-d2ab464e3823 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:56.892278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:56.908916 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9139b98-e827-4410-8bb1-23a045b886c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:56.909711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9139b98-e827-4410-8bb1-23a045b886c9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.909995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9139b98-e827-4410-8bb1-23a045b886c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.910267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9139b98-e827-4410-8bb1-23a045b886c9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.919793 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 239/503] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Jul 11 15:36:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:56.920759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9139b98-e827-4410-8bb1-23a045b886c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:56.920847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb41bfc-f784-438a-b4f0-d285f7be6ebb None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:56.920847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb41bfc-f784-438a-b4f0-d285f7be6ebb None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:56.920847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb41bfc-f784-438a-b4f0-d285f7be6ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:56.921584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9139b98-e827-4410-8bb1-23a045b886c9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-a9139b98-e827-4410-8bb1-23a045b886c9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:36:56.937006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:56.938245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:56.944689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:56.944689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:56.944689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:36:56.944689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:36:56.944689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:36:56.944689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:36:56.944689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:36:56.944689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:36:56.944689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:36:56.944689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:56.945329 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-7cb41bfc-f784-438a-b4f0-d285f7be6ebb None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:36:56.945413 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 265/504] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:56.945500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7cb41bfc-f784-438a-b4f0-d285f7be6ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:36:56.945594 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9139b98-e827-4410-8bb1-23a045b886c9 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:57.013192 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 240/505] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:36:57.013933 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb41bfc-f784-438a-b4f0-d285f7be6ebb None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:57.039484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9139b98-e827-4410-8bb1-23a045b886c9 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:57.075568 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046aaca-a819-4781-a17c-cd96d20b8243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:57.076487 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046aaca-a819-4781-a17c-cd96d20b8243 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:57.076772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046aaca-a819-4781-a17c-cd96d20b8243 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:57.077111 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046aaca-a819-4781-a17c-cd96d20b8243 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:57.078591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:57.088195 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046aaca-a819-4781-a17c-cd96d20b8243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-2046aaca-a819-4781-a17c-cd96d20b8243 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:36:57.095774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:57.097161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:57.097988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:57.097988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:57.097988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:57.097988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:57.097988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:36:57.097988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:36:57.097988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:36:57.097988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:36:57.097988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:36:57.097988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:36:57.097988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:36:57.097988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:57.097988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 266/506] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:36:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:57.097988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046aaca-a819-4781-a17c-cd96d20b8243 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:57.118990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb41bfc-f784-438a-b4f0-d285f7be6ebb None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:57.139804 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:57.155478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600911fb-98d6-4d1a-8aa8-47f11507be86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:57.156320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600911fb-98d6-4d1a-8aa8-47f11507be86 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:57.156607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600911fb-98d6-4d1a-8aa8-47f11507be86 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:57.156879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600911fb-98d6-4d1a-8aa8-47f11507be86 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:57.164333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600911fb-98d6-4d1a-8aa8-47f11507be86 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:57.165799 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600911fb-98d6-4d1a-8aa8-47f11507be86 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-600911fb-98d6-4d1a-8aa8-47f11507be86 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:36:57.181533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:57.182474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:57.183376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:57.183376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:57.183376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:36:57.183376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:36:57.183376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:36:57.183376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:36:57.183376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:36:57.183376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:36:57.183376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 15:36:57.183376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:57.183376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 241/507] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:36:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:57.183932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600911fb-98d6-4d1a-8aa8-47f11507be86 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:57.207824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046aaca-a819-4781-a17c-cd96d20b8243 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:57.247694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e31a4-b85e-46a6-920c-6c0e9698ed75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:57.248488 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e31a4-b85e-46a6-920c-6c0e9698ed75 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:57.248783 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e31a4-b85e-46a6-920c-6c0e9698ed75 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:57.249563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e31a4-b85e-46a6-920c-6c0e9698ed75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:57.295749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600911fb-98d6-4d1a-8aa8-47f11507be86 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:57.320108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e31a4-b85e-46a6-920c-6c0e9698ed75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:57.321635 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e31a4-b85e-46a6-920c-6c0e9698ed75 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:57.322405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:57.331622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfac7e-bf91-4e7c-94c2-524c4c995c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:57.332313 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfac7e-bf91-4e7c-94c2-524c4c995c9a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:57.332599 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfac7e-bf91-4e7c-94c2-524c4c995c9a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:57.332870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfac7e-bf91-4e7c-94c2-524c4c995c9a None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:57.333724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfac7e-bf91-4e7c-94c2-524c4c995c9a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:57.334030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfac7e-bf91-4e7c-94c2-524c4c995c9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:57.335482 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfac7e-bf91-4e7c-94c2-524c4c995c9a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:57.352992 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 242/508] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Jul 11 15:36:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:57.353780 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfac7e-bf91-4e7c-94c2-524c4c995c9a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:57.365264 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:57.424005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 267/509] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:57.424961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e31a4-b85e-46a6-920c-6c0e9698ed75 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:57.453610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfac7e-bf91-4e7c-94c2-524c4c995c9a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:57.487219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19816c0-4568-4793-886a-0b6ba62ce134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:57.488012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19816c0-4568-4793-886a-0b6ba62ce134 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:57.488303 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19816c0-4568-4793-886a-0b6ba62ce134 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:57.488593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19816c0-4568-4793-886a-0b6ba62ce134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:57.498502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19816c0-4568-4793-886a-0b6ba62ce134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:57.500615 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19816c0-4568-4793-886a-0b6ba62ce134 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-d19816c0-4568-4793-886a-0b6ba62ce134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:36:57.518558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:57.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:57.520474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:36:57.520474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:36:57.520474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:57.520474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:57.520474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 243/510] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:57.520734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19816c0-4568-4793-886a-0b6ba62ce134 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:57.523863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e31a4-b85e-46a6-920c-6c0e9698ed75 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:57.558246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c7311-eb6a-4990-bb0f-26f332f066ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:57.558835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c7311-eb6a-4990-bb0f-26f332f066ae None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:57.559109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c7311-eb6a-4990-bb0f-26f332f066ae None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:57.559377 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c7311-eb6a-4990-bb0f-26f332f066ae None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:57.560247 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c7311-eb6a-4990-bb0f-26f332f066ae None admin] RBAC: Adding query filter params (name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:57.560583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c7311-eb6a-4990-bb0f-26f332f066ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:57.562040 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c7311-eb6a-4990-bb0f-26f332f066ae None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:57.566245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:57.572096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 268/511] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:36:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:57.573011 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c7311-eb6a-4990-bb0f-26f332f066ae None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:57.575726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:57.632327 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19816c0-4568-4793-886a-0b6ba62ce134 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:57.666446 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37640e3-d5e3-4f89-ab57-cb063c9467a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:57.667127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37640e3-d5e3-4f89-ab57-cb063c9467a9 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:57.667395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37640e3-d5e3-4f89-ab57-cb063c9467a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:57.667674 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37640e3-d5e3-4f89-ab57-cb063c9467a9 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:57.668557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37640e3-d5e3-4f89-ab57-cb063c9467a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:57.668861 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37640e3-d5e3-4f89-ab57-cb063c9467a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:57.670318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37640e3-d5e3-4f89-ab57-cb063c9467a9 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:57.682071 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c7311-eb6a-4990-bb0f-26f332f066ae None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:57.687813 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 244/512] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Jul 11 15:36:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:57.688642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37640e3-d5e3-4f89-ab57-cb063c9467a9 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:57.720442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e5bcf-0d24-49d8-a3a5-4219151a7695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:57.721093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5bcf-0d24-49d8-a3a5-4219151a7695 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:57.721375 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5bcf-0d24-49d8-a3a5-4219151a7695 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:57.721648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5bcf-0d24-49d8-a3a5-4219151a7695 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:57.782176 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:57.788442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37640e3-d5e3-4f89-ab57-cb063c9467a9 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:57.789351 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e5bcf-0d24-49d8-a3a5-4219151a7695 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:57.790820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e5bcf-0d24-49d8-a3a5-4219151a7695 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:57.792703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:57.831033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1e8dd-124e-45b3-a71a-4e545594c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:57.831746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1e8dd-124e-45b3-a71a-4e545594c614 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:57.832018 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1e8dd-124e-45b3-a71a-4e545594c614 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:57.832280 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1e8dd-124e-45b3-a71a-4e545594c614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:57.843652 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1e8dd-124e-45b3-a71a-4e545594c614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:57.845153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1e8dd-124e-45b3-a71a-4e545594c614 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-06e1e8dd-124e-45b3-a71a-4e545594c614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:36:57.866686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:57.867571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:57.868819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:36:57.868819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:36:57.868819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:57.868819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:57.868819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 245/513] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:57.868819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1e8dd-124e-45b3-a71a-4e545594c614 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:57.902480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 269/514] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:57.903332 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e5bcf-0d24-49d8-a3a5-4219151a7695 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:57.977706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1e8dd-124e-45b3-a71a-4e545594c614 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:58.006953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e5bcf-0d24-49d8-a3a5-4219151a7695 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:58.008494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:58.012335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51f29b-bfa3-4334-b97e-3f2b42ef03b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:58.013008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51f29b-bfa3-4334-b97e-3f2b42ef03b0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:58.013291 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51f29b-bfa3-4334-b97e-3f2b42ef03b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:58.013564 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51f29b-bfa3-4334-b97e-3f2b42ef03b0 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:58.014303 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51f29b-bfa3-4334-b97e-3f2b42ef03b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:58.014726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51f29b-bfa3-4334-b97e-3f2b42ef03b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:58.016111 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51f29b-bfa3-4334-b97e-3f2b42ef03b0 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:58.027467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 246/515] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:58.028267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51f29b-bfa3-4334-b97e-3f2b42ef03b0 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:58.039087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:58.046798 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97616e55-42ca-423c-86b5-3069ef817e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:58.047601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97616e55-42ca-423c-86b5-3069ef817e73 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:58.047884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97616e55-42ca-423c-86b5-3069ef817e73 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:58.048161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97616e55-42ca-423c-86b5-3069ef817e73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:58.058226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97616e55-42ca-423c-86b5-3069ef817e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:58.059699 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97616e55-42ca-423c-86b5-3069ef817e73 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-97616e55-42ca-423c-86b5-3069ef817e73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:36:58.077206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:58.078282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:58.084136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:36:58.084136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:36:58.084136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:58.084136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:58.084136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 270/516] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:58.084136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97616e55-42ca-423c-86b5-3069ef817e73 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:58.132546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51f29b-bfa3-4334-b97e-3f2b42ef03b0 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:58.166649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7a6e2-5d3c-4474-af7f-d0511cead153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:58.167301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7a6e2-5d3c-4474-af7f-d0511cead153 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:58.167581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7a6e2-5d3c-4474-af7f-d0511cead153 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:58.167846 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7a6e2-5d3c-4474-af7f-d0511cead153 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:58.175487 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97616e55-42ca-423c-86b5-3069ef817e73 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:58.209753 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6205f-28b3-4ca7-8bd2-96dc8e943afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:58.210422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6205f-28b3-4ca7-8bd2-96dc8e943afd None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:58.210710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6205f-28b3-4ca7-8bd2-96dc8e943afd None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:58.210988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6205f-28b3-4ca7-8bd2-96dc8e943afd None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:58.212040 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6205f-28b3-4ca7-8bd2-96dc8e943afd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:58.212377 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6205f-28b3-4ca7-8bd2-96dc8e943afd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:58.213765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6205f-28b3-4ca7-8bd2-96dc8e943afd None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:58.225253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 271/517] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:58.226039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6205f-28b3-4ca7-8bd2-96dc8e943afd None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:58.242990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7a6e2-5d3c-4474-af7f-d0511cead153 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:58.244559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7a6e2-5d3c-4474-af7f-d0511cead153 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:58.246950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:58.254363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:58.332525 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6205f-28b3-4ca7-8bd2-96dc8e943afd None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:58.341646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 247/518] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:58.342556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7a6e2-5d3c-4474-af7f-d0511cead153 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:58.367291 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fa9e4-2fe1-48be-9c3a-1161d5fed739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:58.368172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fa9e4-2fe1-48be-9c3a-1161d5fed739 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:58.368497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fa9e4-2fe1-48be-9c3a-1161d5fed739 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:58.368765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fa9e4-2fe1-48be-9c3a-1161d5fed739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:58.379106 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fa9e4-2fe1-48be-9c3a-1161d5fed739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:58.380580 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fa9e4-2fe1-48be-9c3a-1161d5fed739 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-ef0fa9e4-2fe1-48be-9c3a-1161d5fed739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:36:58.397207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:58.398032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:58.398881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:36:58.398881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:36:58.398881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:58.398881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:58.398881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 272/519] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:58.399144 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fa9e4-2fe1-48be-9c3a-1161d5fed739 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:58.443643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7a6e2-5d3c-4474-af7f-d0511cead153 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:58.453046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:58.462780 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:58.478184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec8465-036b-410b-a7fe-f0f42d5c5968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:58.479017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec8465-036b-410b-a7fe-f0f42d5c5968 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:58.479308 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec8465-036b-410b-a7fe-f0f42d5c5968 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:58.479578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec8465-036b-410b-a7fe-f0f42d5c5968 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:58.480310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec8465-036b-410b-a7fe-f0f42d5c5968 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:58.481782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec8465-036b-410b-a7fe-f0f42d5c5968 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:58.497596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fa9e4-2fe1-48be-9c3a-1161d5fed739 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:58.501679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 248/520] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:36:58 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:36:58.502481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec8465-036b-410b-a7fe-f0f42d5c5968 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:58.547975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dca4eb-2989-4e3e-ab94-25d72ea2b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:58.548696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca4eb-2989-4e3e-ab94-25d72ea2b145 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:58.548993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca4eb-2989-4e3e-ab94-25d72ea2b145 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:58.549258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca4eb-2989-4e3e-ab94-25d72ea2b145 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:58.550009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dca4eb-2989-4e3e-ab94-25d72ea2b145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:58.550320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dca4eb-2989-4e3e-ab94-25d72ea2b145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:58.551784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dca4eb-2989-4e3e-ab94-25d72ea2b145 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:58.565056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 273/521] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:58.565715 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dca4eb-2989-4e3e-ab94-25d72ea2b145 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:58.629648 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec8465-036b-410b-a7fe-f0f42d5c5968 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:58.672031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246da4e-348d-4fde-ab53-86f826af7619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:58.672896 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246da4e-348d-4fde-ab53-86f826af7619 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:58.673698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246da4e-348d-4fde-ab53-86f826af7619 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:58.673698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246da4e-348d-4fde-ab53-86f826af7619 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:58.674147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dca4eb-2989-4e3e-ab94-25d72ea2b145 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:58.681656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246da4e-348d-4fde-ab53-86f826af7619 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:58.683268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246da4e-348d-4fde-ab53-86f826af7619 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-7246da4e-348d-4fde-ab53-86f826af7619 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:36:58.698833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:58.699733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:58.700636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:36:58.700636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:36:58.700636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:36:58.700636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:36:58.700636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:36:58.700636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:36:58.700636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:36:58.700636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:58.700636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 249/522] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:58.701182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246da4e-348d-4fde-ab53-86f826af7619 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:58.707064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:58.715114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da2f4c-3ba7-49f5-86ef-cfb360a729c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:58.715930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da2f4c-3ba7-49f5-86ef-cfb360a729c1 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:58.716214 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da2f4c-3ba7-49f5-86ef-cfb360a729c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:58.716557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da2f4c-3ba7-49f5-86ef-cfb360a729c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:58.727449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da2f4c-3ba7-49f5-86ef-cfb360a729c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:58.728976 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da2f4c-3ba7-49f5-86ef-cfb360a729c1 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:58.732907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-02da2f4c-3ba7-49f5-86ef-cfb360a729c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:36:58.748220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:58.749171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:58.750235 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:36:58.750235 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:36:58.750235 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:36:58.750235 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:58.750235 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 274/523] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:58.750626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da2f4c-3ba7-49f5-86ef-cfb360a729c1 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:58.815668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246da4e-348d-4fde-ab53-86f826af7619 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:58.851067 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0275b40-6e05-4005-9ac7-c88067d708ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:58.851924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0275b40-6e05-4005-9ac7-c88067d708ed None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:58.852310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0275b40-6e05-4005-9ac7-c88067d708ed None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:58.852652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da2f4c-3ba7-49f5-86ef-cfb360a729c1 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:58.852751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0275b40-6e05-4005-9ac7-c88067d708ed None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:58.853560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0275b40-6e05-4005-9ac7-c88067d708ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:58.853958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0275b40-6e05-4005-9ac7-c88067d708ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:58.855431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0275b40-6e05-4005-9ac7-c88067d708ed None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:58.867794 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 250/524] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:58.868776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0275b40-6e05-4005-9ac7-c88067d708ed None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:58.891483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512fc81-966a-4921-bb29-7df81295b1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:58.892199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512fc81-966a-4921-bb29-7df81295b1d0 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:58.892508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512fc81-966a-4921-bb29-7df81295b1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:58.892779 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512fc81-966a-4921-bb29-7df81295b1d0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:58.899946 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512fc81-966a-4921-bb29-7df81295b1d0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:58.901436 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512fc81-966a-4921-bb29-7df81295b1d0 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-f512fc81-966a-4921-bb29-7df81295b1d0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:36:58.915599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:58.916744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:58.917660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:58.917660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:58.917660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:36:58.917660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:36:58.917660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:36:58.917660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:36:58.917660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:36:58.917660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:36:58.917660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 15:36:58.917660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:58.917660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 275/525] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:36:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:58.918290 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512fc81-966a-4921-bb29-7df81295b1d0 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:58.958850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:58.976030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:58.977093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0275b40-6e05-4005-9ac7-c88067d708ed None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:59.014121 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c6bb2-82f8-4a9b-99e4-b3e89d43582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:59.015283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c6bb2-82f8-4a9b-99e4-b3e89d43582a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:59.015676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c6bb2-82f8-4a9b-99e4-b3e89d43582a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:59.016051 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c6bb2-82f8-4a9b-99e4-b3e89d43582a None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:59.016981 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c6bb2-82f8-4a9b-99e4-b3e89d43582a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:59.017386 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c6bb2-82f8-4a9b-99e4-b3e89d43582a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:59.018921 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c6bb2-82f8-4a9b-99e4-b3e89d43582a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:59.037540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 251/526] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:36:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:59.038597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c6bb2-82f8-4a9b-99e4-b3e89d43582a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:59.047400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512fc81-966a-4921-bb29-7df81295b1d0 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:59.083214 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c78709-bbe4-45e5-a9b8-812771c29682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:59.084213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c78709-bbe4-45e5-a9b8-812771c29682 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:59.084724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c78709-bbe4-45e5-a9b8-812771c29682 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:59.085080 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c78709-bbe4-45e5-a9b8-812771c29682 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:59.085893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c78709-bbe4-45e5-a9b8-812771c29682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:59.086269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c78709-bbe4-45e5-a9b8-812771c29682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:59.088041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c78709-bbe4-45e5-a9b8-812771c29682 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:59.099373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 276/527] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:59.100247 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c78709-bbe4-45e5-a9b8-812771c29682 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:59.149669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c6bb2-82f8-4a9b-99e4-b3e89d43582a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:59.186945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3808f-8bf7-472b-b62f-9fef755852ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:59.188019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3808f-8bf7-472b-b62f-9fef755852ad None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:59.188320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3808f-8bf7-472b-b62f-9fef755852ad None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:59.188609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3808f-8bf7-472b-b62f-9fef755852ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:59.195995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3808f-8bf7-472b-b62f-9fef755852ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:59.197597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3808f-8bf7-472b-b62f-9fef755852ad None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-90d3808f-8bf7-472b-b62f-9fef755852ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:36:59.211306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:59.212690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:59.213607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:36:59.213607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:36:59.213607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:36:59.213607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:36:59.213607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:36:59.213607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:36:59.213607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:36:59.213607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:36:59.213607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 252/528] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:59.213607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3808f-8bf7-472b-b62f-9fef755852ad None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:59.219318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:59.220633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:59.223663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c78709-bbe4-45e5-a9b8-812771c29682 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:59.261409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a22951-bcb8-4f22-a4da-cda39ce0cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:59.262278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a22951-bcb8-4f22-a4da-cda39ce0cc07 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:59.262384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a22951-bcb8-4f22-a4da-cda39ce0cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:59.262608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a22951-bcb8-4f22-a4da-cda39ce0cc07 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:59.263458 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a22951-bcb8-4f22-a4da-cda39ce0cc07 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:59.263763 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a22951-bcb8-4f22-a4da-cda39ce0cc07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:59.265289 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a22951-bcb8-4f22-a4da-cda39ce0cc07 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:59.302285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 277/529] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Jul 11 15:36:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:59.302796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a22951-bcb8-4f22-a4da-cda39ce0cc07 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:59.328545 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3808f-8bf7-472b-b62f-9fef755852ad None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:59.364347 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b3f8-e32d-46f5-824c-b82ae4ccd389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:59.365111 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b3f8-e32d-46f5-824c-b82ae4ccd389 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:59.365291 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b3f8-e32d-46f5-824c-b82ae4ccd389 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:59.365565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b3f8-e32d-46f5-824c-b82ae4ccd389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:59.366401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885b3f8-e32d-46f5-824c-b82ae4ccd389 None admin] RBAC: Adding query filter params (role.id=c8fd28e5c32f4759a288774fddec4493, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=fa038a2e30f544aaa609d32e0e1ceaa0) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:59.366715 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885b3f8-e32d-46f5-824c-b82ae4ccd389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:59.368170 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885b3f8-e32d-46f5-824c-b82ae4ccd389 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:59.380220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 253/530] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:59 2022] GET /identity/v3/role_assignments?user.id=fa038a2e30f544aaa609d32e0e1ceaa0&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c8fd28e5c32f4759a288774fddec4493 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:59.380220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b3f8-e32d-46f5-824c-b82ae4ccd389 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:59.416264 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a22951-bcb8-4f22-a4da-cda39ce0cc07 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:59.460342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe317315-961a-44af-89b2-49278ef09f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:59.461963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe317315-961a-44af-89b2-49278ef09f68 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:59.462394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe317315-961a-44af-89b2-49278ef09f68 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:59.463159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe317315-961a-44af-89b2-49278ef09f68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:59.467400 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:59.473533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe317315-961a-44af-89b2-49278ef09f68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:59.476116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe317315-961a-44af-89b2-49278ef09f68 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-fe317315-961a-44af-89b2-49278ef09f68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:36:59.494820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:36:59.495782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:36:59.496648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:36:59.496648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:36:59.496648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:36:59.496648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:36:59.496648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:36:59.496648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:36:59.496648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:36:59.496648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:36:59.500461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 278/531] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:36:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:36:59.501581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe317315-961a-44af-89b2-49278ef09f68 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:59.517431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b3f8-e32d-46f5-824c-b82ae4ccd389 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:59.529362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:59.562231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c4055-8ba7-4d68-ac2d-90d1b6115301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:59.563164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c4055-8ba7-4d68-ac2d-90d1b6115301 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:59.563537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c4055-8ba7-4d68-ac2d-90d1b6115301 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:59.563904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c4055-8ba7-4d68-ac2d-90d1b6115301 None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:59.564827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c4055-8ba7-4d68-ac2d-90d1b6115301 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:59.565321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c4055-8ba7-4d68-ac2d-90d1b6115301 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:59.566949 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c4055-8ba7-4d68-ac2d-90d1b6115301 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:59.580492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 254/532] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:59.581526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c4055-8ba7-4d68-ac2d-90d1b6115301 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:59.623747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe317315-961a-44af-89b2-49278ef09f68 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:59.663224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0dea3-93c9-4a03-9ba2-9298852e03ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:59.663881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0dea3-93c9-4a03-9ba2-9298852e03ce None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:59.664163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0dea3-93c9-4a03-9ba2-9298852e03ce None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:59.664472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0dea3-93c9-4a03-9ba2-9298852e03ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:59.716661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c4055-8ba7-4d68-ac2d-90d1b6115301 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:59.740367 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0dea3-93c9-4a03-9ba2-9298852e03ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:59.742746 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0dea3-93c9-4a03-9ba2-9298852e03ce None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:59.745133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:59.754831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9f6ae-a827-442c-b2db-48c56f3d63aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:59.755664 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9f6ae-a827-442c-b2db-48c56f3d63aa None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:59.755818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9f6ae-a827-442c-b2db-48c56f3d63aa None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:59.756097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9f6ae-a827-442c-b2db-48c56f3d63aa None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:59.756990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9f6ae-a827-442c-b2db-48c56f3d63aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:59.757306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9f6ae-a827-442c-b2db-48c56f3d63aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:59.758787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9f6ae-a827-442c-b2db-48c56f3d63aa None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:59.767046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:36:59.776526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 255/533] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:59.777410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9f6ae-a827-442c-b2db-48c56f3d63aa None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:59.869411 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 279/534] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:36:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:36:59.870504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0dea3-93c9-4a03-9ba2-9298852e03ce None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:59.888035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9f6ae-a827-442c-b2db-48c56f3d63aa None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:59.922069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599512f5-1301-45ad-babf-968a080a56a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:36:59.922759 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599512f5-1301-45ad-babf-968a080a56a8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:36:59.923063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599512f5-1301-45ad-babf-968a080a56a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:36:59.923296 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599512f5-1301-45ad-babf-968a080a56a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:36:59.924216 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599512f5-1301-45ad-babf-968a080a56a8 None admin] RBAC: Adding query filter params (role.id=c8fd28e5c32f4759a288774fddec4493, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=73732594dbee480e9e5d153ca1382494) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:36:59.924561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599512f5-1301-45ad-babf-968a080a56a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:36:59.926194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599512f5-1301-45ad-babf-968a080a56a8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:36:59.932736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 256/535] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:59 2022] GET /identity/v3/role_assignments?user.id=73732594dbee480e9e5d153ca1382494&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c8fd28e5c32f4759a288774fddec4493 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:36:59.937747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599512f5-1301-45ad-babf-968a080a56a8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:36:59.980068 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0dea3-93c9-4a03-9ba2-9298852e03ce None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:36:59.999301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:00.023685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e047f1-f140-44c4-87ab-5123d525e185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:00.024625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e047f1-f140-44c4-87ab-5123d525e185 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:00.025852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e047f1-f140-44c4-87ab-5123d525e185 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:00.026431 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e047f1-f140-44c4-87ab-5123d525e185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:00.029207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e047f1-f140-44c4-87ab-5123d525e185 None admin] RBAC: Adding query filter params (role.id=c8fd28e5c32f4759a288774fddec4493, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=3be29cfa76174b44b99ddaf3d293ead1) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:00.029712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e047f1-f140-44c4-87ab-5123d525e185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:00.032600 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e047f1-f140-44c4-87ab-5123d525e185 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:00.043435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:00.045390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 280/536] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:36:59 2022] GET /identity/v3/role_assignments?user.id=3be29cfa76174b44b99ddaf3d293ead1&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c8fd28e5c32f4759a288774fddec4493 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:00.122372 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599512f5-1301-45ad-babf-968a080a56a8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:00.171447 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87be7e0-c5c0-4315-91a5-caba1cfb545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:00.172281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87be7e0-c5c0-4315-91a5-caba1cfb545a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:00.172579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87be7e0-c5c0-4315-91a5-caba1cfb545a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:00.172850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87be7e0-c5c0-4315-91a5-caba1cfb545a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:00.189906 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87be7e0-c5c0-4315-91a5-caba1cfb545a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:00.190628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87be7e0-c5c0-4315-91a5-caba1cfb545a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-c87be7e0-c5c0-4315-91a5-caba1cfb545a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:00.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:00.218231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:00.219066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:00.219066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:00.219066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:00.219066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:00.219271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 257/537] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:00.224259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e047f1-f140-44c4-87ab-5123d525e185 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:00.332210 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e047f1-f140-44c4-87ab-5123d525e185 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:00.366449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc9944-efd2-49fb-85af-caa47d2f6639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:00.367114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc9944-efd2-49fb-85af-caa47d2f6639 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:00.367391 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc9944-efd2-49fb-85af-caa47d2f6639 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:00.367663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc9944-efd2-49fb-85af-caa47d2f6639 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:00.368424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc9944-efd2-49fb-85af-caa47d2f6639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:00.368733 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc9944-efd2-49fb-85af-caa47d2f6639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:00.370114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc9944-efd2-49fb-85af-caa47d2f6639 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:00.382462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 281/538] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:00.391189 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87be7e0-c5c0-4315-91a5-caba1cfb545a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:00.493036 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87be7e0-c5c0-4315-91a5-caba1cfb545a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:00.495481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:00.528095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbfff4-20a1-48e1-aa2a-7d02a9979027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:00.529015 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbfff4-20a1-48e1-aa2a-7d02a9979027 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:00.529358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbfff4-20a1-48e1-aa2a-7d02a9979027 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:00.529748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbfff4-20a1-48e1-aa2a-7d02a9979027 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:00.537267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbfff4-20a1-48e1-aa2a-7d02a9979027 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:00.538815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbfff4-20a1-48e1-aa2a-7d02a9979027 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-e0dbfff4-20a1-48e1-aa2a-7d02a9979027 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:00.553761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:00.554859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:00.555886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:00.555886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:00.555886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:00.555886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:00.555886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:00.555886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:00.555886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:00.555886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:00.556971 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 258/539] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:00.565721 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc9944-efd2-49fb-85af-caa47d2f6639 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:00.568019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55971d-1657-4179-9b2a-49cfad34c04c None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:00.568394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55971d-1657-4179-9b2a-49cfad34c04c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:00.568737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55971d-1657-4179-9b2a-49cfad34c04c None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:00.570185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 259/540] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:00.575524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e25e0-cbc6-461d-a781-407f83db8d4a None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:00.575882 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e25e0-cbc6-461d-a781-407f83db8d4a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:00.576225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e25e0-cbc6-461d-a781-407f83db8d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:00.595194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-9c5e25e0-cbc6-461d-a781-407f83db8d4a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:00.596435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9c5e25e0-cbc6-461d-a781-407f83db8d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:00.618949 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:00.687746 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc9944-efd2-49fb-85af-caa47d2f6639 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:00.731098 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0c6a1-038f-47e2-b27c-a2fe8e9ef4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:00.732108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0c6a1-038f-47e2-b27c-a2fe8e9ef4ca None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:00.732562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0c6a1-038f-47e2-b27c-a2fe8e9ef4ca None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:00.732979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0c6a1-038f-47e2-b27c-a2fe8e9ef4ca None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:00.734197 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0c6a1-038f-47e2-b27c-a2fe8e9ef4ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:00.734652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0c6a1-038f-47e2-b27c-a2fe8e9ef4ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:00.736255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0c6a1-038f-47e2-b27c-a2fe8e9ef4ca None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:00.755535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 260/541] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:37:00.763492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 282/542] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:00.768950 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e25e0-cbc6-461d-a781-407f83db8d4a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:00.794611 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0c6a1-038f-47e2-b27c-a2fe8e9ef4ca None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:00.913234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:00.919163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:00.920922 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e25e0-cbc6-461d-a781-407f83db8d4a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:00.923343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0c6a1-038f-47e2-b27c-a2fe8e9ef4ca None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:00.960586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2fe22-3add-4968-9021-8eac2b8edb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:00.962234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2fe22-3add-4968-9021-8eac2b8edb34 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:00.962587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2fe22-3add-4968-9021-8eac2b8edb34 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:00.962926 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2fe22-3add-4968-9021-8eac2b8edb34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:00.963976 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2fe22-3add-4968-9021-8eac2b8edb34 None admin] RBAC: Adding query filter params (role.id=c8fd28e5c32f4759a288774fddec4493, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=44a4d0441d4a423884d7adef45e2641f) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:00.964387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2fe22-3add-4968-9021-8eac2b8edb34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:00.966253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2fe22-3add-4968-9021-8eac2b8edb34 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:00.972800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 261/543] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:00 2022] GET /identity/v3/role_assignments?user.id=44a4d0441d4a423884d7adef45e2641f&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c8fd28e5c32f4759a288774fddec4493 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:00.975486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b0ccc-3363-4e4f-9515-8ad362f7b4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:00.976513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b0ccc-3363-4e4f-9515-8ad362f7b4d5 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:00.976974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b0ccc-3363-4e4f-9515-8ad362f7b4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:00.977393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b0ccc-3363-4e4f-9515-8ad362f7b4d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:01.013473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b0ccc-3363-4e4f-9515-8ad362f7b4d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-5f9b0ccc-3363-4e4f-9515-8ad362f7b4d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:01.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:01.023108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:01.024086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:01.024086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:01.024086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:01.024086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:01.024086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:01.024086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:01.024086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:01.024086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:01.024086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:01.024086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:01.024086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:01.024086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:01.028829 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 283/544] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:01.035008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2fe22-3add-4968-9021-8eac2b8edb34 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:01.172303 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2fe22-3add-4968-9021-8eac2b8edb34 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:01.208510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567e5e9-4b82-4255-ad8c-cb3d44e8762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:01.209187 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567e5e9-4b82-4255-ad8c-cb3d44e8762b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:01.209465 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567e5e9-4b82-4255-ad8c-cb3d44e8762b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:01.209735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567e5e9-4b82-4255-ad8c-cb3d44e8762b None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:01.210496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567e5e9-4b82-4255-ad8c-cb3d44e8762b None admin] RBAC: Adding query filter params (name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:01.210796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567e5e9-4b82-4255-ad8c-cb3d44e8762b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:01.212539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567e5e9-4b82-4255-ad8c-cb3d44e8762b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:01.221226 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 262/545] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:37:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:01.226735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b0ccc-3363-4e4f-9515-8ad362f7b4d5 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:01.368494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b0ccc-3363-4e4f-9515-8ad362f7b4d5 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:01.415557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be17bf-9986-41da-bda7-5adef9d93527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:01.416430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be17bf-9986-41da-bda7-5adef9d93527 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:01.416718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be17bf-9986-41da-bda7-5adef9d93527 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:01.416995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be17bf-9986-41da-bda7-5adef9d93527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:01.431332 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be17bf-9986-41da-bda7-5adef9d93527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:01.432850 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be17bf-9986-41da-bda7-5adef9d93527 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-90be17bf-9986-41da-bda7-5adef9d93527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:01.452087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:01.453293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:01.454154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:01.454154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:01.454154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:01.454154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:01.454154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 284/546] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:01.460601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567e5e9-4b82-4255-ad8c-cb3d44e8762b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:01.504542 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:01.607522 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567e5e9-4b82-4255-ad8c-cb3d44e8762b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:01.642023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5f674-ff46-4acc-b474-6c50c0be8120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:01.643074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5f674-ff46-4acc-b474-6c50c0be8120 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:01.643558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5f674-ff46-4acc-b474-6c50c0be8120 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:01.644059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5f674-ff46-4acc-b474-6c50c0be8120 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:01.645076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5f674-ff46-4acc-b474-6c50c0be8120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:01.645598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5f674-ff46-4acc-b474-6c50c0be8120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:01.647225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5f674-ff46-4acc-b474-6c50c0be8120 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:01.665650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 263/547] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:01.671413 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be17bf-9986-41da-bda7-5adef9d93527 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:01.696704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:01.813323 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be17bf-9986-41da-bda7-5adef9d93527 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:01.859837 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee099b-6520-41aa-8a1f-267ff7dcd0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:01.860668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee099b-6520-41aa-8a1f-267ff7dcd0a5 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:01.860950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee099b-6520-41aa-8a1f-267ff7dcd0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:01.861224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee099b-6520-41aa-8a1f-267ff7dcd0a5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:01.869285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee099b-6520-41aa-8a1f-267ff7dcd0a5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:01.870859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee099b-6520-41aa-8a1f-267ff7dcd0a5 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:01.871608 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edff5cb-1542-4c04-b455-754ac88caf36 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:01.871902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edff5cb-1542-4c04-b455-754ac88caf36 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:01.872162 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edff5cb-1542-4c04-b455-754ac88caf36 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:01.875589 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 264/548] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:01.880062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c2c3-c437-4c12-9957-6f701e302422 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:01.880394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c2c3-c437-4c12-9957-6f701e302422 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:01.880671 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c2c3-c437-4c12-9957-6f701e302422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-37ee099b-6520-41aa-8a1f-267ff7dcd0a5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:01.893062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:01.893965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:01.895506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:01.895506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:01.895506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:01.895506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:01.895506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:01.895506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:01.895506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:01.895506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:01.895506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:37:01.895506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:01.895506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 285/549] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:37:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:01.910027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee099b-6520-41aa-8a1f-267ff7dcd0a5 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:01.910293 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-bfc8c2c3-c437-4c12-9957-6f701e302422 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:01.911544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-bfc8c2c3-c437-4c12-9957-6f701e302422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:01.982597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 265/550] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:37:01.999118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:02.049375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8c2c3-c437-4c12-9957-6f701e302422 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:02.050486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee099b-6520-41aa-8a1f-267ff7dcd0a5 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:02.069936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:02.091176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f9c6b-eadb-45b0-8afc-cd54ae4177fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:02.091854 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f9c6b-eadb-45b0-8afc-cd54ae4177fc None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:02.092134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f9c6b-eadb-45b0-8afc-cd54ae4177fc None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:02.092484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f9c6b-eadb-45b0-8afc-cd54ae4177fc None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:02.093894 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f9c6b-eadb-45b0-8afc-cd54ae4177fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:02.094205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f9c6b-eadb-45b0-8afc-cd54ae4177fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:02.095670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f9c6b-eadb-45b0-8afc-cd54ae4177fc None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:02.140212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 286/551] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Jul 11 15:37:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:02.160088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f9c6b-eadb-45b0-8afc-cd54ae4177fc None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:02.242551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8c2c3-c437-4c12-9957-6f701e302422 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:02.274178 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f9c6b-eadb-45b0-8afc-cd54ae4177fc None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:02.305407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:02.312737 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6f83e-cee4-46ca-9326-78ab33fccfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:02.314339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6f83e-cee4-46ca-9326-78ab33fccfd1 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:02.314644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6f83e-cee4-46ca-9326-78ab33fccfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:02.314923 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6f83e-cee4-46ca-9326-78ab33fccfd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:02.331083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb1fb8-fad1-446c-abc2-2ab90a9a82eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:02.331904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb1fb8-fad1-446c-abc2-2ab90a9a82eb None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:02.332182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb1fb8-fad1-446c-abc2-2ab90a9a82eb None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:02.332475 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb1fb8-fad1-446c-abc2-2ab90a9a82eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:02.353654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb1fb8-fad1-446c-abc2-2ab90a9a82eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-12cb1fb8-fad1-446c-abc2-2ab90a9a82eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:02.369643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:02.370689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:02.371618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:02.371618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:02.371618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:02.371618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:02.371618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:02.371618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:02.371618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:02.371618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:02.371618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:02.371618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:02.371618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:02.371618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:02.371618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 266/552] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:02.378603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb1fb8-fad1-446c-abc2-2ab90a9a82eb None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:02.394042 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6f83e-cee4-46ca-9326-78ab33fccfd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:02.395549 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6f83e-cee4-46ca-9326-78ab33fccfd1 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:02.512749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:02.519263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 287/553] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 15:37:02.520724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a6edf-0e15-4d75-ab8e-4b3fdd698550 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:02.521013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a6edf-0e15-4d75-ab8e-4b3fdd698550 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:02.521283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a6edf-0e15-4d75-ab8e-4b3fdd698550 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:02.522573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 288/554] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:02.525280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a6edf-0e15-4d75-ab8e-4b3fdd698550 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:02.554135 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb1fb8-fad1-446c-abc2-2ab90a9a82eb None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:02.556484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:02.591663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc6eb4-1fac-4f2f-aea0-bf0ce7bffe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:02.592411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc6eb4-1fac-4f2f-aea0-bf0ce7bffe1e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:02.592757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc6eb4-1fac-4f2f-aea0-bf0ce7bffe1e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:02.593128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc6eb4-1fac-4f2f-aea0-bf0ce7bffe1e None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:02.594127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc6eb4-1fac-4f2f-aea0-bf0ce7bffe1e None admin] RBAC: Adding query filter params (name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:02.594440 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc6eb4-1fac-4f2f-aea0-bf0ce7bffe1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:02.595850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc6eb4-1fac-4f2f-aea0-bf0ce7bffe1e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:02.609544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 267/555] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:37:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:02.609544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc2be0-25ea-4f01-9bf5-0151810f24a5 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:02.609544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc2be0-25ea-4f01-9bf5-0151810f24a5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:02.609544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc2be0-25ea-4f01-9bf5-0151810f24a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:02.625059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-64bc2be0-25ea-4f01-9bf5-0151810f24a5 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:02.626445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-64bc2be0-25ea-4f01-9bf5-0151810f24a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:02.637742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a6edf-0e15-4d75-ab8e-4b3fdd698550 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:02.674290 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eef02-22c8-4edf-a33e-699e5156ac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:02.675473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eef02-22c8-4edf-a33e-699e5156ac26 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:02.676036 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eef02-22c8-4edf-a33e-699e5156ac26 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:02.676518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eef02-22c8-4edf-a33e-699e5156ac26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:02.687614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400eef02-22c8-4edf-a33e-699e5156ac26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:02.689617 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400eef02-22c8-4edf-a33e-699e5156ac26 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:02.696790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 268/556] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:37:02.704975 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc2be0-25ea-4f01-9bf5-0151810f24a5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-400eef02-22c8-4edf-a33e-699e5156ac26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:02.709326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:02.710187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:02.711064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:02.711064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:02.711064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:02.711064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:02.713703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 289/557] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:02.719519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eef02-22c8-4edf-a33e-699e5156ac26 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:02.776220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:02.820661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:02.823910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc2be0-25ea-4f01-9bf5-0151810f24a5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:02.837112 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eef02-22c8-4edf-a33e-699e5156ac26 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:02.864016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e722f0-90c3-4dcf-8356-d6a8633beca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:02.865079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e722f0-90c3-4dcf-8356-d6a8633beca0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:02.865504 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e722f0-90c3-4dcf-8356-d6a8633beca0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:02.865944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e722f0-90c3-4dcf-8356-d6a8633beca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:02.873975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d555a75-fdfc-4ee8-a550-fea316ba2f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:02.874706 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d555a75-fdfc-4ee8-a550-fea316ba2f47 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:02.874986 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d555a75-fdfc-4ee8-a550-fea316ba2f47 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:02.875256 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d555a75-fdfc-4ee8-a550-fea316ba2f47 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:02.876421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d555a75-fdfc-4ee8-a550-fea316ba2f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:02.876732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d555a75-fdfc-4ee8-a550-fea316ba2f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:02.878001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e722f0-90c3-4dcf-8356-d6a8633beca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:02.878117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d555a75-fdfc-4ee8-a550-fea316ba2f47 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:02.879703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e722f0-90c3-4dcf-8356-d6a8633beca0 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:02.892324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 290/558] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:02.892324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d555a75-fdfc-4ee8-a550-fea316ba2f47 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-f6e722f0-90c3-4dcf-8356-d6a8633beca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:02.902110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:02.903433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:02.905097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:02.905097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:02.905097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:02.905097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:02.905097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 269/559] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:02.905097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c070e60-7112-4f07-9b29-5f5501e7017d None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:02.905097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c070e60-7112-4f07-9b29-5f5501e7017d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:02.905547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c070e60-7112-4f07-9b29-5f5501e7017d None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:02.906548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 270/560] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:02.908406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c070e60-7112-4f07-9b29-5f5501e7017d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:03.015258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d555a75-fdfc-4ee8-a550-fea316ba2f47 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:03.016388 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c070e60-7112-4f07-9b29-5f5501e7017d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:03.032680 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:03.054309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5be6ad-5c73-45f9-a6fa-991bd8002b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:03.054912 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee593a-5149-46ca-af62-b521f090d01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:03.055356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be6ad-5c73-45f9-a6fa-991bd8002b22 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:03.055709 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee593a-5149-46ca-af62-b521f090d01c None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:03.055800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be6ad-5c73-45f9-a6fa-991bd8002b22 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:03.055988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee593a-5149-46ca-af62-b521f090d01c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:03.056259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be6ad-5c73-45f9-a6fa-991bd8002b22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:03.056379 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee593a-5149-46ca-af62-b521f090d01c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:03.063888 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5be6ad-5c73-45f9-a6fa-991bd8002b22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:03.065428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5be6ad-5c73-45f9-a6fa-991bd8002b22 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:03.068213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee593a-5149-46ca-af62-b521f090d01c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-d9ee593a-5149-46ca-af62-b521f090d01c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:03.077286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:03.078206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:03.079029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:03.079029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:03.079029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:03.079029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:03.079029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:03.079029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:03.079029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:03.079029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:03.079029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:03.079029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:03.079029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:03.079029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:03.079029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 291/561] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-df5be6ad-5c73-45f9-a6fa-991bd8002b22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:03.079714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:03.085880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:03.087271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:03.087271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:03.087271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:03.087271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:03.087271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:03.087271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:03.087271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:03.087271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:03.087871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee593a-5149-46ca-af62-b521f090d01c None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:03.087957 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 271/562] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:03.087957 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77324d56-4a30-4181-8be4-971dbd89750a None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:03.087957 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77324d56-4a30-4181-8be4-971dbd89750a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:03.087957 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77324d56-4a30-4181-8be4-971dbd89750a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:03.091414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:03.100925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-77324d56-4a30-4181-8be4-971dbd89750a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:03.102120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-77324d56-4a30-4181-8be4-971dbd89750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:03.171696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 272/563] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:37:03.172881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77324d56-4a30-4181-8be4-971dbd89750a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:03.208423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee593a-5149-46ca-af62-b521f090d01c None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:03.244422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a977739-64b7-4c6b-9500-144259bac00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:03.245125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a977739-64b7-4c6b-9500-144259bac00f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:03.245409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a977739-64b7-4c6b-9500-144259bac00f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:03.245687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a977739-64b7-4c6b-9500-144259bac00f None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:03.246427 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a977739-64b7-4c6b-9500-144259bac00f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:03.246741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a977739-64b7-4c6b-9500-144259bac00f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:03.248144 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a977739-64b7-4c6b-9500-144259bac00f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:03.265140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 292/564] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:03.265140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a977739-64b7-4c6b-9500-144259bac00f None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:03.291606 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77324d56-4a30-4181-8be4-971dbd89750a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:03.294968 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:03.329276 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:03.341185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663b8f4-a3cd-4951-b6bb-bf82dd33a8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:03.342082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663b8f4-a3cd-4951-b6bb-bf82dd33a8e1 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:03.342522 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663b8f4-a3cd-4951-b6bb-bf82dd33a8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:03.342921 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663b8f4-a3cd-4951-b6bb-bf82dd33a8e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:03.343885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663b8f4-a3cd-4951-b6bb-bf82dd33a8e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:03.344196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663b8f4-a3cd-4951-b6bb-bf82dd33a8e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:03.345671 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663b8f4-a3cd-4951-b6bb-bf82dd33a8e1 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:03.354975 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 273/565] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:37:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:03.355909 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663b8f4-a3cd-4951-b6bb-bf82dd33a8e1 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:03.381070 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a977739-64b7-4c6b-9500-144259bac00f None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:03.413793 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc60097-37cb-4e5e-92cb-b4688f972e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:03.414456 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60097-37cb-4e5e-92cb-b4688f972e35 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:03.414733 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60097-37cb-4e5e-92cb-b4688f972e35 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:03.415008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60097-37cb-4e5e-92cb-b4688f972e35 None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:03.415801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc60097-37cb-4e5e-92cb-b4688f972e35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:03.416107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc60097-37cb-4e5e-92cb-b4688f972e35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:03.417591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc60097-37cb-4e5e-92cb-b4688f972e35 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:03.428622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 293/566] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:03.429410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc60097-37cb-4e5e-92cb-b4688f972e35 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:03.462730 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663b8f4-a3cd-4951-b6bb-bf82dd33a8e1 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:03.496209 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88f068-7915-4722-b3d3-a6b46799225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:03.497039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88f068-7915-4722-b3d3-a6b46799225e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:03.497321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88f068-7915-4722-b3d3-a6b46799225e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:03.497594 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88f068-7915-4722-b3d3-a6b46799225e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:03.507776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88f068-7915-4722-b3d3-a6b46799225e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-4c88f068-7915-4722-b3d3-a6b46799225e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:03.515546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:03.517035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:03.518353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:03.518353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:03.518353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:03.518353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:03.518353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:03.518353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:03.518353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:03.518353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:03.518353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:03.518353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:03.518353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:03.518353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:03.518353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 274/567] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:03.518353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88f068-7915-4722-b3d3-a6b46799225e None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:03.529580 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc60097-37cb-4e5e-92cb-b4688f972e35 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:03.548076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:03.551984 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:03.565483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bb5a1-6136-440e-8e7b-29bf4b59906a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:03.566280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bb5a1-6136-440e-8e7b-29bf4b59906a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:03.566559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bb5a1-6136-440e-8e7b-29bf4b59906a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:03.566836 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bb5a1-6136-440e-8e7b-29bf4b59906a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:03.575000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bb5a1-6136-440e-8e7b-29bf4b59906a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:03.576494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bb5a1-6136-440e-8e7b-29bf4b59906a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-196bb5a1-6136-440e-8e7b-29bf4b59906a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:03.590955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:03.591977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:03.593862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:03.593862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:03.593862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:03.593862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:03.593862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:03.593862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:03.593862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:03.593862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:03.593862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:37:03.593862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:03.593862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 294/568] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Jul 11 15:37:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:03.593862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaceb7-1660-4f04-b698-e7c326db72be None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:03.593862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaceb7-1660-4f04-b698-e7c326db72be None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:03.594567 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaceb7-1660-4f04-b698-e7c326db72be None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:03.595555 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 295/569] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:03.597254 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaceb7-1660-4f04-b698-e7c326db72be None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:03.622529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88f068-7915-4722-b3d3-a6b46799225e None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:03.656404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7621180-d777-406b-a567-10c716538680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:03.657224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7621180-d777-406b-a567-10c716538680 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:03.657508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7621180-d777-406b-a567-10c716538680 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:03.657782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7621180-d777-406b-a567-10c716538680 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:03.669421 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7621180-d777-406b-a567-10c716538680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:03.672115 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7621180-d777-406b-a567-10c716538680 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-a7621180-d777-406b-a567-10c716538680 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:03.691665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:03.692653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:03.693736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:03.693736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:03.693736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:03.693736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:03.693736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 275/570] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:03.693736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7621180-d777-406b-a567-10c716538680 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:03.701611 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaceb7-1660-4f04-b698-e7c326db72be None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:03.736084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca61a2f-96f3-45cd-9721-04d11cbbd5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:03.736774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61a2f-96f3-45cd-9721-04d11cbbd5b6 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:03.737057 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61a2f-96f3-45cd-9721-04d11cbbd5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:03.737336 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61a2f-96f3-45cd-9721-04d11cbbd5b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:03.738218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca61a2f-96f3-45cd-9721-04d11cbbd5b6 None admin] RBAC: Adding query filter params (role.id=c8fd28e5c32f4759a288774fddec4493, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=8eaff8748f8b47e088e0cb7875992a4d) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:03.738532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca61a2f-96f3-45cd-9721-04d11cbbd5b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:03.739980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca61a2f-96f3-45cd-9721-04d11cbbd5b6 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:03.745497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 296/571] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:03 2022] GET /identity/v3/role_assignments?user.id=8eaff8748f8b47e088e0cb7875992a4d&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c8fd28e5c32f4759a288774fddec4493 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:03.746245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca61a2f-96f3-45cd-9721-04d11cbbd5b6 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:03.783662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:03.799429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:03.811252 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7621180-d777-406b-a567-10c716538680 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:03.850318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a8754-efad-4398-9992-b875e341113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:03.851322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a8754-efad-4398-9992-b875e341113d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:03.851646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a8754-efad-4398-9992-b875e341113d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:03.851919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a8754-efad-4398-9992-b875e341113d None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:03.852720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a8754-efad-4398-9992-b875e341113d None admin] RBAC: Adding query filter params (name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:03.853007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a8754-efad-4398-9992-b875e341113d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:03.854401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a8754-efad-4398-9992-b875e341113d None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:03.863944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 276/572] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:37:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:03.865312 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49478bfe-e9bd-43f3-b03c-145f5938f3ed None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:03.865591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49478bfe-e9bd-43f3-b03c-145f5938f3ed None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:03.865861 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49478bfe-e9bd-43f3-b03c-145f5938f3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:03.875502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca61a2f-96f3-45cd-9721-04d11cbbd5b6 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:03.883849 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-49478bfe-e9bd-43f3-b03c-145f5938f3ed None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:03.885137 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-49478bfe-e9bd-43f3-b03c-145f5938f3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:03.913157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5393453-f66f-424a-8918-6a6d2807b6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:03.913930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5393453-f66f-424a-8918-6a6d2807b6b6 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:03.914262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5393453-f66f-424a-8918-6a6d2807b6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:03.914531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5393453-f66f-424a-8918-6a6d2807b6b6 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:03.915459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5393453-f66f-424a-8918-6a6d2807b6b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:03.915728 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5393453-f66f-424a-8918-6a6d2807b6b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:03.917198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5393453-f66f-424a-8918-6a6d2807b6b6 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:03.940758 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 297/573] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Jul 11 15:37:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:03.940758 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5393453-f66f-424a-8918-6a6d2807b6b6 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:03.967406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 277/574] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:37:03.968901 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49478bfe-e9bd-43f3-b03c-145f5938f3ed None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:04.042433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:04.055646 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5393453-f66f-424a-8918-6a6d2807b6b6 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:04.058754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:04.076315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49478bfe-e9bd-43f3-b03c-145f5938f3ed None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:04.094526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a0042-bb8e-4c97-8559-5b8b6e8de61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:04.095196 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a0042-bb8e-4c97-8559-5b8b6e8de61e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:04.095478 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a0042-bb8e-4c97-8559-5b8b6e8de61e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:04.095752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a0042-bb8e-4c97-8559-5b8b6e8de61e None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:04.096516 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a0042-bb8e-4c97-8559-5b8b6e8de61e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:04.096824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a0042-bb8e-4c97-8559-5b8b6e8de61e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:04.098189 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a0042-bb8e-4c97-8559-5b8b6e8de61e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:04.110251 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 298/575] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:04.111008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a0042-bb8e-4c97-8559-5b8b6e8de61e None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:04.120444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee4936-f694-4de1-a0a6-3a0dd33686a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:04.121346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4936-f694-4de1-a0a6-3a0dd33686a1 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:04.121647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4936-f694-4de1-a0a6-3a0dd33686a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:04.121914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4936-f694-4de1-a0a6-3a0dd33686a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:04.132179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee4936-f694-4de1-a0a6-3a0dd33686a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:04.133685 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee4936-f694-4de1-a0a6-3a0dd33686a1 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-c4ee4936-f694-4de1-a0a6-3a0dd33686a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:04.151687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:04.152829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:04.153810 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:04.153810 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:04.153810 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:04.153810 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:04.157775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 278/576] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:04.158445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee4936-f694-4de1-a0a6-3a0dd33686a1 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:04.229858 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a0042-bb8e-4c97-8559-5b8b6e8de61e None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:04.266540 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4eac4-8c02-49f2-b20b-b81cbd3d94cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:04.267296 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4eac4-8c02-49f2-b20b-b81cbd3d94cc None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:04.267601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4eac4-8c02-49f2-b20b-b81cbd3d94cc None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:04.267865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4eac4-8c02-49f2-b20b-b81cbd3d94cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:04.269828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee4936-f694-4de1-a0a6-3a0dd33686a1 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:04.278786 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4eac4-8c02-49f2-b20b-b81cbd3d94cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:04.280779 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4eac4-8c02-49f2-b20b-b81cbd3d94cc None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:04.293156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-42e4eac4-8c02-49f2-b20b-b81cbd3d94cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:04.298259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:04.299145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:04.300021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:04.300021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:04.300021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:04.300021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:04.300021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 299/577] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:04.300614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4eac4-8c02-49f2-b20b-b81cbd3d94cc None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:04.311791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77d7c9-d0f3-4992-aa97-2a83ee100d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:04.312659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77d7c9-d0f3-4992-aa97-2a83ee100d35 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:04.313217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77d7c9-d0f3-4992-aa97-2a83ee100d35 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:04.313217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77d7c9-d0f3-4992-aa97-2a83ee100d35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:04.321950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:04.323800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77d7c9-d0f3-4992-aa97-2a83ee100d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-4b77d7c9-d0f3-4992-aa97-2a83ee100d35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:04.331911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:04.332866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:04.333691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:04.333691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:04.333691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:04.333691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:04.333691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:04.333691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:04.333691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:04.333691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:04.333691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:04.333691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:04.333691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:04.333691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:04.333691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 279/578] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:04.334393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77d7c9-d0f3-4992-aa97-2a83ee100d35 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:04.420365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4eac4-8c02-49f2-b20b-b81cbd3d94cc None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:04.446073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77d7c9-d0f3-4992-aa97-2a83ee100d35 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:04.454277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac87348-0b1a-4aad-a504-a038713a4f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:04.455168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87348-0b1a-4aad-a504-a038713a4f79 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:04.455458 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87348-0b1a-4aad-a504-a038713a4f79 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:04.455738 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87348-0b1a-4aad-a504-a038713a4f79 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:04.463921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac87348-0b1a-4aad-a504-a038713a4f79 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:04.465523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac87348-0b1a-4aad-a504-a038713a4f79 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-2ac87348-0b1a-4aad-a504-a038713a4f79 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:04.480277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:04.481430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:04.482697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:04.482697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:04.482697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:04.482697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:04.482697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:04.482697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:04.482697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:04.482697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:04.482697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 15:37:04.482697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:04.482697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 300/579] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:37:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:04.482697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac87348-0b1a-4aad-a504-a038713a4f79 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:04.489660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d91fac-16c7-4d99-b317-63e311a763d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:04.490343 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d91fac-16c7-4d99-b317-63e311a763d9 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:04.490630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d91fac-16c7-4d99-b317-63e311a763d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:04.490905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d91fac-16c7-4d99-b317-63e311a763d9 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:04.491650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d91fac-16c7-4d99-b317-63e311a763d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:04.491954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d91fac-16c7-4d99-b317-63e311a763d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:04.493808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d91fac-16c7-4d99-b317-63e311a763d9 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:04.511009 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 280/580] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:04.511009 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d91fac-16c7-4d99-b317-63e311a763d9 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:04.552818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:04.570425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:04.596061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac87348-0b1a-4aad-a504-a038713a4f79 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:04.612141 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d91fac-16c7-4d99-b317-63e311a763d9 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:04.631309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6edb4e-0956-478c-9d20-e718caa33cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:04.631973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6edb4e-0956-478c-9d20-e718caa33cc4 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:04.632255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6edb4e-0956-478c-9d20-e718caa33cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:04.632570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6edb4e-0956-478c-9d20-e718caa33cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:04.633804 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6edb4e-0956-478c-9d20-e718caa33cc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:04.634271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6edb4e-0956-478c-9d20-e718caa33cc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:04.636118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6edb4e-0956-478c-9d20-e718caa33cc4 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:04.648749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee06e20-df66-4d4f-8652-5067ab49570c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:04.649686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 301/581] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:04.649798 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06e20-df66-4d4f-8652-5067ab49570c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:04.649798 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06e20-df66-4d4f-8652-5067ab49570c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:04.650064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06e20-df66-4d4f-8652-5067ab49570c None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:04.650824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee06e20-df66-4d4f-8652-5067ab49570c None admin] RBAC: Adding query filter params (name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:04.651135 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee06e20-df66-4d4f-8652-5067ab49570c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:04.652573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee06e20-df66-4d4f-8652-5067ab49570c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:04.654853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6edb4e-0956-478c-9d20-e718caa33cc4 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:04.666470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 281/582] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:37:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:04.666470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee06e20-df66-4d4f-8652-5067ab49570c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:04.760790 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6edb4e-0956-478c-9d20-e718caa33cc4 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:04.770258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee06e20-df66-4d4f-8652-5067ab49570c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:04.772912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:04.797836 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7953bc-3a4f-471a-86f9-ff73cd87e7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:04.798510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7953bc-3a4f-471a-86f9-ff73cd87e7cc None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:04.798794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7953bc-3a4f-471a-86f9-ff73cd87e7cc None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:04.799069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7953bc-3a4f-471a-86f9-ff73cd87e7cc None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:04.800157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7953bc-3a4f-471a-86f9-ff73cd87e7cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:04.800498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7953bc-3a4f-471a-86f9-ff73cd87e7cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:04.802031 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7953bc-3a4f-471a-86f9-ff73cd87e7cc None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:04.804841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20b463-c54a-4224-9de7-345211a6dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:04.805639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20b463-c54a-4224-9de7-345211a6dd48 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:04.805856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:04.805964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20b463-c54a-4224-9de7-345211a6dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:04.806176 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20b463-c54a-4224-9de7-345211a6dd48 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:04.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20b463-c54a-4224-9de7-345211a6dd48 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:04.816655 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20b463-c54a-4224-9de7-345211a6dd48 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:04.828661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 302/583] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Jul 11 15:37:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:04.828661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7953bc-3a4f-471a-86f9-ff73cd87e7cc None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-ef20b463-c54a-4224-9de7-345211a6dd48 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:04.831735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:04.832857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:04.838845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:04.838845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:04.838845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:04.838845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:04.838845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:04.838845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:04.838845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:04.838845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:04.838845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:37:04.838845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:04.838845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 282/584] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:37:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:04.838845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20b463-c54a-4224-9de7-345211a6dd48 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:04.943145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7953bc-3a4f-471a-86f9-ff73cd87e7cc None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:04.944466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20b463-c54a-4224-9de7-345211a6dd48 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:04.980072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe9f34-4ba3-470f-b211-538d4a88bd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:04.980904 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe9f34-4ba3-470f-b211-538d4a88bd42 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:04.981188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe9f34-4ba3-470f-b211-538d4a88bd42 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:04.981464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe9f34-4ba3-470f-b211-538d4a88bd42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:04.982485 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789de3b-4731-4097-97c7-53a35b3bdcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:04.983368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789de3b-4731-4097-97c7-53a35b3bdcd2 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:04.983649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789de3b-4731-4097-97c7-53a35b3bdcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:04.983922 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789de3b-4731-4097-97c7-53a35b3bdcd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:04.988736 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe9f34-4ba3-470f-b211-538d4a88bd42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:04.990200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe9f34-4ba3-470f-b211-538d4a88bd42 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:04.995142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789de3b-4731-4097-97c7-53a35b3bdcd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:04.996680 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789de3b-4731-4097-97c7-53a35b3bdcd2 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-32fe9f34-4ba3-470f-b211-538d4a88bd42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:05.004006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:05.004920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:05.005801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:05.005801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:05.005801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:05.005801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:05.005801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:05.005801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:05.005801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:05.005801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:05.005801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 303/585] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:05.007132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe9f34-4ba3-470f-b211-538d4a88bd42 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-f789de3b-4731-4097-97c7-53a35b3bdcd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:05.019184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:05.020195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:05.021279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:05.021279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:05.021279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:05.021279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:05.028931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 283/586] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:05.029953 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789de3b-4731-4097-97c7-53a35b3bdcd2 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:05.051325 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:05.069648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:05.126582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe9f34-4ba3-470f-b211-538d4a88bd42 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:05.150380 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789de3b-4731-4097-97c7-53a35b3bdcd2 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:05.165248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9eb4b-e5b8-4753-8103-5c06dc76ddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:05.166125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9eb4b-e5b8-4753-8103-5c06dc76ddd2 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:05.166464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9eb4b-e5b8-4753-8103-5c06dc76ddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:05.166800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9eb4b-e5b8-4753-8103-5c06dc76ddd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:05.179666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9eb4b-e5b8-4753-8103-5c06dc76ddd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:05.181870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9eb4b-e5b8-4753-8103-5c06dc76ddd2 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:05.195390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fc056-a461-4630-acf2-4ba7b03a9a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:05.195390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fc056-a461-4630-acf2-4ba7b03a9a0a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:05.197924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fc056-a461-4630-acf2-4ba7b03a9a0a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:05.198221 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fc056-a461-4630-acf2-4ba7b03a9a0a None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:05.199405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fc056-a461-4630-acf2-4ba7b03a9a0a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:05.199723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fc056-a461-4630-acf2-4ba7b03a9a0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:05.201236 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fc056-a461-4630-acf2-4ba7b03a9a0a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-7de9eb4b-e5b8-4753-8103-5c06dc76ddd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:05.208963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:05.209931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:05.210802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:05.210802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:05.210802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:05.210802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:05.212432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 304/587] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:05.213360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9eb4b-e5b8-4753-8103-5c06dc76ddd2 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:05.225656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 284/588] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Jul 11 15:37:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:05.226631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fc056-a461-4630-acf2-4ba7b03a9a0a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:05.328853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:05.351362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9eb4b-e5b8-4753-8103-5c06dc76ddd2 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:05.355311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fc056-a461-4630-acf2-4ba7b03a9a0a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:05.360064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:05.394223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c3bb1-df31-4635-8be2-d6cf1a997ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:05.394913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c3bb1-df31-4635-8be2-d6cf1a997ba8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:05.395303 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c3bb1-df31-4635-8be2-d6cf1a997ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:05.395538 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c3bb1-df31-4635-8be2-d6cf1a997ba8 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:05.396495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c3bb1-df31-4635-8be2-d6cf1a997ba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:05.396966 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c3bb1-df31-4635-8be2-d6cf1a997ba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:05.398430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c3bb1-df31-4635-8be2-d6cf1a997ba8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:05.398621 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb4c71-ae11-4b16-a5cd-54316fb0bc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:05.399292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb4c71-ae11-4b16-a5cd-54316fb0bc41 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:05.399575 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb4c71-ae11-4b16-a5cd-54316fb0bc41 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:05.399851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb4c71-ae11-4b16-a5cd-54316fb0bc41 None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:05.403669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb4c71-ae11-4b16-a5cd-54316fb0bc41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:05.403990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb4c71-ae11-4b16-a5cd-54316fb0bc41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:05.405741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb4c71-ae11-4b16-a5cd-54316fb0bc41 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:05.416077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 285/589] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:05.417130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c3bb1-df31-4635-8be2-d6cf1a997ba8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:05.425257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 305/590] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:05.426921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb4c71-ae11-4b16-a5cd-54316fb0bc41 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:05.539982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c3bb1-df31-4635-8be2-d6cf1a997ba8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:05.544831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb4c71-ae11-4b16-a5cd-54316fb0bc41 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:05.574818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb13ab6-2c22-4705-a9ea-e16d230956b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:05.575714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13ab6-2c22-4705-a9ea-e16d230956b8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:05.575996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13ab6-2c22-4705-a9ea-e16d230956b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:05.576415 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13ab6-2c22-4705-a9ea-e16d230956b8 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:05.577283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb13ab6-2c22-4705-a9ea-e16d230956b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:05.577590 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb13ab6-2c22-4705-a9ea-e16d230956b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:05.578979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb13ab6-2c22-4705-a9ea-e16d230956b8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:05.580652 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:05.581749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3acb2-72ea-4cb2-8dd1-d1b221e82a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:05.582663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3acb2-72ea-4cb2-8dd1-d1b221e82a62 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:05.583022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3acb2-72ea-4cb2-8dd1-d1b221e82a62 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:05.583247 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3acb2-72ea-4cb2-8dd1-d1b221e82a62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:05.594515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3acb2-72ea-4cb2-8dd1-d1b221e82a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:05.595978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3acb2-72ea-4cb2-8dd1-d1b221e82a62 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:05.597283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 286/591] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:05.598169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb13ab6-2c22-4705-a9ea-e16d230956b8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-1ab3acb2-72ea-4cb2-8dd1-d1b221e82a62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:05.613569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:05.614673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:05.615564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:05.615564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:05.615564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:05.615564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:05.615564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 306/592] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:05.615564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3acb2-72ea-4cb2-8dd1-d1b221e82a62 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:05.636082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:05.713360 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb13ab6-2c22-4705-a9ea-e16d230956b8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:05.717105 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3acb2-72ea-4cb2-8dd1-d1b221e82a62 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:05.749364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dcd59-32f9-4556-a41f-12fa0e795d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:05.750258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dcd59-32f9-4556-a41f-12fa0e795d92 None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:05.750543 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dcd59-32f9-4556-a41f-12fa0e795d92 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:05.750814 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dcd59-32f9-4556-a41f-12fa0e795d92 None admin] PATH_INFO: `/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/fa038a2e30f544aaa609d32e0e1ceaa0/roles/c8fd28e5c32f4759a288774fddec4493` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:05.751889 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7a250-9ac5-462d-aa00-0d727f2b8766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:05.752870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7a250-9ac5-462d-aa00-0d727f2b8766 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:05.753406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7a250-9ac5-462d-aa00-0d727f2b8766 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:05.753823 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7a250-9ac5-462d-aa00-0d727f2b8766 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:05.761726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7a250-9ac5-462d-aa00-0d727f2b8766 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:05.763579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7a250-9ac5-462d-aa00-0d727f2b8766 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:05.766091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dcd59-32f9-4556-a41f-12fa0e795d92 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fe17aeb94ad42dc990c9d963dac9af6, user_id=fa038a2e30f544aaa609d32e0e1ceaa0, role_id=c8fd28e5c32f4759a288774fddec4493)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:05.767545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dcd59-32f9-4556-a41f-12fa0e795d92 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-00d7a250-9ac5-462d-aa00-0d727f2b8766 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:05.779582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:05.780899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:05.781826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:05.781826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:05.781826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:05.781826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:05.781826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:05.781826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:05.781826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:05.781826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:05.781826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 15:37:05.781826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:05.781826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 287/593] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:05.782405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 307/594] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:37:05 2022] PUT /identity/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/fa038a2e30f544aaa609d32e0e1ceaa0/roles/c8fd28e5c32f4759a288774fddec4493 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:37:05.782405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dcd59-32f9-4556-a41f-12fa0e795d92 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:05.785240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7a250-9ac5-462d-aa00-0d727f2b8766 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:05.849554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:05.868777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:05.904469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7a250-9ac5-462d-aa00-0d727f2b8766 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:05.909507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dcd59-32f9-4556-a41f-12fa0e795d92 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:05.948104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23b918-5efa-4072-8d7d-c38997487652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:05.948919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23b918-5efa-4072-8d7d-c38997487652 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:05.949204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23b918-5efa-4072-8d7d-c38997487652 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:05.949477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23b918-5efa-4072-8d7d-c38997487652 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:05.951835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053eda3b-b3db-4fec-a892-a68f53f91770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:05.952550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053eda3b-b3db-4fec-a892-a68f53f91770 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:05.952838 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053eda3b-b3db-4fec-a892-a68f53f91770 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:05.953118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053eda3b-b3db-4fec-a892-a68f53f91770 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:05.953894 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053eda3b-b3db-4fec-a892-a68f53f91770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:05.954200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053eda3b-b3db-4fec-a892-a68f53f91770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:05.955625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053eda3b-b3db-4fec-a892-a68f53f91770 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:05.957585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23b918-5efa-4072-8d7d-c38997487652 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:05.959054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23b918-5efa-4072-8d7d-c38997487652 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:05.968518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 308/595] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:05.969754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ae590-b754-468d-850d-3c481c4383d0 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:05.970045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ae590-b754-468d-850d-3c481c4383d0 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:05.970323 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ae590-b754-468d-850d-3c481c4383d0 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:05.971811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 309/596] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:05.972536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ae590-b754-468d-850d-3c481c4383d0 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-7e23b918-5efa-4072-8d7d-c38997487652 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:05.973796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:05.974635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:05.975518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:05.975518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:05.975518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:05.975518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:05.975518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:05.975518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:05.975518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:05.975518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:05.975518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 288/597] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:05.978999 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23b918-5efa-4072-8d7d-c38997487652 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:06.079955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ae590-b754-468d-850d-3c481c4383d0 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:06.085538 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23b918-5efa-4072-8d7d-c38997487652 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:06.100259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:06.108364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:06.117310 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75554bd-ffa6-4282-9a51-9d0759b94d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:06.117993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75554bd-ffa6-4282-9a51-9d0759b94d43 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:06.118275 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75554bd-ffa6-4282-9a51-9d0759b94d43 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:06.118556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75554bd-ffa6-4282-9a51-9d0759b94d43 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:06.119434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75554bd-ffa6-4282-9a51-9d0759b94d43 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:06.119752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75554bd-ffa6-4282-9a51-9d0759b94d43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:06.121227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75554bd-ffa6-4282-9a51-9d0759b94d43 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:06.124070 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bf006-3117-405a-9b4c-ee9a6d6a4e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:06.124915 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bf006-3117-405a-9b4c-ee9a6d6a4e83 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:06.125202 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bf006-3117-405a-9b4c-ee9a6d6a4e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:06.125533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bf006-3117-405a-9b4c-ee9a6d6a4e83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:06.132504 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bf006-3117-405a-9b4c-ee9a6d6a4e83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:06.133951 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bf006-3117-405a-9b4c-ee9a6d6a4e83 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:06.144352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 310/598] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Jul 11 15:37:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:06.144352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902da3-a124-4efe-952d-79152ea7de8d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:06.144352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902da3-a124-4efe-952d-79152ea7de8d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:06.144352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902da3-a124-4efe-952d-79152ea7de8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-b92bf006-3117-405a-9b4c-ee9a6d6a4e83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:06.153478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:06.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:06.155317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:06.155317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:06.155317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:06.155317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:06.155317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:06.155317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:06.155317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:06.155317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:06.155317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 289/599] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:06.156501 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bf006-3117-405a-9b4c-ee9a6d6a4e83 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:06.163293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-4b902da3-a124-4efe-952d-79152ea7de8d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:06.164538 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4b902da3-a124-4efe-952d-79152ea7de8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:06.233253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 311/600] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:37:06.233993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902da3-a124-4efe-952d-79152ea7de8d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:06.273194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bf006-3117-405a-9b4c-ee9a6d6a4e83 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:06.308214 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fcb75-111c-46f3-a76a-46f3e2280fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:06.308913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fcb75-111c-46f3-a76a-46f3e2280fe9 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:06.309198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fcb75-111c-46f3-a76a-46f3e2280fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:06.309473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fcb75-111c-46f3-a76a-46f3e2280fe9 None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:06.310273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fcb75-111c-46f3-a76a-46f3e2280fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:06.310586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fcb75-111c-46f3-a76a-46f3e2280fe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:06.312261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fcb75-111c-46f3-a76a-46f3e2280fe9 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:06.324157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 290/601] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:06.324997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fcb75-111c-46f3-a76a-46f3e2280fe9 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:06.346592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902da3-a124-4efe-952d-79152ea7de8d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:06.359660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:06.365198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:06.384875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99f138-b1b3-4b89-9f4e-7e88b6b77c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:06.385670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99f138-b1b3-4b89-9f4e-7e88b6b77c9b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:06.385947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99f138-b1b3-4b89-9f4e-7e88b6b77c9b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:06.386219 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99f138-b1b3-4b89-9f4e-7e88b6b77c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:06.396475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99f138-b1b3-4b89-9f4e-7e88b6b77c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:06.397946 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99f138-b1b3-4b89-9f4e-7e88b6b77c9b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-1e99f138-b1b3-4b89-9f4e-7e88b6b77c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:06.415743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:06.416717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:06.417587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:06.417587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:06.417587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:06.417587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:06.422001 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 312/602] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:06.422859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99f138-b1b3-4b89-9f4e-7e88b6b77c9b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:06.429866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fcb75-111c-46f3-a76a-46f3e2280fe9 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:06.464519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc38b5-6c2e-4bd8-8023-e904fde4e89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:06.465192 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc38b5-6c2e-4bd8-8023-e904fde4e89c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:06.465477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc38b5-6c2e-4bd8-8023-e904fde4e89c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:06.465756 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc38b5-6c2e-4bd8-8023-e904fde4e89c None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:06.466553 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc38b5-6c2e-4bd8-8023-e904fde4e89c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:06.466864 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc38b5-6c2e-4bd8-8023-e904fde4e89c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:06.468408 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc38b5-6c2e-4bd8-8023-e904fde4e89c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:06.485433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 291/603] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:06.485433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc38b5-6c2e-4bd8-8023-e904fde4e89c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:06.539698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99f138-b1b3-4b89-9f4e-7e88b6b77c9b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:06.579967 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a92f40-f240-49e9-8771-af8421c09b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:06.580886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a92f40-f240-49e9-8771-af8421c09b6d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:06.581346 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a92f40-f240-49e9-8771-af8421c09b6d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:06.581454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a92f40-f240-49e9-8771-af8421c09b6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:06.583955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:06.592478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc38b5-6c2e-4bd8-8023-e904fde4e89c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:06.593359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a92f40-f240-49e9-8771-af8421c09b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-99a92f40-f240-49e9-8771-af8421c09b6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:06.601049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:06.602170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:06.603238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:06.603238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:06.603238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:06.603238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:06.603238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:06.603238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:06.603238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:06.603238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:06.603238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:06.603238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:06.603238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:06.603238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:06.604369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 313/604] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:06.605047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a92f40-f240-49e9-8771-af8421c09b6d None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:06.634688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:06.637318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65328e-bf5f-4c23-ad14-1c0f6e8de6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:06.638326 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65328e-bf5f-4c23-ad14-1c0f6e8de6b6 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:06.638676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65328e-bf5f-4c23-ad14-1c0f6e8de6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:06.639016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65328e-bf5f-4c23-ad14-1c0f6e8de6b6 None admin] PATH_INFO: `/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/3be29cfa76174b44b99ddaf3d293ead1/roles/c8fd28e5c32f4759a288774fddec4493` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:06.654420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65328e-bf5f-4c23-ad14-1c0f6e8de6b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fe17aeb94ad42dc990c9d963dac9af6, user_id=3be29cfa76174b44b99ddaf3d293ead1, role_id=c8fd28e5c32f4759a288774fddec4493)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:06.656077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65328e-bf5f-4c23-ad14-1c0f6e8de6b6 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:06.670460 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 292/605] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:37:06 2022] PUT /identity/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/3be29cfa76174b44b99ddaf3d293ead1/roles/c8fd28e5c32f4759a288774fddec4493 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:37:06.671231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65328e-bf5f-4c23-ad14-1c0f6e8de6b6 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:06.732154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a92f40-f240-49e9-8771-af8421c09b6d None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:06.774779 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee185f9-0e65-4f4c-8c10-316e73bd42df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:06.774979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee185f9-0e65-4f4c-8c10-316e73bd42df None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:06.775307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee185f9-0e65-4f4c-8c10-316e73bd42df None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:06.775654 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee185f9-0e65-4f4c-8c10-316e73bd42df None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:06.776510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee185f9-0e65-4f4c-8c10-316e73bd42df None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:06.776884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee185f9-0e65-4f4c-8c10-316e73bd42df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:06.778480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee185f9-0e65-4f4c-8c10-316e73bd42df None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:06.792981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 314/606] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:06.794140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee185f9-0e65-4f4c-8c10-316e73bd42df None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:06.816655 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65328e-bf5f-4c23-ad14-1c0f6e8de6b6 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:06.865806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce671e48-2875-4166-b495-5ee451572ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:06.866801 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671e48-2875-4166-b495-5ee451572ae5 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:06.867153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671e48-2875-4166-b495-5ee451572ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:06.867499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671e48-2875-4166-b495-5ee451572ae5 None admin] PATH_INFO: `/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/73732594dbee480e9e5d153ca1382494/roles/c8fd28e5c32f4759a288774fddec4493` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:06.886861 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce671e48-2875-4166-b495-5ee451572ae5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fe17aeb94ad42dc990c9d963dac9af6, user_id=73732594dbee480e9e5d153ca1382494, role_id=c8fd28e5c32f4759a288774fddec4493)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:06.888421 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce671e48-2875-4166-b495-5ee451572ae5 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:06.891311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:06.897505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:06.906187 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 293/607] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:37:06 2022] PUT /identity/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/73732594dbee480e9e5d153ca1382494/roles/c8fd28e5c32f4759a288774fddec4493 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:37:06.908524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce671e48-2875-4166-b495-5ee451572ae5 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:06.929113 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee185f9-0e65-4f4c-8c10-316e73bd42df None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:06.979053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66265066-8762-4778-a1a0-8c5eec4dd172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:06.979820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66265066-8762-4778-a1a0-8c5eec4dd172 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:06.980098 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66265066-8762-4778-a1a0-8c5eec4dd172 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:06.980441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66265066-8762-4778-a1a0-8c5eec4dd172 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:06.981202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66265066-8762-4778-a1a0-8c5eec4dd172 None admin] RBAC: Adding query filter params (name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:06.981505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66265066-8762-4778-a1a0-8c5eec4dd172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:06.983030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66265066-8762-4778-a1a0-8c5eec4dd172 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:06.996315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 315/608] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:37:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:06.998388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66265066-8762-4778-a1a0-8c5eec4dd172 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:07.054726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce671e48-2875-4166-b495-5ee451572ae5 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:07.142542 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4825d-0cbe-438e-89a0-33dac2e537a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:07.143112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4825d-0cbe-438e-89a0-33dac2e537a5 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:07.143397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4825d-0cbe-438e-89a0-33dac2e537a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:07.143669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4825d-0cbe-438e-89a0-33dac2e537a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:07.149871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66265066-8762-4778-a1a0-8c5eec4dd172 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:07.153487 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4825d-0cbe-438e-89a0-33dac2e537a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:07.154028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4825d-0cbe-438e-89a0-33dac2e537a5 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-b2d4825d-0cbe-438e-89a0-33dac2e537a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:07.174601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:07.175629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:07.176530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:07.176530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:07.176530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:07.176530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:07.176530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:07.176530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:07.176530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:07.176530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:07.176530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 294/609] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:07.182673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4825d-0cbe-438e-89a0-33dac2e537a5 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:07.215095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4c605-3095-429c-ab1b-030ce7981958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:07.216023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4c605-3095-429c-ab1b-030ce7981958 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:07.216224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4c605-3095-429c-ab1b-030ce7981958 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:07.220593 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4c605-3095-429c-ab1b-030ce7981958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:07.241428 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4c605-3095-429c-ab1b-030ce7981958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:07.242922 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4c605-3095-429c-ab1b-030ce7981958 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:07.253561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-19e4c605-3095-429c-ab1b-030ce7981958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:07.274417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:07.275369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:07.276267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:07.276267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:07.276267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:07.276267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:07.284748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 316/610] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:07.292603 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4c605-3095-429c-ab1b-030ce7981958 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:07.298582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:07.315312 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4825d-0cbe-438e-89a0-33dac2e537a5 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:07.353944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae6837-e237-4155-a38e-d8abe15b646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:07.355008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae6837-e237-4155-a38e-d8abe15b646b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:07.355492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae6837-e237-4155-a38e-d8abe15b646b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:07.355960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae6837-e237-4155-a38e-d8abe15b646b None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:07.357677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae6837-e237-4155-a38e-d8abe15b646b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:07.358223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae6837-e237-4155-a38e-d8abe15b646b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:07.360017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae6837-e237-4155-a38e-d8abe15b646b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:07.374722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 295/611] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:07.386280 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae6837-e237-4155-a38e-d8abe15b646b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:07.523043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4c605-3095-429c-ab1b-030ce7981958 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:07.549736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae6837-e237-4155-a38e-d8abe15b646b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:07.558660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a7f10-430e-4db0-ad65-954619ff70e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:07.559986 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a7f10-430e-4db0-ad65-954619ff70e6 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:07.560514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a7f10-430e-4db0-ad65-954619ff70e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:07.561015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a7f10-430e-4db0-ad65-954619ff70e6 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:07.561965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a7f10-430e-4db0-ad65-954619ff70e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:07.562484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a7f10-430e-4db0-ad65-954619ff70e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:07.564067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a7f10-430e-4db0-ad65-954619ff70e6 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:07.577069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 317/612] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:07.582664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a7f10-430e-4db0-ad65-954619ff70e6 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:07.583177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:07.595770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d854f-2095-4c4a-bf42-6116fb9f2fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:07.596943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d854f-2095-4c4a-bf42-6116fb9f2fc8 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:07.597506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d854f-2095-4c4a-bf42-6116fb9f2fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:07.597614 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d854f-2095-4c4a-bf42-6116fb9f2fc8 None admin] PATH_INFO: `/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/44a4d0441d4a423884d7adef45e2641f/roles/c8fd28e5c32f4759a288774fddec4493` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:07.628876 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d854f-2095-4c4a-bf42-6116fb9f2fc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fe17aeb94ad42dc990c9d963dac9af6, user_id=44a4d0441d4a423884d7adef45e2641f, role_id=c8fd28e5c32f4759a288774fddec4493)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:07.630506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d854f-2095-4c4a-bf42-6116fb9f2fc8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:07.664496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 296/613] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:37:07 2022] PUT /identity/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/44a4d0441d4a423884d7adef45e2641f/roles/c8fd28e5c32f4759a288774fddec4493 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:37:07.668824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:07.725190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a7f10-430e-4db0-ad65-954619ff70e6 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:07.777099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc04843-a26e-445d-91b7-3e09a0c3bd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:07.777926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc04843-a26e-445d-91b7-3e09a0c3bd20 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:07.778207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc04843-a26e-445d-91b7-3e09a0c3bd20 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:07.778480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc04843-a26e-445d-91b7-3e09a0c3bd20 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:07.786999 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc04843-a26e-445d-91b7-3e09a0c3bd20 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:07.788492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc04843-a26e-445d-91b7-3e09a0c3bd20 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-2bc04843-a26e-445d-91b7-3e09a0c3bd20 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:07.812523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:07.813560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:07.814498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:07.814498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:07.814498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:07.814498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:07.814498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:07.814498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:07.814498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:07.814498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:07.814498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:37:07.814498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:07.814498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 318/614] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:37:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:07.821619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d854f-2095-4c4a-bf42-6116fb9f2fc8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:07.840500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaae4c-2aa9-46be-954b-ef21945656f1 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:07.840796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaae4c-2aa9-46be-954b-ef21945656f1 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:07.840990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaae4c-2aa9-46be-954b-ef21945656f1 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:07.842696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 319/615] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:07.852329 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17c2c4-0b6b-4965-bd82-f12089cdad98 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:07.852682 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17c2c4-0b6b-4965-bd82-f12089cdad98 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:07.852903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17c2c4-0b6b-4965-bd82-f12089cdad98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:07.887564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-cf17c2c4-0b6b-4965-bd82-f12089cdad98 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:07.888848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-cf17c2c4-0b6b-4965-bd82-f12089cdad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:08.007087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d854f-2095-4c4a-bf42-6116fb9f2fc8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:08.010579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 320/616] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 11 15:37:08.036645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17c2c4-0b6b-4965-bd82-f12089cdad98 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:08.055476 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2281c-9ca4-4f63-ba33-44555562e221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:08.056182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2281c-9ca4-4f63-ba33-44555562e221 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:08.056502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2281c-9ca4-4f63-ba33-44555562e221 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:08.056782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2281c-9ca4-4f63-ba33-44555562e221 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:08.057655 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2281c-9ca4-4f63-ba33-44555562e221 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:08.057974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2281c-9ca4-4f63-ba33-44555562e221 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:08.059456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2281c-9ca4-4f63-ba33-44555562e221 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:08.089531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 297/617] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Jul 11 15:37:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:08.097790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2281c-9ca4-4f63-ba33-44555562e221 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:08.128915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:08.146646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:08.232157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17c2c4-0b6b-4965-bd82-f12089cdad98 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:08.275153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd919c-f512-4acb-8e64-2412f3abac76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:08.276152 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd919c-f512-4acb-8e64-2412f3abac76 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:08.276541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd919c-f512-4acb-8e64-2412f3abac76 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:08.276886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd919c-f512-4acb-8e64-2412f3abac76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:08.290701 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd919c-f512-4acb-8e64-2412f3abac76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-73cd919c-f512-4acb-8e64-2412f3abac76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:08.299590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:08.300640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:08.301470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:08.301470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:08.301470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:08.301470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:08.301470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:08.301470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:08.301470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:08.301470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:08.301470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:08.301470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:08.301470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:08.301470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:08.301470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 321/618] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:08.307506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd919c-f512-4acb-8e64-2412f3abac76 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:08.325464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2281c-9ca4-4f63-ba33-44555562e221 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:08.392045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3ce62-dea0-42cf-8f2e-14b25512b2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:08.392810 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3ce62-dea0-42cf-8f2e-14b25512b2b7 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:08.393094 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3ce62-dea0-42cf-8f2e-14b25512b2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:08.393434 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3ce62-dea0-42cf-8f2e-14b25512b2b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:08.414445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3ce62-dea0-42cf-8f2e-14b25512b2b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:08.416268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3ce62-dea0-42cf-8f2e-14b25512b2b7 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-d5c3ce62-dea0-42cf-8f2e-14b25512b2b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:08.444916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:08.445850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:08.446897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:08.446897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:08.446897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:08.446897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:08.446897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 298/619] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:08.447688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3ce62-dea0-42cf-8f2e-14b25512b2b7 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:08.479035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd919c-f512-4acb-8e64-2412f3abac76 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:08.500428 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:08.544965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:08.548336 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3226f-e3b8-47d6-8db3-b398c33ebdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:08.548748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3226f-e3b8-47d6-8db3-b398c33ebdfa None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:08.549034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3226f-e3b8-47d6-8db3-b398c33ebdfa None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:08.549309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3226f-e3b8-47d6-8db3-b398c33ebdfa None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:08.550082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3226f-e3b8-47d6-8db3-b398c33ebdfa None admin] RBAC: Adding query filter params (name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:08.550390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3226f-e3b8-47d6-8db3-b398c33ebdfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:08.551903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3226f-e3b8-47d6-8db3-b398c33ebdfa None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:08.560844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 322/620] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:37:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:08.566198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3226f-e3b8-47d6-8db3-b398c33ebdfa None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:08.583719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3ce62-dea0-42cf-8f2e-14b25512b2b7 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:08.635794 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942e46c-9840-406e-b81f-b34aafb46bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:08.637307 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942e46c-9840-406e-b81f-b34aafb46bbe None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:08.637793 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942e46c-9840-406e-b81f-b34aafb46bbe None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:08.638265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942e46c-9840-406e-b81f-b34aafb46bbe None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:08.639373 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942e46c-9840-406e-b81f-b34aafb46bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:08.639909 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942e46c-9840-406e-b81f-b34aafb46bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:08.641547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942e46c-9840-406e-b81f-b34aafb46bbe None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:08.654594 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 299/621] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:08.660373 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942e46c-9840-406e-b81f-b34aafb46bbe None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:08.767892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942e46c-9840-406e-b81f-b34aafb46bbe None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:08.772146 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3226f-e3b8-47d6-8db3-b398c33ebdfa None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:08.804031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdb12c-47c7-4791-8b1f-d6f1056d848a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:08.805249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb12c-47c7-4791-8b1f-d6f1056d848a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:08.805734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb12c-47c7-4791-8b1f-d6f1056d848a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:08.806228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb12c-47c7-4791-8b1f-d6f1056d848a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:08.814236 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdb12c-47c7-4791-8b1f-d6f1056d848a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:08.816032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdb12c-47c7-4791-8b1f-d6f1056d848a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-71cdb12c-47c7-4791-8b1f-d6f1056d848a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:08.833238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:08.834208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:08.835095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:08.835095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:08.835095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:08.835095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:08.835095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:08.835095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:08.835095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:08.835095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:08.838205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 300/622] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:08.842973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:08.844183 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdb12c-47c7-4791-8b1f-d6f1056d848a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:08.869020 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19815344-84f9-4948-8e75-d705d1875026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:08.869851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815344-84f9-4948-8e75-d705d1875026 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:08.870136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815344-84f9-4948-8e75-d705d1875026 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:08.870410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815344-84f9-4948-8e75-d705d1875026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:08.901658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19815344-84f9-4948-8e75-d705d1875026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:08.903144 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19815344-84f9-4948-8e75-d705d1875026 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-19815344-84f9-4948-8e75-d705d1875026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:08.948423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:08.949366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:08.950259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:08.950259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:08.950259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:08.950259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:08.950259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 323/623] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:08.954197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdb12c-47c7-4791-8b1f-d6f1056d848a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:08.961340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19815344-84f9-4948-8e75-d705d1875026 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:08.997396 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2856d5f-2068-43ae-a051-55a7af290e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:08.999964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2856d5f-2068-43ae-a051-55a7af290e38 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:09.001854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2856d5f-2068-43ae-a051-55a7af290e38 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:09.002363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2856d5f-2068-43ae-a051-55a7af290e38 None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:09.003383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2856d5f-2068-43ae-a051-55a7af290e38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:09.004973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2856d5f-2068-43ae-a051-55a7af290e38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:09.006667 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2856d5f-2068-43ae-a051-55a7af290e38 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:09.024360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:09.036359 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 301/624] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:09.053012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2856d5f-2068-43ae-a051-55a7af290e38 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:09.142255 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:09.146194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19815344-84f9-4948-8e75-d705d1875026 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:09.183631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb080d97-45c4-46cb-8b9e-5a853c7b706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:09.184450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb080d97-45c4-46cb-8b9e-5a853c7b706d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:09.185227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb080d97-45c4-46cb-8b9e-5a853c7b706d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:09.185227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb080d97-45c4-46cb-8b9e-5a853c7b706d None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:09.186316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb080d97-45c4-46cb-8b9e-5a853c7b706d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:09.186425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb080d97-45c4-46cb-8b9e-5a853c7b706d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:09.187872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb080d97-45c4-46cb-8b9e-5a853c7b706d None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:09.203272 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2856d5f-2068-43ae-a051-55a7af290e38 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:09.204556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 324/625] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:09.206299 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62971c-98c4-499c-afe9-77142d6dc026 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:09.206595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62971c-98c4-499c-afe9-77142d6dc026 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:09.206881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62971c-98c4-499c-afe9-77142d6dc026 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:09.209805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 325/626] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:09.210535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62971c-98c4-499c-afe9-77142d6dc026 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:09.247309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88e6d0-1dc6-4ca6-a7bc-dcfae561c657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:09.248670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88e6d0-1dc6-4ca6-a7bc-dcfae561c657 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:09.248983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88e6d0-1dc6-4ca6-a7bc-dcfae561c657 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:09.249265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88e6d0-1dc6-4ca6-a7bc-dcfae561c657 None admin] PATH_INFO: `/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/8eaff8748f8b47e088e0cb7875992a4d/roles/c8fd28e5c32f4759a288774fddec4493` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:09.266338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88e6d0-1dc6-4ca6-a7bc-dcfae561c657 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fe17aeb94ad42dc990c9d963dac9af6, user_id=8eaff8748f8b47e088e0cb7875992a4d, role_id=c8fd28e5c32f4759a288774fddec4493)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:09.268010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88e6d0-1dc6-4ca6-a7bc-dcfae561c657 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:09.289040 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 302/627] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:37:09 2022] PUT /identity/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/8eaff8748f8b47e088e0cb7875992a4d/roles/c8fd28e5c32f4759a288774fddec4493 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:37:09.291390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b82e-75a3-4e85-a0ce-a139d8ace0ec None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:09.291732 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b82e-75a3-4e85-a0ce-a139d8ace0ec None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:09.292018 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b82e-75a3-4e85-a0ce-a139d8ace0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:09.318928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:09.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-53e1b82e-75a3-4e85-a0ce-a139d8ace0ec None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:09.321917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-53e1b82e-75a3-4e85-a0ce-a139d8ace0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:09.342369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62971c-98c4-499c-afe9-77142d6dc026 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:09.388562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84136604-ce84-42f5-b809-04425f7e2b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:09.389486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84136604-ce84-42f5-b809-04425f7e2b63 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:09.389759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84136604-ce84-42f5-b809-04425f7e2b63 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:09.390032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84136604-ce84-42f5-b809-04425f7e2b63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:09.398684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84136604-ce84-42f5-b809-04425f7e2b63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:09.400340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84136604-ce84-42f5-b809-04425f7e2b63 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-84136604-ce84-42f5-b809-04425f7e2b63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:09.419450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:09.420638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:09.421670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:09.421670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:09.421670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:09.421670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:09.421670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:09.421670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:09.421670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:09.421670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:09.421670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:37:09.421670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:09.428378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 326/629] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Jul 11 15:37:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:09.428378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f064be-243a-49d8-8fc3-ad3e97f745b4 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:09.428378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f064be-243a-49d8-8fc3-ad3e97f745b4 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:09.428378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f064be-243a-49d8-8fc3-ad3e97f745b4 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:09.429075 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 303/629] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:37:09.437557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 327/630] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:09.439230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1b82e-75a3-4e85-a0ce-a139d8ace0ec None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:09.440625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc4654-c0a6-43a0-87fa-958438f20e0c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:09.440936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc4654-c0a6-43a0-87fa-958438f20e0c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:09.441349 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc4654-c0a6-43a0-87fa-958438f20e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:09.470554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-dbfc4654-c0a6-43a0-87fa-958438f20e0c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:09.471686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-dbfc4654-c0a6-43a0-87fa-958438f20e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:09.484123 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:09.556520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 328/631] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:37:09.557405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc4654-c0a6-43a0-87fa-958438f20e0c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:09.567779 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1b82e-75a3-4e85-a0ce-a139d8ace0ec None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:09.613363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfae0c9-b70b-4eb5-8ce5-a22d14875f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:09.614426 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfae0c9-b70b-4eb5-8ce5-a22d14875f6b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:09.614845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfae0c9-b70b-4eb5-8ce5-a22d14875f6b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:09.615309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfae0c9-b70b-4eb5-8ce5-a22d14875f6b None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:09.616703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfae0c9-b70b-4eb5-8ce5-a22d14875f6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:09.617185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfae0c9-b70b-4eb5-8ce5-a22d14875f6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:09.619188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfae0c9-b70b-4eb5-8ce5-a22d14875f6b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:09.640492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 304/632] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Jul 11 15:37:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:09.641346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfae0c9-b70b-4eb5-8ce5-a22d14875f6b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:09.665789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:09.695344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc4654-c0a6-43a0-87fa-958438f20e0c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:09.743645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daab8e-8f5e-4c36-be63-8898b3d074c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:09.744753 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daab8e-8f5e-4c36-be63-8898b3d074c8 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:09.745197 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daab8e-8f5e-4c36-be63-8898b3d074c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:09.745634 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daab8e-8f5e-4c36-be63-8898b3d074c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:09.750594 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:09.762165 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfae0c9-b70b-4eb5-8ce5-a22d14875f6b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:09.762718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daab8e-8f5e-4c36-be63-8898b3d074c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-a8daab8e-8f5e-4c36-be63-8898b3d074c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:09.773222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:09.774471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:09.775566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:09.775566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:09.775566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:09.775566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:09.775566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:09.775566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:09.775566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:09.775566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:09.775566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:09.775566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:09.775566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:09.775566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:09.778729 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 329/633] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:09.780643 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daab8e-8f5e-4c36-be63-8898b3d074c8 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:09.807108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd538f4-e494-4e84-94da-6a69f39d22e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:09.807923 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd538f4-e494-4e84-94da-6a69f39d22e9 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:09.808201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd538f4-e494-4e84-94da-6a69f39d22e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:09.808541 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd538f4-e494-4e84-94da-6a69f39d22e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:09.819959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd538f4-e494-4e84-94da-6a69f39d22e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-6dd538f4-e494-4e84-94da-6a69f39d22e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:09.828249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:09.829253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:09.830101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:09.830101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:09.830101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:09.830101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:09.830101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:09.830101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:09.830101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:09.830101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:09.830101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:09.830101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:09.830101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:09.830101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:09.834344 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 305/634] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:09.835228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd538f4-e494-4e84-94da-6a69f39d22e9 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:09.909650 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daab8e-8f5e-4c36-be63-8898b3d074c8 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:09.944513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd538f4-e494-4e84-94da-6a69f39d22e9 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:09.960436 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd67174-1a58-4c63-a1b6-df338ee3e4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:09.961346 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd67174-1a58-4c63-a1b6-df338ee3e4bb None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:09.962432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd67174-1a58-4c63-a1b6-df338ee3e4bb None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:09.962721 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd67174-1a58-4c63-a1b6-df338ee3e4bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:09.974815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:09.989708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bc6f4-8165-4ce1-b237-38d78708d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:09.991144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bc6f4-8165-4ce1-b237-38d78708d191 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:09.991665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bc6f4-8165-4ce1-b237-38d78708d191 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:09.992172 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bc6f4-8165-4ce1-b237-38d78708d191 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:09.993799 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bc6f4-8165-4ce1-b237-38d78708d191 None admin] RBAC: Adding query filter params (name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:09.994325 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bc6f4-8165-4ce1-b237-38d78708d191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:09.996484 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bc6f4-8165-4ce1-b237-38d78708d191 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:10.009974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 306/635] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:37:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:10.011104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bc6f4-8165-4ce1-b237-38d78708d191 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:10.033332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:10.044122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd67174-1a58-4c63-a1b6-df338ee3e4bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:10.046076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd67174-1a58-4c63-a1b6-df338ee3e4bb None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:10.147455 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bc6f4-8165-4ce1-b237-38d78708d191 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:10.160097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 330/636] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:37:10.161466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd67174-1a58-4c63-a1b6-df338ee3e4bb None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:10.191238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5793b2-d9e8-422e-9f1a-453bfd143471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:10.192448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5793b2-d9e8-422e-9f1a-453bfd143471 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:10.192885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5793b2-d9e8-422e-9f1a-453bfd143471 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:10.193725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5793b2-d9e8-422e-9f1a-453bfd143471 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:10.194906 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5793b2-d9e8-422e-9f1a-453bfd143471 None admin] RBAC: Adding query filter params (name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:10.195362 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5793b2-d9e8-422e-9f1a-453bfd143471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:10.197519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5793b2-d9e8-422e-9f1a-453bfd143471 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:10.203924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:10.207863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 307/637] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:37:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:10.208972 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5793b2-d9e8-422e-9f1a-453bfd143471 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:10.290357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd67174-1a58-4c63-a1b6-df338ee3e4bb None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:10.297440 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:10.322692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5793b2-d9e8-422e-9f1a-453bfd143471 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:10.329988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b403e-68ce-4d2e-be46-560fd15be7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:10.330994 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b403e-68ce-4d2e-be46-560fd15be7f5 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:10.331428 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b403e-68ce-4d2e-be46-560fd15be7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:10.331853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b403e-68ce-4d2e-be46-560fd15be7f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:10.342459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b403e-68ce-4d2e-be46-560fd15be7f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:10.344563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b403e-68ce-4d2e-be46-560fd15be7f5 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:10.356392 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf9f78-0101-4450-abaf-703436977294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:10.357200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf9f78-0101-4450-abaf-703436977294 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:10.357477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf9f78-0101-4450-abaf-703436977294 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:10.357746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf9f78-0101-4450-abaf-703436977294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-dc1b403e-68ce-4d2e-be46-560fd15be7f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:10.364660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:10.365857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:10.367091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:10.367091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:10.367091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:10.367091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:10.372738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf9f78-0101-4450-abaf-703436977294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:10.372738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf9f78-0101-4450-abaf-703436977294 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:10.373712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 331/638] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:10.375000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b403e-68ce-4d2e-be46-560fd15be7f5 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-3ecf9f78-0101-4450-abaf-703436977294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:10.390351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:10.391297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:10.392171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:10.392171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:10.392171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:10.392171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:10.392171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 308/639] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:10.392901 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026e97c-eae2-4d5e-a57f-f4a386427f21 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:10.393151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026e97c-eae2-4d5e-a57f-f4a386427f21 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:10.393425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026e97c-eae2-4d5e-a57f-f4a386427f21 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:10.396413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 309/640] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:10.396413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026e97c-eae2-4d5e-a57f-f4a386427f21 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:10.476111 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:10.489629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b403e-68ce-4d2e-be46-560fd15be7f5 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:10.506978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026e97c-eae2-4d5e-a57f-f4a386427f21 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:10.526334 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb5d34-b324-4eff-953f-e025493728a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:10.527137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb5d34-b324-4eff-953f-e025493728a4 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:10.527415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb5d34-b324-4eff-953f-e025493728a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:10.527683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb5d34-b324-4eff-953f-e025493728a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:10.535205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:10.539477 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb5d34-b324-4eff-953f-e025493728a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:10.541032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb5d34-b324-4eff-953f-e025493728a4 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:10.544925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325df97-1310-4af1-8ecd-22dae4a6efc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:10.545662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325df97-1310-4af1-8ecd-22dae4a6efc3 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:10.545942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325df97-1310-4af1-8ecd-22dae4a6efc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:10.546219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325df97-1310-4af1-8ecd-22dae4a6efc3 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:10.546961 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325df97-1310-4af1-8ecd-22dae4a6efc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:10.547272 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325df97-1310-4af1-8ecd-22dae4a6efc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:10.548693 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325df97-1310-4af1-8ecd-22dae4a6efc3 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-5dfb5d34-b324-4eff-953f-e025493728a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:10.560474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:10.561849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:10.562774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:10.562774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:10.562774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:10.562774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:10.562996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 310/641] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:10.562996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325df97-1310-4af1-8ecd-22dae4a6efc3 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:10.572967 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 332/642] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:10.572967 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428f016-3406-47d4-9c69-bbe6e8848b9a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:10.572967 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428f016-3406-47d4-9c69-bbe6e8848b9a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:10.572967 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428f016-3406-47d4-9c69-bbe6e8848b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:10.584820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-c428f016-3406-47d4-9c69-bbe6e8848b9a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:10.586007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c428f016-3406-47d4-9c69-bbe6e8848b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:10.664314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 333/643] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:37:10.664314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428f016-3406-47d4-9c69-bbe6e8848b9a None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:10.689355 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325df97-1310-4af1-8ecd-22dae4a6efc3 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:10.724527 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff374d3d-0c63-42ad-8eb2-73731a620a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:10.725197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff374d3d-0c63-42ad-8eb2-73731a620a60 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:10.725481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff374d3d-0c63-42ad-8eb2-73731a620a60 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:10.725754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff374d3d-0c63-42ad-8eb2-73731a620a60 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:10.726487 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff374d3d-0c63-42ad-8eb2-73731a620a60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:10.726795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff374d3d-0c63-42ad-8eb2-73731a620a60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:10.728188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff374d3d-0c63-42ad-8eb2-73731a620a60 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:10.734491 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:10.744573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 311/644] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:10.744573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff374d3d-0c63-42ad-8eb2-73731a620a60 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:10.777006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428f016-3406-47d4-9c69-bbe6e8848b9a None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:10.793346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:10.818186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad3e90-4469-41d1-8f09-216c75fdf4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:10.819523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad3e90-4469-41d1-8f09-216c75fdf4eb None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:10.819898 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad3e90-4469-41d1-8f09-216c75fdf4eb None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:10.820265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad3e90-4469-41d1-8f09-216c75fdf4eb None admin] PATH_INFO: `/v3/users/glance` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:10.829722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad3e90-4469-41d1-8f09-216c75fdf4eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:10.831683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad3e90-4469-41d1-8f09-216c75fdf4eb None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:10.842960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff374d3d-0c63-42ad-8eb2-73731a620a60 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-6bad3e90-4469-41d1-8f09-216c75fdf4eb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:10.850094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:10.851199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:10.852338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:10.852338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:10.852338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:10.852338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:10.852338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:10.852338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:10.852338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:10.852338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:10.852338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 15:37:10.852338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:10.853374 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 334/645] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:37:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:10.853692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad3e90-4469-41d1-8f09-216c75fdf4eb None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:10.882605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f077a-1255-4200-8900-6ee99e03d98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:10.883280 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f077a-1255-4200-8900-6ee99e03d98b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:10.883533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f077a-1255-4200-8900-6ee99e03d98b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:10.883801 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f077a-1255-4200-8900-6ee99e03d98b None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:10.884569 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f077a-1255-4200-8900-6ee99e03d98b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:10.884870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f077a-1255-4200-8900-6ee99e03d98b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:10.886248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f077a-1255-4200-8900-6ee99e03d98b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:10.898336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 312/646] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:10.898954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f077a-1255-4200-8900-6ee99e03d98b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:10.966713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad3e90-4469-41d1-8f09-216c75fdf4eb None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:10.999944 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:11.002955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f077a-1255-4200-8900-6ee99e03d98b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:11.006521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e6781-e132-46f7-ae19-caf04ecf4cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:11.007328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e6781-e132-46f7-ae19-caf04ecf4cc3 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:11.007705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e6781-e132-46f7-ae19-caf04ecf4cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:11.007979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e6781-e132-46f7-ae19-caf04ecf4cc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:11.013291 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:11.020874 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e6781-e132-46f7-ae19-caf04ecf4cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-eb6e6781-e132-46f7-ae19-caf04ecf4cc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:11.028536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:11.029457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:11.030466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:11.030466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:11.030466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:11.030466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:11.030466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:11.030466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:11.030466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:11.030466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:11.030466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:11.030466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:11.030466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:11.030466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:11.030466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 335/647] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:11.031197 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e6781-e132-46f7-ae19-caf04ecf4cc3 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:11.050809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2b859-67c4-43e1-af0b-b07680bf2003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:11.051848 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2b859-67c4-43e1-af0b-b07680bf2003 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:11.052130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2b859-67c4-43e1-af0b-b07680bf2003 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:11.052431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2b859-67c4-43e1-af0b-b07680bf2003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:11.059757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2b859-67c4-43e1-af0b-b07680bf2003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:11.061309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2b859-67c4-43e1-af0b-b07680bf2003 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-bfe2b859-67c4-43e1-af0b-b07680bf2003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:11.077375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:11.078547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:11.080031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:11.080031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:11.080031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:11.080031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:11.080031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:11.080031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:11.080031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:11.080031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:11.082446 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 313/648] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:11.083781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2b859-67c4-43e1-af0b-b07680bf2003 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:11.145795 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e6781-e132-46f7-ae19-caf04ecf4cc3 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:11.179801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf17be-db9a-4f1e-baf9-99cd1c6a7f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:11.180505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf17be-db9a-4f1e-baf9-99cd1c6a7f93 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:11.180785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf17be-db9a-4f1e-baf9-99cd1c6a7f93 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:11.181056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf17be-db9a-4f1e-baf9-99cd1c6a7f93 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:11.181906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf17be-db9a-4f1e-baf9-99cd1c6a7f93 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:11.182213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf17be-db9a-4f1e-baf9-99cd1c6a7f93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:11.183659 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf17be-db9a-4f1e-baf9-99cd1c6a7f93 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:11.195496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2b859-67c4-43e1-af0b-b07680bf2003 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:11.212449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 336/649] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Jul 11 15:37:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:11.214000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf17be-db9a-4f1e-baf9-99cd1c6a7f93 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:11.233297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b9cd5-79a0-4945-b45f-3695dfc10816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:11.234229 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b9cd5-79a0-4945-b45f-3695dfc10816 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:11.234770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b9cd5-79a0-4945-b45f-3695dfc10816 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:11.235046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b9cd5-79a0-4945-b45f-3695dfc10816 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:11.242786 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b9cd5-79a0-4945-b45f-3695dfc10816 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:11.244244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b9cd5-79a0-4945-b45f-3695dfc10816 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-189b9cd5-79a0-4945-b45f-3695dfc10816 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:11.259088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:11.260013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:11.260956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:11.260956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:11.260956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:11.260956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:11.260956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:11.260956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:11.260956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:11.260956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:11.260956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:37:11.260956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:11.260956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 314/650] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:37:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:11.261531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b9cd5-79a0-4945-b45f-3695dfc10816 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:11.268663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:11.300489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:11.329500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf17be-db9a-4f1e-baf9-99cd1c6a7f93 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:11.367294 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c932c1-92f6-4535-aaa0-f76ca36c2eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:11.368013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c932c1-92f6-4535-aaa0-f76ca36c2eac None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:11.368311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c932c1-92f6-4535-aaa0-f76ca36c2eac None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:11.368604 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c932c1-92f6-4535-aaa0-f76ca36c2eac None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:11.369370 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c932c1-92f6-4535-aaa0-f76ca36c2eac None admin] RBAC: Adding query filter params (name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:11.369679 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c932c1-92f6-4535-aaa0-f76ca36c2eac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:11.371072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c932c1-92f6-4535-aaa0-f76ca36c2eac None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:11.379483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b9cd5-79a0-4945-b45f-3695dfc10816 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:11.384205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 337/651] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:37:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:11.384205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c932c1-92f6-4535-aaa0-f76ca36c2eac None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:11.421080 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c46d5-1822-4c14-9598-68148f7a0eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:11.421805 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c46d5-1822-4c14-9598-68148f7a0eca None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:11.422090 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c46d5-1822-4c14-9598-68148f7a0eca None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:11.422365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c46d5-1822-4c14-9598-68148f7a0eca None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:11.423172 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c46d5-1822-4c14-9598-68148f7a0eca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:11.423600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c46d5-1822-4c14-9598-68148f7a0eca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:11.425198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c46d5-1822-4c14-9598-68148f7a0eca None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:11.437655 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 315/652] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:11.438437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c46d5-1822-4c14-9598-68148f7a0eca None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:11.480222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c932c1-92f6-4535-aaa0-f76ca36c2eac None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:11.490688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:11.513923 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a46fdc-63d4-4a1b-a266-cbd33d6a5701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:11.514811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a46fdc-63d4-4a1b-a266-cbd33d6a5701 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:11.515108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a46fdc-63d4-4a1b-a266-cbd33d6a5701 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:11.515372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a46fdc-63d4-4a1b-a266-cbd33d6a5701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:11.526923 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:11.540683 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c46d5-1822-4c14-9598-68148f7a0eca None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:11.574887 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3953aa-181d-4a3b-a074-fdd870ee3dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:11.575574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3953aa-181d-4a3b-a074-fdd870ee3dd4 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:11.575849 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3953aa-181d-4a3b-a074-fdd870ee3dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:11.576126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3953aa-181d-4a3b-a074-fdd870ee3dd4 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:11.577145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3953aa-181d-4a3b-a074-fdd870ee3dd4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:11.577461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3953aa-181d-4a3b-a074-fdd870ee3dd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:11.579103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3953aa-181d-4a3b-a074-fdd870ee3dd4 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:11.584474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a46fdc-63d4-4a1b-a266-cbd33d6a5701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:11.585821 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a46fdc-63d4-4a1b-a266-cbd33d6a5701 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:11.597330 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 316/653] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Jul 11 15:37:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:11.598138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3953aa-181d-4a3b-a074-fdd870ee3dd4 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:11.687742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 338/654] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:37:11.689187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20712052-865f-4eef-b170-c5f053e06692 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:11.689464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20712052-865f-4eef-b170-c5f053e06692 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:11.689740 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20712052-865f-4eef-b170-c5f053e06692 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:11.695043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 339/655] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:11.695685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20712052-865f-4eef-b170-c5f053e06692 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:11.701207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3953aa-181d-4a3b-a074-fdd870ee3dd4 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:11.707401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:11.735526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714f8e0-6840-4b5f-8dd5-9f65e799e8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:11.736340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714f8e0-6840-4b5f-8dd5-9f65e799e8e6 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:11.736622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714f8e0-6840-4b5f-8dd5-9f65e799e8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:11.736889 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714f8e0-6840-4b5f-8dd5-9f65e799e8e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:11.746669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714f8e0-6840-4b5f-8dd5-9f65e799e8e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:11.748106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714f8e0-6840-4b5f-8dd5-9f65e799e8e6 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:11.755019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-d714f8e0-6840-4b5f-8dd5-9f65e799e8e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:11.766258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:11.767247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:11.768155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:11.768155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:11.768155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:11.768155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:11.768155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 317/656] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:11.768831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714f8e0-6840-4b5f-8dd5-9f65e799e8e6 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:11.799092 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20712052-865f-4eef-b170-c5f053e06692 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:11.831742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9760e0-5f1b-45bf-bd68-dded2c0efd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:11.832416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9760e0-5f1b-45bf-bd68-dded2c0efd2c None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:11.832694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9760e0-5f1b-45bf-bd68-dded2c0efd2c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:11.832967 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9760e0-5f1b-45bf-bd68-dded2c0efd2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:11.833803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9760e0-5f1b-45bf-bd68-dded2c0efd2c None admin] RBAC: Adding query filter params (role.id=c8fd28e5c32f4759a288774fddec4493, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=fa038a2e30f544aaa609d32e0e1ceaa0) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:11.834108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9760e0-5f1b-45bf-bd68-dded2c0efd2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:11.835601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9760e0-5f1b-45bf-bd68-dded2c0efd2c None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:11.841696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 340/657] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:11 2022] GET /identity/v3/role_assignments?user.id=fa038a2e30f544aaa609d32e0e1ceaa0&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c8fd28e5c32f4759a288774fddec4493 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:11.842590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9760e0-5f1b-45bf-bd68-dded2c0efd2c None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:11.872715 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714f8e0-6840-4b5f-8dd5-9f65e799e8e6 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:11.920860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca088b-def1-4f86-98f3-e936f0e5dd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:11.921612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca088b-def1-4f86-98f3-e936f0e5dd83 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:11.921886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca088b-def1-4f86-98f3-e936f0e5dd83 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:11.922164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca088b-def1-4f86-98f3-e936f0e5dd83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:11.938920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:11.972392 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9760e0-5f1b-45bf-bd68-dded2c0efd2c None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:11.999701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:12.004782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca088b-def1-4f86-98f3-e936f0e5dd83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:12.006256 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca088b-def1-4f86-98f3-e936f0e5dd83 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:12.016144 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd05fe3-1060-4c13-9614-dcdb8e0b1fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:12.016983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd05fe3-1060-4c13-9614-dcdb8e0b1fb1 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:12.017263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd05fe3-1060-4c13-9614-dcdb8e0b1fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:12.017532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd05fe3-1060-4c13-9614-dcdb8e0b1fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:12.029545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd05fe3-1060-4c13-9614-dcdb8e0b1fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:12.031263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd05fe3-1060-4c13-9614-dcdb8e0b1fb1 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-2dd05fe3-1060-4c13-9614-dcdb8e0b1fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:12.050270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:12.051222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:12.052099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:12.052099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:12.052099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:12.052099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:12.052099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 341/658] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:12.053463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e8c48-755a-46c7-9581-bbe875e32017 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:12.053749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e8c48-755a-46c7-9581-bbe875e32017 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:12.054009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e8c48-755a-46c7-9581-bbe875e32017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:12.072206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-505e8c48-755a-46c7-9581-bbe875e32017 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:12.073132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-505e8c48-755a-46c7-9581-bbe875e32017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:12.121747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 318/659] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:37:12.122587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca088b-def1-4f86-98f3-e936f0e5dd83 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:12.148258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 342/660] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:37:12.149116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e8c48-755a-46c7-9581-bbe875e32017 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:12.212828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:12.230772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:12.235426 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca088b-def1-4f86-98f3-e936f0e5dd83 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:12.267309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e8c48-755a-46c7-9581-bbe875e32017 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:12.273380 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46430ebb-756a-4bbe-8b0a-d2439a6193b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:12.274064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46430ebb-756a-4bbe-8b0a-d2439a6193b4 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:12.274338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46430ebb-756a-4bbe-8b0a-d2439a6193b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:12.274609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46430ebb-756a-4bbe-8b0a-d2439a6193b4 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:12.275349 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46430ebb-756a-4bbe-8b0a-d2439a6193b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:12.275649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46430ebb-756a-4bbe-8b0a-d2439a6193b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:12.277199 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46430ebb-756a-4bbe-8b0a-d2439a6193b4 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:12.294142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 319/661] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:12.294142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46430ebb-756a-4bbe-8b0a-d2439a6193b4 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:12.314013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe54262-63e7-4d58-8d5f-8013f3e59ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:12.314971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe54262-63e7-4d58-8d5f-8013f3e59ce8 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:12.315384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe54262-63e7-4d58-8d5f-8013f3e59ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:12.315801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe54262-63e7-4d58-8d5f-8013f3e59ce8 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:12.316995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe54262-63e7-4d58-8d5f-8013f3e59ce8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:12.317475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe54262-63e7-4d58-8d5f-8013f3e59ce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:12.319658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe54262-63e7-4d58-8d5f-8013f3e59ce8 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:12.336489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 343/662] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:12.338027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe54262-63e7-4d58-8d5f-8013f3e59ce8 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:12.399156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46430ebb-756a-4bbe-8b0a-d2439a6193b4 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:12.431874 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a25c9-7ca7-49cf-bd4d-0b09da217049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:12.432707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a25c9-7ca7-49cf-bd4d-0b09da217049 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:12.432988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a25c9-7ca7-49cf-bd4d-0b09da217049 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:12.433258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a25c9-7ca7-49cf-bd4d-0b09da217049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:12.443744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a25c9-7ca7-49cf-bd4d-0b09da217049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:12.445214 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a25c9-7ca7-49cf-bd4d-0b09da217049 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:12.458972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe54262-63e7-4d58-8d5f-8013f3e59ce8 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-eb5a25c9-7ca7-49cf-bd4d-0b09da217049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:12.462724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:12.463588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:12.470083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:12.470083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:12.470083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:12.470083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:12.470083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 320/663] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:12.470083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a25c9-7ca7-49cf-bd4d-0b09da217049 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:12.477902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:12.481014 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:12.501223 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c187b-32b5-4f03-9acd-a73b5ebc50cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:12.502019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c187b-32b5-4f03-9acd-a73b5ebc50cd None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:12.502297 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c187b-32b5-4f03-9acd-a73b5ebc50cd None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:12.502565 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c187b-32b5-4f03-9acd-a73b5ebc50cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:12.514087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c187b-32b5-4f03-9acd-a73b5ebc50cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-ef3c187b-32b5-4f03-9acd-a73b5ebc50cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:12.521991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:12.522908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:12.524520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:12.524520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:12.524520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:12.524520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:12.524520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:12.524520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:12.524520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:12.524520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:12.524520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:12.524520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:12.524520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:12.524520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:12.524520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 344/664] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:12.524520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c187b-32b5-4f03-9acd-a73b5ebc50cd None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:12.574598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a25c9-7ca7-49cf-bd4d-0b09da217049 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:12.609227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55474a8-fa00-4477-bd91-3c0f5172284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:12.610036 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55474a8-fa00-4477-bd91-3c0f5172284d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:12.610319 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55474a8-fa00-4477-bd91-3c0f5172284d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:12.610601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55474a8-fa00-4477-bd91-3c0f5172284d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:12.619095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55474a8-fa00-4477-bd91-3c0f5172284d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:12.620580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55474a8-fa00-4477-bd91-3c0f5172284d None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:12.635128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c187b-32b5-4f03-9acd-a73b5ebc50cd None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-f55474a8-fa00-4477-bd91-3c0f5172284d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:12.635497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:12.636450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:12.637361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:12.637361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:12.637361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:12.637361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:12.637361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:12.637361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:12.637361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:12.637361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:12.637361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 15:37:12.637361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:12.641455 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 321/665] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:12.642535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55474a8-fa00-4477-bd91-3c0f5172284d None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:12.678951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f87d81-b0f6-460c-9b40-893a3f83abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:12.680060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f87d81-b0f6-460c-9b40-893a3f83abe9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:12.680525 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f87d81-b0f6-460c-9b40-893a3f83abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:12.680937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f87d81-b0f6-460c-9b40-893a3f83abe9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:12.691440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f87d81-b0f6-460c-9b40-893a3f83abe9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:12.693816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f87d81-b0f6-460c-9b40-893a3f83abe9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-01f87d81-b0f6-460c-9b40-893a3f83abe9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:12.713132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:12.714043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:12.714925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:12.714925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:12.714925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:12.714925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:12.714925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:12.714925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:12.714925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:12.714925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:12.714925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 345/666] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:12.715826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f87d81-b0f6-460c-9b40-893a3f83abe9 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:12.721935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:12.751217 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:12.755662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55474a8-fa00-4477-bd91-3c0f5172284d None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:12.792400 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba780d-3488-4b62-83d9-110658cfeffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:12.793398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba780d-3488-4b62-83d9-110658cfeffb None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:12.794248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba780d-3488-4b62-83d9-110658cfeffb None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:12.794741 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba780d-3488-4b62-83d9-110658cfeffb None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:12.795712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba780d-3488-4b62-83d9-110658cfeffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:12.796593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba780d-3488-4b62-83d9-110658cfeffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:12.798740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba780d-3488-4b62-83d9-110658cfeffb None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:12.815614 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 322/667] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:12.815614 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba780d-3488-4b62-83d9-110658cfeffb None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:12.826042 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f87d81-b0f6-460c-9b40-893a3f83abe9 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:12.862066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53837c5b-d46d-4200-b8a8-963f48735d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:12.862730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53837c5b-d46d-4200-b8a8-963f48735d53 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:12.863010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53837c5b-d46d-4200-b8a8-963f48735d53 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:12.863281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53837c5b-d46d-4200-b8a8-963f48735d53 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:12.864024 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53837c5b-d46d-4200-b8a8-963f48735d53 None admin] RBAC: Adding query filter params (name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:12.864345 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53837c5b-d46d-4200-b8a8-963f48735d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:12.865714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53837c5b-d46d-4200-b8a8-963f48735d53 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:12.882412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 346/668] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:37:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:12.882412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53837c5b-d46d-4200-b8a8-963f48735d53 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:12.930500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba780d-3488-4b62-83d9-110658cfeffb None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:12.962312 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:12.969258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120c604-eea3-4db1-8602-b647090a10c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:12.969935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120c604-eea3-4db1-8602-b647090a10c3 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:12.970516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120c604-eea3-4db1-8602-b647090a10c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:12.970516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120c604-eea3-4db1-8602-b647090a10c3 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:12.971311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120c604-eea3-4db1-8602-b647090a10c3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:12.971809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120c604-eea3-4db1-8602-b647090a10c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:12.973300 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120c604-eea3-4db1-8602-b647090a10c3 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:12.981573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:12.986403 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53837c5b-d46d-4200-b8a8-963f48735d53 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.002669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 323/669] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Jul 11 15:37:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:13.002669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120c604-eea3-4db1-8602-b647090a10c3 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.026254 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a12b2-8a52-4cb9-8680-b3548bb430e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.027833 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a12b2-8a52-4cb9-8680-b3548bb430e7 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.028594 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a12b2-8a52-4cb9-8680-b3548bb430e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.029057 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a12b2-8a52-4cb9-8680-b3548bb430e7 None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.030731 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a12b2-8a52-4cb9-8680-b3548bb430e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:13.031574 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a12b2-8a52-4cb9-8680-b3548bb430e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.035255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a12b2-8a52-4cb9-8680-b3548bb430e7 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.055975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 347/670] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:13.055975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a12b2-8a52-4cb9-8680-b3548bb430e7 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.122712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120c604-eea3-4db1-8602-b647090a10c3 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.157023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c57689-c7cb-4edc-944f-3ad16bf34534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.157816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c57689-c7cb-4edc-944f-3ad16bf34534 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.158088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c57689-c7cb-4edc-944f-3ad16bf34534 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.158342 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c57689-c7cb-4edc-944f-3ad16bf34534 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.160540 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a12b2-8a52-4cb9-8680-b3548bb430e7 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.164957 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c57689-c7cb-4edc-944f-3ad16bf34534 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.166416 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c57689-c7cb-4edc-944f-3ad16bf34534 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-97c57689-c7cb-4edc-944f-3ad16bf34534 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:13.180321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:13.181277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:13.182188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:13.182188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:13.182188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:13.182188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:13.182188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:13.182188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:13.182188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:13.182188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:13.182188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 324/671] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:13.182674 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c57689-c7cb-4edc-944f-3ad16bf34534 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.208973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3e69d-8146-40bb-a882-a70b291e3eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.209789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3e69d-8146-40bb-a882-a70b291e3eeb None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.210102 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3e69d-8146-40bb-a882-a70b291e3eeb None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.210466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3e69d-8146-40bb-a882-a70b291e3eeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.222063 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3e69d-8146-40bb-a882-a70b291e3eeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.223524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3e69d-8146-40bb-a882-a70b291e3eeb None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.239909 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-25b3e69d-8146-40bb-a882-a70b291e3eeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:13.243043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:13.243982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:13.245180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:13.245180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:13.245180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:13.245180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:13.245180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 348/672] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:13.245473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3e69d-8146-40bb-a882-a70b291e3eeb None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.259218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:13.300322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c57689-c7cb-4edc-944f-3ad16bf34534 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.338222 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550f185-b308-4dc0-9308-6c893b34077b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.338881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f185-b308-4dc0-9308-6c893b34077b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.339162 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f185-b308-4dc0-9308-6c893b34077b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.339457 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f185-b308-4dc0-9308-6c893b34077b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.356493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3e69d-8146-40bb-a882-a70b291e3eeb None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.394977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b0fe9-fa80-416f-950d-02b68139ab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.395646 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b0fe9-fa80-416f-950d-02b68139ab5e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.396215 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b0fe9-fa80-416f-950d-02b68139ab5e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.396523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b0fe9-fa80-416f-950d-02b68139ab5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.397361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b0fe9-fa80-416f-950d-02b68139ab5e None admin] RBAC: Adding query filter params (role.id=c8fd28e5c32f4759a288774fddec4493, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=3be29cfa76174b44b99ddaf3d293ead1) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:13.397689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b0fe9-fa80-416f-950d-02b68139ab5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.399136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b0fe9-fa80-416f-950d-02b68139ab5e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.406401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 349/673] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:13 2022] GET /identity/v3/role_assignments?user.id=3be29cfa76174b44b99ddaf3d293ead1&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c8fd28e5c32f4759a288774fddec4493 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:13.407191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b0fe9-fa80-416f-950d-02b68139ab5e None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.431103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550f185-b308-4dc0-9308-6c893b34077b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.432880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550f185-b308-4dc0-9308-6c893b34077b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.491816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:13.499121 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:13.527107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b0fe9-fa80-416f-950d-02b68139ab5e None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.563415 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 325/674] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:37:13.564574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550f185-b308-4dc0-9308-6c893b34077b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.578601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebea958-35d6-4148-af75-81dced564a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.578853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea958-35d6-4148-af75-81dced564a1a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.579267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea958-35d6-4148-af75-81dced564a1a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.579545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea958-35d6-4148-af75-81dced564a1a None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.580957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebea958-35d6-4148-af75-81dced564a1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:13.580957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebea958-35d6-4148-af75-81dced564a1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.582766 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebea958-35d6-4148-af75-81dced564a1a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.598412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 350/675] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:13.599370 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebea958-35d6-4148-af75-81dced564a1a None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.698477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550f185-b308-4dc0-9308-6c893b34077b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.733797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e13947-da29-4c09-ac74-5ad322fee274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.734612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e13947-da29-4c09-ac74-5ad322fee274 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.734983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e13947-da29-4c09-ac74-5ad322fee274 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.735367 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e13947-da29-4c09-ac74-5ad322fee274 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.736525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e13947-da29-4c09-ac74-5ad322fee274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:13.736525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e13947-da29-4c09-ac74-5ad322fee274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.738054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e13947-da29-4c09-ac74-5ad322fee274 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.750356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 326/676] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:13.750540 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebea958-35d6-4148-af75-81dced564a1a None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.751417 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e13947-da29-4c09-ac74-5ad322fee274 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.762905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:13.795290 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69386766-ac23-48ed-b778-6a9ffc0a3b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.796834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69386766-ac23-48ed-b778-6a9ffc0a3b76 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.797263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69386766-ac23-48ed-b778-6a9ffc0a3b76 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.798135 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69386766-ac23-48ed-b778-6a9ffc0a3b76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.802275 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:13.813034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69386766-ac23-48ed-b778-6a9ffc0a3b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.815236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69386766-ac23-48ed-b778-6a9ffc0a3b76 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-69386766-ac23-48ed-b778-6a9ffc0a3b76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:13.839198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:13.840727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:13.841640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:13.841640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:13.841640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:13.841640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:13.847158 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 351/677] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:13.847158 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69386766-ac23-48ed-b778-6a9ffc0a3b76 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.867107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e13947-da29-4c09-ac74-5ad322fee274 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:13.902770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f15fc6-f2e6-4e98-9829-5a1ffb9a7fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:13.903532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15fc6-f2e6-4e98-9829-5a1ffb9a7fab None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:13.903802 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15fc6-f2e6-4e98-9829-5a1ffb9a7fab None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:13.904076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15fc6-f2e6-4e98-9829-5a1ffb9a7fab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:13.905052 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f15fc6-f2e6-4e98-9829-5a1ffb9a7fab None admin] RBAC: Adding query filter params (role.id=c8fd28e5c32f4759a288774fddec4493, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=73732594dbee480e9e5d153ca1382494) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:13.905502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f15fc6-f2e6-4e98-9829-5a1ffb9a7fab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:13.906882 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f15fc6-f2e6-4e98-9829-5a1ffb9a7fab None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:13.918477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 327/678] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:13 2022] GET /identity/v3/role_assignments?user.id=73732594dbee480e9e5d153ca1382494&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c8fd28e5c32f4759a288774fddec4493 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:13.919564 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f15fc6-f2e6-4e98-9829-5a1ffb9a7fab None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:13.967757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69386766-ac23-48ed-b778-6a9ffc0a3b76 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:14.005374 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f542e-38eb-4a9d-adc1-5bb77b80aa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:14.006594 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f542e-38eb-4a9d-adc1-5bb77b80aa8c None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:14.007127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f542e-38eb-4a9d-adc1-5bb77b80aa8c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:14.007656 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f542e-38eb-4a9d-adc1-5bb77b80aa8c None admin] PATH_INFO: `/v3/users/swift` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:14.017334 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f542e-38eb-4a9d-adc1-5bb77b80aa8c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:14.018944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:14.020363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f542e-38eb-4a9d-adc1-5bb77b80aa8c None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-179f542e-38eb-4a9d-adc1-5bb77b80aa8c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:14.038030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:14.039026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:14.039961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:14.039961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:14.039961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:14.039961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:14.039961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:14.039961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:14.039961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:14.039961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:14.039961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:37:14.039961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:14.042877 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 352/679] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:37:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:14.044568 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f5f55-f618-477a-ac93-f272112bc7ba None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:14.045082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f5f55-f618-477a-ac93-f272112bc7ba None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:14.045583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f5f55-f618-477a-ac93-f272112bc7ba None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:14.047499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 353/680] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:14.048800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f5f55-f618-477a-ac93-f272112bc7ba None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:14.057104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f15fc6-f2e6-4e98-9829-5a1ffb9a7fab None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:14.097522 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549b450-6e5f-4615-bbf3-354c9782b83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:14.098212 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549b450-6e5f-4615-bbf3-354c9782b83e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:14.098494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549b450-6e5f-4615-bbf3-354c9782b83e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:14.098765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549b450-6e5f-4615-bbf3-354c9782b83e None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:14.099509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549b450-6e5f-4615-bbf3-354c9782b83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:14.099814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549b450-6e5f-4615-bbf3-354c9782b83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:14.101275 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549b450-6e5f-4615-bbf3-354c9782b83e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:14.113237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:14.117155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 328/681] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:14.117155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e35df5-4953-4390-a8cd-1e3050784018 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:14.117155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e35df5-4953-4390-a8cd-1e3050784018 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:14.117155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e35df5-4953-4390-a8cd-1e3050784018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:14.140910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-a4e35df5-4953-4390-a8cd-1e3050784018 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:14.142115 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a4e35df5-4953-4390-a8cd-1e3050784018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:14.188751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f5f55-f618-477a-ac93-f272112bc7ba None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:14.229793 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 329/682] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:37:14.230958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e35df5-4953-4390-a8cd-1e3050784018 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:14.244903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07b9f2-813a-4865-bdcf-47e3cee9afb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:14.245599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07b9f2-813a-4865-bdcf-47e3cee9afb2 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:14.245927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07b9f2-813a-4865-bdcf-47e3cee9afb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:14.246200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07b9f2-813a-4865-bdcf-47e3cee9afb2 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:14.249058 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07b9f2-813a-4865-bdcf-47e3cee9afb2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:14.249467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07b9f2-813a-4865-bdcf-47e3cee9afb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:14.251987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07b9f2-813a-4865-bdcf-47e3cee9afb2 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:14.276570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 354/683] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Jul 11 15:37:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:14.278017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07b9f2-813a-4865-bdcf-47e3cee9afb2 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:14.318559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:14.363735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e35df5-4953-4390-a8cd-1e3050784018 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:14.395971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07b9f2-813a-4865-bdcf-47e3cee9afb2 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:14.398584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:14.401448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadc24e-78cb-4044-8ee9-939d7c29e238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:14.404869 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc24e-78cb-4044-8ee9-939d7c29e238 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:14.404869 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc24e-78cb-4044-8ee9-939d7c29e238 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:14.404869 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc24e-78cb-4044-8ee9-939d7c29e238 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:14.411895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadc24e-78cb-4044-8ee9-939d7c29e238 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:14.413767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadc24e-78cb-4044-8ee9-939d7c29e238 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-6cadc24e-78cb-4044-8ee9-939d7c29e238 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:14.429006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:14.429893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:14.430775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:14.430775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:14.430775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:14.430775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:14.430775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:14.430775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:14.430775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:14.430775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:14.433358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 330/684] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:14.434292 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadc24e-78cb-4044-8ee9-939d7c29e238 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:14.439505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fddb6-dde2-40bb-95aa-54df9fcb7e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:14.440967 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fddb6-dde2-40bb-95aa-54df9fcb7e24 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:14.444127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fddb6-dde2-40bb-95aa-54df9fcb7e24 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:14.444643 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fddb6-dde2-40bb-95aa-54df9fcb7e24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:14.458620 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fddb6-dde2-40bb-95aa-54df9fcb7e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-040fddb6-dde2-40bb-95aa-54df9fcb7e24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:14.469750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:14.470686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:14.471518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:14.471518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:14.471518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:14.471518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:14.471518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:14.471518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:14.471518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:14.471518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:14.471518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:14.471518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:14.471518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:37:14.471518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:14.474187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 355/685] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:37:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:14.475112 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fddb6-dde2-40bb-95aa-54df9fcb7e24 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:14.558232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadc24e-78cb-4044-8ee9-939d7c29e238 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:14.586164 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fddb6-dde2-40bb-95aa-54df9fcb7e24 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:14.587245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:14.601432 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f45c5-872d-4d8d-96e4-0b3b11650cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:14.602583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f45c5-872d-4d8d-96e4-0b3b11650cc0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:14.603013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f45c5-872d-4d8d-96e4-0b3b11650cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:14.603441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f45c5-872d-4d8d-96e4-0b3b11650cc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:14.633144 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02d141-1f39-4598-8fdd-6f832f8433f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:14.634238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d141-1f39-4598-8fdd-6f832f8433f3 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:14.634970 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d141-1f39-4598-8fdd-6f832f8433f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:14.635396 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d141-1f39-4598-8fdd-6f832f8433f3 None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:14.636611 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02d141-1f39-4598-8fdd-6f832f8433f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:14.637226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02d141-1f39-4598-8fdd-6f832f8433f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:14.639469 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02d141-1f39-4598-8fdd-6f832f8433f3 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:14.659616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 356/686] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:14.660739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02d141-1f39-4598-8fdd-6f832f8433f3 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:14.682611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f45c5-872d-4d8d-96e4-0b3b11650cc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:14.684562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f45c5-872d-4d8d-96e4-0b3b11650cc0 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:14.695696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:14.788973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02d141-1f39-4598-8fdd-6f832f8433f3 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:14.809100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 331/687] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:37:14.811128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f45c5-872d-4d8d-96e4-0b3b11650cc0 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:14.826384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88f109-fc6d-42e3-ae30-7d1ef1acd098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:14.827275 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f109-fc6d-42e3-ae30-7d1ef1acd098 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:14.827591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f109-fc6d-42e3-ae30-7d1ef1acd098 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:14.827960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f109-fc6d-42e3-ae30-7d1ef1acd098 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:14.829021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88f109-fc6d-42e3-ae30-7d1ef1acd098 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:14.829424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88f109-fc6d-42e3-ae30-7d1ef1acd098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:14.830896 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88f109-fc6d-42e3-ae30-7d1ef1acd098 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:14.841312 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:14.844821 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 357/688] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:37:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:14.845794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88f109-fc6d-42e3-ae30-7d1ef1acd098 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:14.920099 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f45c5-872d-4d8d-96e4-0b3b11650cc0 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:14.952147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:14.960975 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cea16-dc81-4497-b31a-05638066d1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:14.962638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cea16-dc81-4497-b31a-05638066d1b6 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:14.963166 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cea16-dc81-4497-b31a-05638066d1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:14.963585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cea16-dc81-4497-b31a-05638066d1b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:14.965238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cea16-dc81-4497-b31a-05638066d1b6 None admin] RBAC: Adding query filter params (role.id=c8fd28e5c32f4759a288774fddec4493, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=44a4d0441d4a423884d7adef45e2641f) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:14.965725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cea16-dc81-4497-b31a-05638066d1b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:14.967879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cea16-dc81-4497-b31a-05638066d1b6 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:14.971060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88f109-fc6d-42e3-ae30-7d1ef1acd098 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:14.980977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 332/689] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:14 2022] GET /identity/v3/role_assignments?user.id=44a4d0441d4a423884d7adef45e2641f&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c8fd28e5c32f4759a288774fddec4493 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:14.981267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cea16-dc81-4497-b31a-05638066d1b6 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:15.063351 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b007fc-57ee-4fcc-ac1e-c842b85f4c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:15.065234 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b007fc-57ee-4fcc-ac1e-c842b85f4c7a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:15.065515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b007fc-57ee-4fcc-ac1e-c842b85f4c7a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:15.065788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b007fc-57ee-4fcc-ac1e-c842b85f4c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:15.090711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b007fc-57ee-4fcc-ac1e-c842b85f4c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:15.094344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b007fc-57ee-4fcc-ac1e-c842b85f4c7a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:15.105498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-e6b007fc-57ee-4fcc-ac1e-c842b85f4c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:15.128096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:15.129236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:15.130128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:15.130128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:15.130128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:15.130128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:15.132534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 358/690] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:15.138373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b007fc-57ee-4fcc-ac1e-c842b85f4c7a None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:15.146084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cea16-dc81-4497-b31a-05638066d1b6 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:15.221320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce6da5-193d-4ebd-b858-e01fbd1c7550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:15.222184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce6da5-193d-4ebd-b858-e01fbd1c7550 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:15.222394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce6da5-193d-4ebd-b858-e01fbd1c7550 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:15.222670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce6da5-193d-4ebd-b858-e01fbd1c7550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:15.237064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce6da5-193d-4ebd-b858-e01fbd1c7550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:15.238631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce6da5-193d-4ebd-b858-e01fbd1c7550 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:15.260035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b007fc-57ee-4fcc-ac1e-c842b85f4c7a None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-93ce6da5-193d-4ebd-b858-e01fbd1c7550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:15.260398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:15.261242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:15.262124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:15.262124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:15.262124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:15.262124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:15.262124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 333/691] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:15.267891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce6da5-193d-4ebd-b858-e01fbd1c7550 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:15.306099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a6925-167b-4d37-ada1-dbe852294fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:15.306768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a6925-167b-4d37-ada1-dbe852294fb6 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:15.307047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a6925-167b-4d37-ada1-dbe852294fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:15.307323 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a6925-167b-4d37-ada1-dbe852294fb6 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:15.308055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a6925-167b-4d37-ada1-dbe852294fb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:15.308394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a6925-167b-4d37-ada1-dbe852294fb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:15.309825 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a6925-167b-4d37-ada1-dbe852294fb6 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:15.317752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:15.324873 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 359/692] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:15.330296 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a6925-167b-4d37-ada1-dbe852294fb6 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:15.400390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce6da5-193d-4ebd-b858-e01fbd1c7550 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:15.446727 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70110-b89f-421e-a164-15a73d4ba761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:15.447401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70110-b89f-421e-a164-15a73d4ba761 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:15.447682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70110-b89f-421e-a164-15a73d4ba761 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:15.447957 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70110-b89f-421e-a164-15a73d4ba761 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:15.451739 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f70110-b89f-421e-a164-15a73d4ba761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:15.451739 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f70110-b89f-421e-a164-15a73d4ba761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:15.451739 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f70110-b89f-421e-a164-15a73d4ba761 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:15.458690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:15.461478 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a6925-167b-4d37-ada1-dbe852294fb6 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:15.465913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 334/693] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:15.471551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70110-b89f-421e-a164-15a73d4ba761 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:15.514062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035ac91-d233-40c6-8944-0e97dd61534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:15.514946 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035ac91-d233-40c6-8944-0e97dd61534b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:15.515224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035ac91-d233-40c6-8944-0e97dd61534b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:15.515538 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035ac91-d233-40c6-8944-0e97dd61534b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:15.527873 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035ac91-d233-40c6-8944-0e97dd61534b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:15.529390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035ac91-d233-40c6-8944-0e97dd61534b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-0035ac91-d233-40c6-8944-0e97dd61534b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:15.552005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:15.552978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:15.553838 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:15.553838 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:15.553838 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:15.553838 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:15.553838 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:15.553838 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:15.553838 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:15.553838 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:15.561110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 360/694] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:15.566971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035ac91-d233-40c6-8944-0e97dd61534b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:15.583243 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70110-b89f-421e-a164-15a73d4ba761 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:15.619254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db722615-73d1-4b9e-89d3-89690c294c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:15.620563 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db722615-73d1-4b9e-89d3-89690c294c14 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:15.621040 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db722615-73d1-4b9e-89d3-89690c294c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:15.621504 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db722615-73d1-4b9e-89d3-89690c294c14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:15.630151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db722615-73d1-4b9e-89d3-89690c294c14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:15.631884 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db722615-73d1-4b9e-89d3-89690c294c14 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-db722615-73d1-4b9e-89d3-89690c294c14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:15.647093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:15.648060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:15.648998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:15.648998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:15.648998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:15.648998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:15.648998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:15.648998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:15.648998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:15.648998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:15.648998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:37:15.648998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:15.651767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 335/695] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Jul 11 15:37:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:15.657708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db722615-73d1-4b9e-89d3-89690c294c14 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:15.681669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:15.724685 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:15.738475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035ac91-d233-40c6-8944-0e97dd61534b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:15.772005 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db722615-73d1-4b9e-89d3-89690c294c14 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:15.774561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46943c88-24c9-468a-91a5-403ec3d1d9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:15.775487 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46943c88-24c9-468a-91a5-403ec3d1d9b2 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:15.775961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46943c88-24c9-468a-91a5-403ec3d1d9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:15.776489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46943c88-24c9-468a-91a5-403ec3d1d9b2 None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:15.777498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46943c88-24c9-468a-91a5-403ec3d1d9b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:15.777994 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46943c88-24c9-468a-91a5-403ec3d1d9b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:15.779851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46943c88-24c9-468a-91a5-403ec3d1d9b2 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:15.793799 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 361/696] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:15.795649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd133d4-71df-447c-a92a-a6d7789c05fb None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:15.796137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd133d4-71df-447c-a92a-a6d7789c05fb None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:15.796633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd133d4-71df-447c-a92a-a6d7789c05fb None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:15.798491 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 362/697] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:15.799491 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd133d4-71df-447c-a92a-a6d7789c05fb None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:15.815682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402a3aa-929b-41d8-a60e-ded20c4ca176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:15.816416 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a3aa-929b-41d8-a60e-ded20c4ca176 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:15.816701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a3aa-929b-41d8-a60e-ded20c4ca176 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:15.816979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a3aa-929b-41d8-a60e-ded20c4ca176 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:15.818317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402a3aa-929b-41d8-a60e-ded20c4ca176 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:15.818634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402a3aa-929b-41d8-a60e-ded20c4ca176 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:15.820384 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402a3aa-929b-41d8-a60e-ded20c4ca176 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:15.849547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 336/698] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Jul 11 15:37:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:15.849547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0dbb2-650a-40dd-a4ae-a563a6514957 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:15.849547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0dbb2-650a-40dd-a4ae-a563a6514957 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:15.849547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0dbb2-650a-40dd-a4ae-a563a6514957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:15.868893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-8dc0dbb2-650a-40dd-a4ae-a563a6514957 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:15.870215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8dc0dbb2-650a-40dd-a4ae-a563a6514957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:15.928704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd133d4-71df-447c-a92a-a6d7789c05fb None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:15.948337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 337/699] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:37:15.948337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0dbb2-650a-40dd-a4ae-a563a6514957 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:15.969342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:15.986470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111113c5-3e0b-493c-b00e-ad26db83992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:15.987645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111113c5-3e0b-493c-b00e-ad26db83992f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:15.988069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111113c5-3e0b-493c-b00e-ad26db83992f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:15.988622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111113c5-3e0b-493c-b00e-ad26db83992f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:15.990169 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111113c5-3e0b-493c-b00e-ad26db83992f None admin] RBAC: Adding query filter params (role.id=c8fd28e5c32f4759a288774fddec4493, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=8eaff8748f8b47e088e0cb7875992a4d) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:15.990622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111113c5-3e0b-493c-b00e-ad26db83992f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:15.992715 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111113c5-3e0b-493c-b00e-ad26db83992f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:16.008898 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 363/700] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:15 2022] GET /identity/v3/role_assignments?user.id=8eaff8748f8b47e088e0cb7875992a4d&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c8fd28e5c32f4759a288774fddec4493 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:16.009478 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111113c5-3e0b-493c-b00e-ad26db83992f None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:16.028687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:16.127754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0dbb2-650a-40dd-a4ae-a563a6514957 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:16.170712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb347-32c7-4b19-8d5e-e889dbc1b7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:16.173215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb347-32c7-4b19-8d5e-e889dbc1b7b2 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:16.173512 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb347-32c7-4b19-8d5e-e889dbc1b7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:16.173790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb347-32c7-4b19-8d5e-e889dbc1b7b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:16.225254 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111113c5-3e0b-493c-b00e-ad26db83992f None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:16.271703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc88489-573e-49f3-b285-a5de1e6fe5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:16.273391 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc88489-573e-49f3-b285-a5de1e6fe5fe None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:16.273873 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc88489-573e-49f3-b285-a5de1e6fe5fe None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:16.274393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc88489-573e-49f3-b285-a5de1e6fe5fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:16.275024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bb347-32c7-4b19-8d5e-e889dbc1b7b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:16.276551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bb347-32c7-4b19-8d5e-e889dbc1b7b2 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:16.286507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc88489-573e-49f3-b285-a5de1e6fe5fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:16.288399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc88489-573e-49f3-b285-a5de1e6fe5fe None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-bcc88489-573e-49f3-b285-a5de1e6fe5fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:16.309449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:16.310398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:16.311983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:16.311983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:16.311983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:16.311983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:16.311983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 364/701] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:16.312980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afee6f-ce46-445b-9d50-fcbcaa8e6c92 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:16.313468 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afee6f-ce46-445b-9d50-fcbcaa8e6c92 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:16.313569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afee6f-ce46-445b-9d50-fcbcaa8e6c92 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:16.315077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 365/702] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:16.320555 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116921-7016-4322-84d4-912201d0b296 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:16.320694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116921-7016-4322-84d4-912201d0b296 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:16.320951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116921-7016-4322-84d4-912201d0b296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:16.334890 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:16.341109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-4e116921-7016-4322-84d4-912201d0b296 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:16.341953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4e116921-7016-4322-84d4-912201d0b296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:16.378582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:16.401540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 338/703] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:37:16.402462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb347-32c7-4b19-8d5e-e889dbc1b7b2 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:16.434022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 366/704] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:37:16.434891 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e116921-7016-4322-84d4-912201d0b296 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:16.548852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb347-32c7-4b19-8d5e-e889dbc1b7b2 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:16.556668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e116921-7016-4322-84d4-912201d0b296 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:16.594107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94254a-0cda-4860-87f8-49b598674026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:16.594908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94254a-0cda-4860-87f8-49b598674026 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:16.595186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94254a-0cda-4860-87f8-49b598674026 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:16.595453 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94254a-0cda-4860-87f8-49b598674026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:16.598964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80638ef2-bf1d-480c-a785-5895b2799bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:16.599703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80638ef2-bf1d-480c-a785-5895b2799bc5 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:16.600079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80638ef2-bf1d-480c-a785-5895b2799bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:16.600448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80638ef2-bf1d-480c-a785-5895b2799bc5 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:16.601306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80638ef2-bf1d-480c-a785-5895b2799bc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:16.601677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80638ef2-bf1d-480c-a785-5895b2799bc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:16.603675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80638ef2-bf1d-480c-a785-5895b2799bc5 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:16.606001 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94254a-0cda-4860-87f8-49b598674026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:16.607536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94254a-0cda-4860-87f8-49b598674026 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:16.619314 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 339/705] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:16.620187 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80638ef2-bf1d-480c-a785-5895b2799bc5 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-ee94254a-0cda-4860-87f8-49b598674026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:16.626248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:16.627159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:16.628935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:16.628935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:16.628935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:16.628935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:16.628935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 367/706] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:16.629509 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94254a-0cda-4860-87f8-49b598674026 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:16.631684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:16.649427 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:16.735771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94254a-0cda-4860-87f8-49b598674026 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:16.753483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80638ef2-bf1d-480c-a785-5895b2799bc5 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:16.772701 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5986fbd-ebd2-4167-a4d0-abd0f76ba24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:16.773615 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5986fbd-ebd2-4167-a4d0-abd0f76ba24e None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:16.774018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5986fbd-ebd2-4167-a4d0-abd0f76ba24e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:16.774438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5986fbd-ebd2-4167-a4d0-abd0f76ba24e None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:16.775268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5986fbd-ebd2-4167-a4d0-abd0f76ba24e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:16.776950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5986fbd-ebd2-4167-a4d0-abd0f76ba24e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:16.793333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8c53b-2d54-4a8b-895a-0ffb7d4503f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:16.794162 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8c53b-2d54-4a8b-895a-0ffb7d4503f8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:16.794488 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8c53b-2d54-4a8b-895a-0ffb7d4503f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:16.794766 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8c53b-2d54-4a8b-895a-0ffb7d4503f8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:16.796040 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8c53b-2d54-4a8b-895a-0ffb7d4503f8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:16.797516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8c53b-2d54-4a8b-895a-0ffb7d4503f8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:16.800443 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 368/707] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:37:16 2022] POST /identity/v3/users => generated 254 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:37:16.801483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5986fbd-ebd2-4167-a4d0-abd0f76ba24e None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-6ff8c53b-2d54-4a8b-895a-0ffb7d4503f8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:16.812828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:16.814056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:16.815157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 340/708] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Jul 11 15:37:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:16.820173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8c53b-2d54-4a8b-895a-0ffb7d4503f8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:16.900444 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:16.915002 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:16.934797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5986fbd-ebd2-4167-a4d0-abd0f76ba24e None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:16.954036 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8c53b-2d54-4a8b-895a-0ffb7d4503f8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:17.001235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452fbe7-da5b-4b58-8dd0-f16a66434b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:17.002301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452fbe7-da5b-4b58-8dd0-f16a66434b56 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:17.002775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452fbe7-da5b-4b58-8dd0-f16a66434b56 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:17.003268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452fbe7-da5b-4b58-8dd0-f16a66434b56 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:17.003542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92800f0c-f3e1-4a24-8b69-acbcb9ba7763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:17.004214 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92800f0c-f3e1-4a24-8b69-acbcb9ba7763 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:17.004524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92800f0c-f3e1-4a24-8b69-acbcb9ba7763 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:17.004804 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92800f0c-f3e1-4a24-8b69-acbcb9ba7763 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:17.005057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452fbe7-da5b-4b58-8dd0-f16a66434b56 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:17.005544 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92800f0c-f3e1-4a24-8b69-acbcb9ba7763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:17.005649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452fbe7-da5b-4b58-8dd0-f16a66434b56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:17.005849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92800f0c-f3e1-4a24-8b69-acbcb9ba7763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:17.007300 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92800f0c-f3e1-4a24-8b69-acbcb9ba7763 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:17.007611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452fbe7-da5b-4b58-8dd0-f16a66434b56 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:17.014562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 341/709] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Jul 11 15:37:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:17.021369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 369/710] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:17.022660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452fbe7-da5b-4b58-8dd0-f16a66434b56 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:17.026492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92800f0c-f3e1-4a24-8b69-acbcb9ba7763 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:17.148039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452fbe7-da5b-4b58-8dd0-f16a66434b56 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:17.179324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92800f0c-f3e1-4a24-8b69-acbcb9ba7763 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:17.188859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9e78a-23aa-439e-a85c-13fbf3add304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:17.189721 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9e78a-23aa-439e-a85c-13fbf3add304 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:17.190070 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9e78a-23aa-439e-a85c-13fbf3add304 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:17.190414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9e78a-23aa-439e-a85c-13fbf3add304 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:17.191218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9e78a-23aa-439e-a85c-13fbf3add304 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:17.191588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9e78a-23aa-439e-a85c-13fbf3add304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:17.195403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9e78a-23aa-439e-a85c-13fbf3add304 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:17.196047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:17.205682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 342/711] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Jul 11 15:37:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:17.227499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:17.241365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f72e0-4eaa-4f09-a999-dfcb4693eb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:17.242504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f72e0-4eaa-4f09-a999-dfcb4693eb8e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:17.242965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f72e0-4eaa-4f09-a999-dfcb4693eb8e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:17.243440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f72e0-4eaa-4f09-a999-dfcb4693eb8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:17.251694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f72e0-4eaa-4f09-a999-dfcb4693eb8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:17.254198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f72e0-4eaa-4f09-a999-dfcb4693eb8e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-4c5f72e0-4eaa-4f09-a999-dfcb4693eb8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:17.270277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:17.271269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:17.272166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:17.272166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:17.272166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:17.272166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:17.272166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:17.272166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:17.272166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:17.272166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:17.274905 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 370/712] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:17.280614 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9e78a-23aa-439e-a85c-13fbf3add304 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:17.392278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9e78a-23aa-439e-a85c-13fbf3add304 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:17.428933 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba14e2e-886e-4cd4-9522-0a467c109025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:17.430010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba14e2e-886e-4cd4-9522-0a467c109025 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:17.430475 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba14e2e-886e-4cd4-9522-0a467c109025 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:17.430949 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba14e2e-886e-4cd4-9522-0a467c109025 None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:17.432086 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba14e2e-886e-4cd4-9522-0a467c109025 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:17.432611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba14e2e-886e-4cd4-9522-0a467c109025 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:17.434271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba14e2e-886e-4cd4-9522-0a467c109025 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:17.448427 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 343/713] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:17.457145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f72e0-4eaa-4f09-a999-dfcb4693eb8e None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:17.564272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f72e0-4eaa-4f09-a999-dfcb4693eb8e None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:17.601105 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b265e3-5802-44b0-97a0-fa8d8ef07a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:17.601770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b265e3-5802-44b0-97a0-fa8d8ef07a1d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:17.602048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b265e3-5802-44b0-97a0-fa8d8ef07a1d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:17.602320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b265e3-5802-44b0-97a0-fa8d8ef07a1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:17.603158 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b265e3-5802-44b0-97a0-fa8d8ef07a1d None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=fa038a2e30f544aaa609d32e0e1ceaa0) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:17.603473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b265e3-5802-44b0-97a0-fa8d8ef07a1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:17.604956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b265e3-5802-44b0-97a0-fa8d8ef07a1d None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:17.611245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 371/714] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:17 2022] GET /identity/v3/role_assignments?user.id=fa038a2e30f544aaa609d32e0e1ceaa0&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=32f5ce5800cf40d99d894960288d0155 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:17.657240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5e692-2b33-4517-861f-8de5ceac0f1a None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:17.657541 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5e692-2b33-4517-861f-8de5ceac0f1a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:17.657797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5e692-2b33-4517-861f-8de5ceac0f1a None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:17.659510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 344/715] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:17.669519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05357ba-25ec-49f0-aae6-993d04988e8e None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:17.669931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05357ba-25ec-49f0-aae6-993d04988e8e None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:17.670167 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05357ba-25ec-49f0-aae6-993d04988e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:17.690575 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-d05357ba-25ec-49f0-aae6-993d04988e8e None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:17.691717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d05357ba-25ec-49f0-aae6-993d04988e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:17.767037 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:17.795042 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 372/716] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:37:17.829280 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5e692-2b33-4517-861f-8de5ceac0f1a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:17.912975 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:17.978308 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5e692-2b33-4517-861f-8de5ceac0f1a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:18.024279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa250b-d8bb-434a-8078-18f77f6229ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:18.025112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa250b-d8bb-434a-8078-18f77f6229ff None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:18.025390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa250b-d8bb-434a-8078-18f77f6229ff None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:18.025658 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa250b-d8bb-434a-8078-18f77f6229ff None admin] PATH_INFO: `/v3/services/network` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:18.026321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa250b-d8bb-434a-8078-18f77f6229ff None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:18.027706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa250b-d8bb-434a-8078-18f77f6229ff None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-4aaa250b-d8bb-434a-8078-18f77f6229ff None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:18.044439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:18.045757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:18.046796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:18.046796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:18.046796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:18.046796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:18.046796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:18.046796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:18.046796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:18.046796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:18.046796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:18.046796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:18.046796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:18.046796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:18.046796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:37:18.046796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:18.051567 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 345/717] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:17 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:18.053056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05357ba-25ec-49f0-aae6-993d04988e8e None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:18.173560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05357ba-25ec-49f0-aae6-993d04988e8e None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:18.209364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5f9c6-a7bb-4118-8acc-1ac5b0aecc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:18.210041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f9c6-a7bb-4118-8acc-1ac5b0aecc8d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:18.210324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f9c6-a7bb-4118-8acc-1ac5b0aecc8d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:18.210652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f9c6-a7bb-4118-8acc-1ac5b0aecc8d None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:18.211372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5f9c6-a7bb-4118-8acc-1ac5b0aecc8d None admin] RBAC: Adding query filter params (name=network) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:18.212063 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5f9c6-a7bb-4118-8acc-1ac5b0aecc8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:18.213490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5f9c6-a7bb-4118-8acc-1ac5b0aecc8d None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:18.223013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 373/718] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Jul 11 15:37:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:18.224440 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa250b-d8bb-434a-8078-18f77f6229ff None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:18.349149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa250b-d8bb-434a-8078-18f77f6229ff None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:18.378961 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:18.394872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1a8e4-22e5-45f1-8b10-e937e9a9c4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:18.395564 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1a8e4-22e5-45f1-8b10-e937e9a9c4a9 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:18.395847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1a8e4-22e5-45f1-8b10-e937e9a9c4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:18.396122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1a8e4-22e5-45f1-8b10-e937e9a9c4a9 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:18.396878 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1a8e4-22e5-45f1-8b10-e937e9a9c4a9 None admin] RBAC: Adding query filter params (type=network) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:18.397185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1a8e4-22e5-45f1-8b10-e937e9a9c4a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:18.398584 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1a8e4-22e5-45f1-8b10-e937e9a9c4a9 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:18.408573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 346/719] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Jul 11 15:37:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:18.491759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd56aa-f96e-44f4-a17f-4fed8b0e7fd1 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:18.491759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd56aa-f96e-44f4-a17f-4fed8b0e7fd1 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:18.491759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd56aa-f96e-44f4-a17f-4fed8b0e7fd1 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:18.492512 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 374/720] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:18.497956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95f5b7-86cc-41c8-b044-032880018ada None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:18.498776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95f5b7-86cc-41c8-b044-032880018ada None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:18.499315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95f5b7-86cc-41c8-b044-032880018ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:18.517431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-1f95f5b7-86cc-41c8-b044-032880018ada None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:18.518972 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1f95f5b7-86cc-41c8-b044-032880018ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:18.592956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 347/721] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:37:18.617176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd56aa-f96e-44f4-a17f-4fed8b0e7fd1 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:18.674672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:18.730621 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd56aa-f96e-44f4-a17f-4fed8b0e7fd1 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:18.768943 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c362653-9052-49ee-b5c7-03a62046332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:18.770172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c362653-9052-49ee-b5c7-03a62046332d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:18.770686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c362653-9052-49ee-b5c7-03a62046332d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:18.771152 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c362653-9052-49ee-b5c7-03a62046332d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:18.787104 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c362653-9052-49ee-b5c7-03a62046332d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-6c362653-9052-49ee-b5c7-03a62046332d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:18.794983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:18.796032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:18.796899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:18.796899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:18.796899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:18.796899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:18.796899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:18.796899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:18.796899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:18.796899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:18.796899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:18.796899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:18.796899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:37:18.796899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:18.799589 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 375/722] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:37:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:18.805591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95f5b7-86cc-41c8-b044-032880018ada None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:18.909185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95f5b7-86cc-41c8-b044-032880018ada None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:18.926720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:18.945251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48083c0-6f2a-4aa8-a0e6-8b216bc1f713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:18.946285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48083c0-6f2a-4aa8-a0e6-8b216bc1f713 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:18.946756 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48083c0-6f2a-4aa8-a0e6-8b216bc1f713 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:18.947219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48083c0-6f2a-4aa8-a0e6-8b216bc1f713 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:18.948166 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48083c0-6f2a-4aa8-a0e6-8b216bc1f713 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:18.948686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48083c0-6f2a-4aa8-a0e6-8b216bc1f713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:18.950283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48083c0-6f2a-4aa8-a0e6-8b216bc1f713 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:18.959885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 348/723] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:37:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:18.965992 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c362653-9052-49ee-b5c7-03a62046332d None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:19.080069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c362653-9052-49ee-b5c7-03a62046332d None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:19.093059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:19.119414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb087141-4ba9-4fdb-bd21-7515f86b2be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:19.120265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb087141-4ba9-4fdb-bd21-7515f86b2be1 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:19.120567 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb087141-4ba9-4fdb-bd21-7515f86b2be1 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:19.120876 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb087141-4ba9-4fdb-bd21-7515f86b2be1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:19.132023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb087141-4ba9-4fdb-bd21-7515f86b2be1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:19.133574 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb087141-4ba9-4fdb-bd21-7515f86b2be1 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-bb087141-4ba9-4fdb-bd21-7515f86b2be1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:19.150651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:19.151577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:19.153009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:19.153009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:19.153009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:19.153009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:19.153009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 376/724] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:19.157929 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48083c0-6f2a-4aa8-a0e6-8b216bc1f713 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:19.270132 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48083c0-6f2a-4aa8-a0e6-8b216bc1f713 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:19.304001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1b319-4cf6-4214-9c65-9651a54025e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:19.304703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1b319-4cf6-4214-9c65-9651a54025e1 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:19.304983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1b319-4cf6-4214-9c65-9651a54025e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:19.305259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1b319-4cf6-4214-9c65-9651a54025e1 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:19.305995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1b319-4cf6-4214-9c65-9651a54025e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:19.306303 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1b319-4cf6-4214-9c65-9651a54025e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:19.307681 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1b319-4cf6-4214-9c65-9651a54025e1 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:19.324668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 349/725] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:19.326126 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb087141-4ba9-4fdb-bd21-7515f86b2be1 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:19.452885 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb087141-4ba9-4fdb-bd21-7515f86b2be1 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:19.486337 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7cde5-adeb-402f-9494-205704727ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:19.487150 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7cde5-adeb-402f-9494-205704727ab0 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:19.487436 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7cde5-adeb-402f-9494-205704727ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:19.487705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7cde5-adeb-402f-9494-205704727ab0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:19.496844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7cde5-adeb-402f-9494-205704727ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:19.498497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7cde5-adeb-402f-9494-205704727ab0 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:19.500959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627427e-cbd2-4e1d-b129-ae1b9a8e6aee None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:19.501241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627427e-cbd2-4e1d-b129-ae1b9a8e6aee None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:19.501513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627427e-cbd2-4e1d-b129-ae1b9a8e6aee None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:19.503167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 350/726] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:19.508213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d8794-22fd-418f-b0a3-7308ad762626 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:19.508524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d8794-22fd-418f-b0a3-7308ad762626 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:19.508799 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d8794-22fd-418f-b0a3-7308ad762626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-b5f7cde5-adeb-402f-9494-205704727ab0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:19.521077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:19.522023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:19.522953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:19.522953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:19.522953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:19.522953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:19.522953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:19.522953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:19.522953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:19.522953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:19.522953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:37:19.522953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:19.522953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 377/727] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:37:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:19.530099 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-341d8794-22fd-418f-b0a3-7308ad762626 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:19.531301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-341d8794-22fd-418f-b0a3-7308ad762626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:19.533804 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7cde5-adeb-402f-9494-205704727ab0 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:19.563130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:19.588635 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:19.602007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 351/728] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 15:37:19.625097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d8794-22fd-418f-b0a3-7308ad762626 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:19.729540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d8794-22fd-418f-b0a3-7308ad762626 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:19.736339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7cde5-adeb-402f-9494-205704727ab0 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:19.797436 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110ebce-0f71-4c13-b4b8-bd1d86a5a39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:19.798254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110ebce-0f71-4c13-b4b8-bd1d86a5a39c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:19.798540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110ebce-0f71-4c13-b4b8-bd1d86a5a39c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:19.798816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110ebce-0f71-4c13-b4b8-bd1d86a5a39c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:19.799888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cb594-42bd-4b19-ad82-64a03a8592be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:19.800596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cb594-42bd-4b19-ad82-64a03a8592be None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:19.800871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cb594-42bd-4b19-ad82-64a03a8592be None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:19.801140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cb594-42bd-4b19-ad82-64a03a8592be None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:19.801999 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cb594-42bd-4b19-ad82-64a03a8592be None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:19.802309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cb594-42bd-4b19-ad82-64a03a8592be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:19.803764 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cb594-42bd-4b19-ad82-64a03a8592be None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:19.824938 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110ebce-0f71-4c13-b4b8-bd1d86a5a39c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:19.831875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 378/729] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Jul 11 15:37:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-4110ebce-0f71-4c13-b4b8-bd1d86a5a39c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:19.833506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:19.834433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:19.835258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:19.835258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:19.835258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:19.835258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:19.835258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:19.835258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:19.835258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:19.835258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:19.835258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:19.835258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:19.835258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:19.835258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:19.838267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 352/730] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:19.839498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cb594-42bd-4b19-ad82-64a03a8592be None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:19.847349 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110ebce-0f71-4c13-b4b8-bd1d86a5a39c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:19.892736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:19.968611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110ebce-0f71-4c13-b4b8-bd1d86a5a39c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:19.977597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:20.001922 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cb594-42bd-4b19-ad82-64a03a8592be None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:20.011639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479f14c-2a51-4099-a08c-df7e0a2df563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:20.012335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f14c-2a51-4099-a08c-df7e0a2df563 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:20.012619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f14c-2a51-4099-a08c-df7e0a2df563 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:20.012894 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f14c-2a51-4099-a08c-df7e0a2df563 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:20.013650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479f14c-2a51-4099-a08c-df7e0a2df563 None admin] RBAC: Adding query filter params (name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:20.014475 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479f14c-2a51-4099-a08c-df7e0a2df563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:20.015581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479f14c-2a51-4099-a08c-df7e0a2df563 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:20.024245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 353/731] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:37:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:20.030377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd424612-bcc6-46f3-88ed-85dd054d6eb3 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:20.030672 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd424612-bcc6-46f3-88ed-85dd054d6eb3 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:20.030960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd424612-bcc6-46f3-88ed-85dd054d6eb3 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:20.032463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 354/732] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:20.034704 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd424612-bcc6-46f3-88ed-85dd054d6eb3 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:20.052175 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f53e8c-cad1-4aeb-be36-305c5612cf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:20.053631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f53e8c-cad1-4aeb-be36-305c5612cf65 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:20.054521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f53e8c-cad1-4aeb-be36-305c5612cf65 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:20.055066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f53e8c-cad1-4aeb-be36-305c5612cf65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:20.142359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f53e8c-cad1-4aeb-be36-305c5612cf65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:20.143952 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:20.145891 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f53e8c-cad1-4aeb-be36-305c5612cf65 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:20.154370 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd424612-bcc6-46f3-88ed-85dd054d6eb3 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:20.190366 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca9142-d5fd-4ea6-b2ff-5c025a78b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:20.191182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca9142-d5fd-4ea6-b2ff-5c025a78b9ff None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:20.191464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca9142-d5fd-4ea6-b2ff-5c025a78b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:20.191740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca9142-d5fd-4ea6-b2ff-5c025a78b9ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:20.203119 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca9142-d5fd-4ea6-b2ff-5c025a78b9ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:20.204645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca9142-d5fd-4ea6-b2ff-5c025a78b9ff None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-93ca9142-d5fd-4ea6-b2ff-5c025a78b9ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:20.222218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:20.223140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:20.224007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:20.224007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:20.224007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:20.224007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:20.228732 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 355/733] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:20.229411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d860078-afd0-4b13-94fd-c1a8b1bd28a9 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:20.229703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d860078-afd0-4b13-94fd-c1a8b1bd28a9 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:20.229979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d860078-afd0-4b13-94fd-c1a8b1bd28a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:20.241411 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:20.246934 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-1d860078-afd0-4b13-94fd-c1a8b1bd28a9 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:20.248050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1d860078-afd0-4b13-94fd-c1a8b1bd28a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:20.269539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 379/734] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:37:20.270805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f53e8c-cad1-4aeb-be36-305c5612cf65 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:20.324594 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 356/735] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:37:20.324594 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d860078-afd0-4b13-94fd-c1a8b1bd28a9 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:20.388210 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:20.402054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f53e8c-cad1-4aeb-be36-305c5612cf65 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:20.418540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d860078-afd0-4b13-94fd-c1a8b1bd28a9 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:20.436094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be2340-4311-4577-832d-f6f64f1d8199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:20.436795 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be2340-4311-4577-832d-f6f64f1d8199 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:20.437131 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be2340-4311-4577-832d-f6f64f1d8199 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:20.437404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be2340-4311-4577-832d-f6f64f1d8199 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:20.438155 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be2340-4311-4577-832d-f6f64f1d8199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:20.438507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be2340-4311-4577-832d-f6f64f1d8199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:20.439872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be2340-4311-4577-832d-f6f64f1d8199 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:20.455461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 380/736] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:20.455461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be2340-4311-4577-832d-f6f64f1d8199 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:20.457904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba85391-ec8d-45ee-83fc-d4e1db89d865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:20.458714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba85391-ec8d-45ee-83fc-d4e1db89d865 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:20.459002 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba85391-ec8d-45ee-83fc-d4e1db89d865 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:20.459914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba85391-ec8d-45ee-83fc-d4e1db89d865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:20.470371 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba85391-ec8d-45ee-83fc-d4e1db89d865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:20.471829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba85391-ec8d-45ee-83fc-d4e1db89d865 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-0ba85391-ec8d-45ee-83fc-d4e1db89d865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:20.489469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:20.490351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:20.491244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:20.491244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:20.491244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:20.491244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:20.491244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 357/737] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:20.492182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a86578-31ba-47ca-be40-cf43c04eaa8c None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:20.492489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a86578-31ba-47ca-be40-cf43c04eaa8c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:20.492764 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a86578-31ba-47ca-be40-cf43c04eaa8c None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:20.494172 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 358/738] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:20.498857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a86578-31ba-47ca-be40-cf43c04eaa8c None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:20.504120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:20.570348 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be2340-4311-4577-832d-f6f64f1d8199 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:20.600629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a86578-31ba-47ca-be40-cf43c04eaa8c None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:20.606334 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666bf0f-0468-4d12-bbb8-b3ce9f064b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:20.607007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666bf0f-0468-4d12-bbb8-b3ce9f064b5c None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:20.607292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666bf0f-0468-4d12-bbb8-b3ce9f064b5c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:20.607777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666bf0f-0468-4d12-bbb8-b3ce9f064b5c None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:20.608635 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666bf0f-0468-4d12-bbb8-b3ce9f064b5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:20.610132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666bf0f-0468-4d12-bbb8-b3ce9f064b5c None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:20.625532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:20.628028 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 381/739] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Jul 11 15:37:20 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:37:20.629646 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666bf0f-0468-4d12-bbb8-b3ce9f064b5c None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:20.654618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b8c7c-d29b-4af7-bd48-fd99eaf1d28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:20.655895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8c7c-d29b-4af7-bd48-fd99eaf1d28f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:20.656365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8c7c-d29b-4af7-bd48-fd99eaf1d28f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:20.656930 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8c7c-d29b-4af7-bd48-fd99eaf1d28f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:20.668985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b8c7c-d29b-4af7-bd48-fd99eaf1d28f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:20.671746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b8c7c-d29b-4af7-bd48-fd99eaf1d28f None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-fa1b8c7c-d29b-4af7-bd48-fd99eaf1d28f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:20.691207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:20.692265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:20.693261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:20.693261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:20.693261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:20.693261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:20.693261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:20.693261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:20.693261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:20.693261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:20.693261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:37:20.693261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:20.700486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 359/740] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Jul 11 15:37:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:20.702523 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f808b-a607-49ec-a73e-69b096eb88ed None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:20.703044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f808b-a607-49ec-a73e-69b096eb88ed None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:20.703526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f808b-a607-49ec-a73e-69b096eb88ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:20.722057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-d16f808b-a607-49ec-a73e-69b096eb88ed None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:20.723738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d16f808b-a607-49ec-a73e-69b096eb88ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:20.774344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:20.781470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666bf0f-0468-4d12-bbb8-b3ce9f064b5c None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:20.806751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 360/741] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:37:20.807569 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f808b-a607-49ec-a73e-69b096eb88ed None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:20.827351 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85384ea2-cc1e-4db6-9e73-5f77d1c55d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:20.827946 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384ea2-cc1e-4db6-9e73-5f77d1c55d1c None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:20.828214 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384ea2-cc1e-4db6-9e73-5f77d1c55d1c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:20.828516 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384ea2-cc1e-4db6-9e73-5f77d1c55d1c None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:20.829309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85384ea2-cc1e-4db6-9e73-5f77d1c55d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:20.829614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85384ea2-cc1e-4db6-9e73-5f77d1c55d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:20.830987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85384ea2-cc1e-4db6-9e73-5f77d1c55d1c None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:20.845214 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 382/742] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:20.846078 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85384ea2-cc1e-4db6-9e73-5f77d1c55d1c None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:20.954074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f808b-a607-49ec-a73e-69b096eb88ed None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:20.956649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85384ea2-cc1e-4db6-9e73-5f77d1c55d1c None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:20.968355 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:20.994453 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f213669-27cb-4f1d-b597-9f5edaff8066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:20.995365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f213669-27cb-4f1d-b597-9f5edaff8066 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:20.995710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f213669-27cb-4f1d-b597-9f5edaff8066 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:20.995988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f213669-27cb-4f1d-b597-9f5edaff8066 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:20.998721 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5edc54-8bfa-410e-9952-62cadf3f15e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:20.999908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5edc54-8bfa-410e-9952-62cadf3f15e6 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:21.000263 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5edc54-8bfa-410e-9952-62cadf3f15e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:21.000628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5edc54-8bfa-410e-9952-62cadf3f15e6 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:21.001855 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5edc54-8bfa-410e-9952-62cadf3f15e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:21.002230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5edc54-8bfa-410e-9952-62cadf3f15e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:21.004018 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5edc54-8bfa-410e-9952-62cadf3f15e6 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:21.007479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f213669-27cb-4f1d-b597-9f5edaff8066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-3f213669-27cb-4f1d-b597-9f5edaff8066 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:21.015686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:21.016693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:21.017535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:21.017535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:21.017535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:21.017535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:21.017535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:21.017535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:21.017535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:21.017535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:21.017535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:21.017535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:21.017535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:37:21.017535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:21.017535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 383/743] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:37:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:21.018998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f213669-27cb-4f1d-b597-9f5edaff8066 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:21.029054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 361/744] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Jul 11 15:37:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:21.030186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5edc54-8bfa-410e-9952-62cadf3f15e6 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:21.052713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:21.150735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5edc54-8bfa-410e-9952-62cadf3f15e6 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:21.156128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f213669-27cb-4f1d-b597-9f5edaff8066 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:21.191103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091b464-1b26-4304-b9ea-2dd880ac69bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:21.191578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091b464-1b26-4304-b9ea-2dd880ac69bd None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:21.191985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091b464-1b26-4304-b9ea-2dd880ac69bd None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:21.192262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091b464-1b26-4304-b9ea-2dd880ac69bd None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:21.193190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091b464-1b26-4304-b9ea-2dd880ac69bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:21.193499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091b464-1b26-4304-b9ea-2dd880ac69bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:21.194879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091b464-1b26-4304-b9ea-2dd880ac69bd None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:21.204335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 362/745] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:37:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:21.205157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091b464-1b26-4304-b9ea-2dd880ac69bd None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:21.214144 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4ba6f-fc12-4853-81f1-56769bd6b16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:21.214951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4ba6f-fc12-4853-81f1-56769bd6b16f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:21.215231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4ba6f-fc12-4853-81f1-56769bd6b16f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:21.215505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4ba6f-fc12-4853-81f1-56769bd6b16f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:21.223310 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4ba6f-fc12-4853-81f1-56769bd6b16f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:21.224828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4ba6f-fc12-4853-81f1-56769bd6b16f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:21.236703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-60f4ba6f-fc12-4853-81f1-56769bd6b16f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:21.240668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:21.241770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:21.242666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:21.242666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:21.242666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:21.242666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:21.242666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:21.242666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:21.242666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:21.242666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:21.242666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 384/746] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:21.243684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2aaee-efe8-4d1a-a3fb-b52d4e87aedc None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:21.243684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2aaee-efe8-4d1a-a3fb-b52d4e87aedc None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:21.243852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2aaee-efe8-4d1a-a3fb-b52d4e87aedc None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:21.245221 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 385/747] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:21.249205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2aaee-efe8-4d1a-a3fb-b52d4e87aedc None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:21.317654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091b464-1b26-4304-b9ea-2dd880ac69bd None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:21.333630 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:21.355753 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2aaee-efe8-4d1a-a3fb-b52d4e87aedc None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:21.356414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048656e-c294-4287-aa19-2515149c764f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:21.357418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048656e-c294-4287-aa19-2515149c764f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:21.357935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048656e-c294-4287-aa19-2515149c764f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:21.358682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048656e-c294-4287-aa19-2515149c764f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:21.393329 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b1fc3-b1b5-479f-a5b2-4e48af7828b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:21.394226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1fc3-b1b5-479f-a5b2-4e48af7828b8 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:21.394512 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1fc3-b1b5-479f-a5b2-4e48af7828b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:21.394783 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1fc3-b1b5-479f-a5b2-4e48af7828b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:21.405298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b1fc3-b1b5-479f-a5b2-4e48af7828b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:21.406717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b1fc3-b1b5-479f-a5b2-4e48af7828b8 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-117b1fc3-b1b5-479f-a5b2-4e48af7828b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:21.425268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:21.426190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:21.431720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:21.431720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:21.431720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:21.431720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:21.431720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 386/748] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:21.431720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b1fc3-b1b5-479f-a5b2-4e48af7828b8 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:21.437245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048656e-c294-4287-aa19-2515149c764f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:21.438688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048656e-c294-4287-aa19-2515149c764f None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:21.469728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:21.534175 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b1fc3-b1b5-479f-a5b2-4e48af7828b8 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:21.548245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 363/749] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:21 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 15:37:21.548245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080350d2-c75e-4a37-970d-6f8fd9d429e1 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:21.548245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080350d2-c75e-4a37-970d-6f8fd9d429e1 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:21.548245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080350d2-c75e-4a37-970d-6f8fd9d429e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:21.564408 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-080350d2-c75e-4a37-970d-6f8fd9d429e1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:21.565707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-080350d2-c75e-4a37-970d-6f8fd9d429e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:21.570324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:21.579891 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ab9cb-c552-466a-8b14-9c899b56ac0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:21.581053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ab9cb-c552-466a-8b14-9c899b56ac0a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:21.581346 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ab9cb-c552-466a-8b14-9c899b56ac0a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:21.581867 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ab9cb-c552-466a-8b14-9c899b56ac0a None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:21.582441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ab9cb-c552-466a-8b14-9c899b56ac0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:21.582753 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ab9cb-c552-466a-8b14-9c899b56ac0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:21.584203 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ab9cb-c552-466a-8b14-9c899b56ac0a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:21.597730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 387/750] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:21.598412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ab9cb-c552-466a-8b14-9c899b56ac0a None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:21.648454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 364/751] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 15:37:21.648454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080350d2-c75e-4a37-970d-6f8fd9d429e1 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:21.706097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:21.718953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ab9cb-c552-466a-8b14-9c899b56ac0a None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:21.746595 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080350d2-c75e-4a37-970d-6f8fd9d429e1 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:21.755139 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a9514-5c83-4b22-988b-095c4556623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:21.756160 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a9514-5c83-4b22-988b-095c4556623b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:21.756649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a9514-5c83-4b22-988b-095c4556623b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:21.757091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a9514-5c83-4b22-988b-095c4556623b None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:21.758037 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a9514-5c83-4b22-988b-095c4556623b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:21.758511 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a9514-5c83-4b22-988b-095c4556623b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:21.760175 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a9514-5c83-4b22-988b-095c4556623b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:21.772754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 388/752] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:21.773848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a9514-5c83-4b22-988b-095c4556623b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:21.792529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977e8be-10ab-4450-942c-245b38b94160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:21.793337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977e8be-10ab-4450-942c-245b38b94160 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:21.793605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977e8be-10ab-4450-942c-245b38b94160 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:21.793877 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977e8be-10ab-4450-942c-245b38b94160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:21.803813 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977e8be-10ab-4450-942c-245b38b94160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:21.805302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977e8be-10ab-4450-942c-245b38b94160 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-2977e8be-10ab-4450-942c-245b38b94160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:21.822425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:21.823404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:21.824273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:21.824273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:21.824273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:21.824273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:21.824273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 365/753] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:21.824610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977e8be-10ab-4450-942c-245b38b94160 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:21.835729 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:21.886764 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a9514-5c83-4b22-988b-095c4556623b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:21.922419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad9dc9-4ecf-4c3c-8cea-c3bfd40fb18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:21.923084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad9dc9-4ecf-4c3c-8cea-c3bfd40fb18f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:21.923365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad9dc9-4ecf-4c3c-8cea-c3bfd40fb18f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:21.923464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977e8be-10ab-4450-942c-245b38b94160 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:21.923639 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad9dc9-4ecf-4c3c-8cea-c3bfd40fb18f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:21.924497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad9dc9-4ecf-4c3c-8cea-c3bfd40fb18f None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=8eaff8748f8b47e088e0cb7875992a4d) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:21.924909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad9dc9-4ecf-4c3c-8cea-c3bfd40fb18f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:21.926504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad9dc9-4ecf-4c3c-8cea-c3bfd40fb18f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:21.932644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 389/754] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:21 2022] GET /identity/v3/role_assignments?user.id=8eaff8748f8b47e088e0cb7875992a4d&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=32f5ce5800cf40d99d894960288d0155 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:21.933425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad9dc9-4ecf-4c3c-8cea-c3bfd40fb18f None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:21.960516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:21.991235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8928a-73a7-4686-81e3-560c78c89277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:21.991926 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8928a-73a7-4686-81e3-560c78c89277 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:21.992211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8928a-73a7-4686-81e3-560c78c89277 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:21.992535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8928a-73a7-4686-81e3-560c78c89277 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:21.993280 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8928a-73a7-4686-81e3-560c78c89277 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:21.994769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8928a-73a7-4686-81e3-560c78c89277 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:22.019291 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 366/755] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Jul 11 15:37:21 2022] POST /identity/v3/services => generated 240 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:37:22.020304 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8928a-73a7-4686-81e3-560c78c89277 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:22.074284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad9dc9-4ecf-4c3c-8cea-c3bfd40fb18f None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:22.093881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:22.129531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec532d66-95d5-4e35-9ab1-0ceaec932089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:22.130608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec532d66-95d5-4e35-9ab1-0ceaec932089 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:22.131022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec532d66-95d5-4e35-9ab1-0ceaec932089 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:22.131517 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec532d66-95d5-4e35-9ab1-0ceaec932089 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:22.141380 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec532d66-95d5-4e35-9ab1-0ceaec932089 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:22.143185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec532d66-95d5-4e35-9ab1-0ceaec932089 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-ec532d66-95d5-4e35-9ab1-0ceaec932089 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:22.159989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:22.163342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:22.165979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:22.165979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:22.165979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:22.165979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:22.165979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:22.165979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:22.165979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:22.165979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:22.165979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:37:22.165979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:22.165979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 390/756] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Jul 11 15:37:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:22.172689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8928a-73a7-4686-81e3-560c78c89277 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:22.172877 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec532d66-95d5-4e35-9ab1-0ceaec932089 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:22.222138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b193c-5222-499a-b42f-8e126f2d5ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:22.223108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b193c-5222-499a-b42f-8e126f2d5ca3 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:22.223676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b193c-5222-499a-b42f-8e126f2d5ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:22.224147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b193c-5222-499a-b42f-8e126f2d5ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:22.225159 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b193c-5222-499a-b42f-8e126f2d5ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:22.225659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b193c-5222-499a-b42f-8e126f2d5ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:22.227250 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b193c-5222-499a-b42f-8e126f2d5ca3 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:22.241733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 367/757] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:22.250102 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b193c-5222-499a-b42f-8e126f2d5ca3 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:22.295401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:22.316223 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec532d66-95d5-4e35-9ab1-0ceaec932089 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:22.372013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58acaf3-34aa-40e7-b8fe-8daedb8051ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:22.373365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58acaf3-34aa-40e7-b8fe-8daedb8051ae None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:22.373756 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58acaf3-34aa-40e7-b8fe-8daedb8051ae None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:22.374438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58acaf3-34aa-40e7-b8fe-8daedb8051ae None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:22.375470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58acaf3-34aa-40e7-b8fe-8daedb8051ae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:22.376028 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58acaf3-34aa-40e7-b8fe-8daedb8051ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:22.378428 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58acaf3-34aa-40e7-b8fe-8daedb8051ae None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:22.379804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b193c-5222-499a-b42f-8e126f2d5ca3 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:22.419271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedc3c9-cc22-4d9c-b509-c1793e27b765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:22.420497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedc3c9-cc22-4d9c-b509-c1793e27b765 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:22.420923 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedc3c9-cc22-4d9c-b509-c1793e27b765 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:22.421339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedc3c9-cc22-4d9c-b509-c1793e27b765 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:22.429620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedc3c9-cc22-4d9c-b509-c1793e27b765 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:22.431371 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedc3c9-cc22-4d9c-b509-c1793e27b765 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-3dedc3c9-cc22-4d9c-b509-c1793e27b765 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:22.447585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:22.448751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:22.449707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:22.449707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:22.449707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:22.449707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:22.449707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:22.449707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:22.449707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:22.449707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:22.452531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 368/758] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:22.465491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedc3c9-cc22-4d9c-b509-c1793e27b765 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:22.532978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 391/759] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Jul 11 15:37:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:22.539959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58acaf3-34aa-40e7-b8fe-8daedb8051ae None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:22.594301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:22.621371 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:22.630984 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedc3c9-cc22-4d9c-b509-c1793e27b765 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:22.666590 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f025b3-7a40-41a7-ac7a-265c40f41bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:22.667705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f025b3-7a40-41a7-ac7a-265c40f41bb6 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:22.668255 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f025b3-7a40-41a7-ac7a-265c40f41bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:22.668747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f025b3-7a40-41a7-ac7a-265c40f41bb6 None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:22.669740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f025b3-7a40-41a7-ac7a-265c40f41bb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:22.670346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f025b3-7a40-41a7-ac7a-265c40f41bb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:22.672009 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f025b3-7a40-41a7-ac7a-265c40f41bb6 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:22.686270 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 369/760] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:22.691629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f025b3-7a40-41a7-ac7a-265c40f41bb6 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:22.778260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58acaf3-34aa-40e7-b8fe-8daedb8051ae None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:22.799687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f025b3-7a40-41a7-ac7a-265c40f41bb6 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:22.839766 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ba9e7-e2d2-4e52-9bd0-59959614be79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:22.841100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ba9e7-e2d2-4e52-9bd0-59959614be79 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:22.841597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ba9e7-e2d2-4e52-9bd0-59959614be79 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:22.842185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ba9e7-e2d2-4e52-9bd0-59959614be79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:22.843405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ba9e7-e2d2-4e52-9bd0-59959614be79 None admin] RBAC: Adding query filter params (role.id=c8fd28e5c32f4759a288774fddec4493, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=8c910084851040cf817aa92ede9d0d97) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:22.843913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ba9e7-e2d2-4e52-9bd0-59959614be79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:22.846399 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ba9e7-e2d2-4e52-9bd0-59959614be79 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:22.850312 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f7dae-71e7-4391-a0b6-94ad9abf9156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:22.851122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f7dae-71e7-4391-a0b6-94ad9abf9156 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:22.851476 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f7dae-71e7-4391-a0b6-94ad9abf9156 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:22.851663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f7dae-71e7-4391-a0b6-94ad9abf9156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:22.854620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 370/761] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:22 2022] GET /identity/v3/role_assignments?user.id=8c910084851040cf817aa92ede9d0d97&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c8fd28e5c32f4759a288774fddec4493 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:22.856152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e06e54-3919-4ae4-8d87-95172b46f1ef None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:22.856664 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e06e54-3919-4ae4-8d87-95172b46f1ef None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:22.857146 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e06e54-3919-4ae4-8d87-95172b46f1ef None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:22.860128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 371/762] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:22.863004 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f7dae-71e7-4391-a0b6-94ad9abf9156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:22.864556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f7dae-71e7-4391-a0b6-94ad9abf9156 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:22.865412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25915f46-aae2-4b17-bd2f-722c422d2331 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:22.865896 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25915f46-aae2-4b17-bd2f-722c422d2331 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:22.866764 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25915f46-aae2-4b17-bd2f-722c422d2331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-e56f7dae-71e7-4391-a0b6-94ad9abf9156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:22.886542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:22.887505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:22.889387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:22.889387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:22.889387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:22.889387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:22.889387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 392/763] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:22.892581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-25915f46-aae2-4b17-bd2f-722c422d2331 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:22.894197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-25915f46-aae2-4b17-bd2f-722c422d2331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:22.894349 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f7dae-71e7-4391-a0b6-94ad9abf9156 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:22.910375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:22.985958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 372/764] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:23.020441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25915f46-aae2-4b17-bd2f-722c422d2331 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:23.036628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:23.063379 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f7dae-71e7-4391-a0b6-94ad9abf9156 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:23.127866 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fc8ab-2d5c-44ed-a654-24076b5e1d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:23.128657 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc8ab-2d5c-44ed-a654-24076b5e1d40 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:23.128858 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc8ab-2d5c-44ed-a654-24076b5e1d40 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:23.129133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc8ab-2d5c-44ed-a654-24076b5e1d40 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:23.129881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fc8ab-2d5c-44ed-a654-24076b5e1d40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:23.130187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fc8ab-2d5c-44ed-a654-24076b5e1d40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:23.131577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fc8ab-2d5c-44ed-a654-24076b5e1d40 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:23.131988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25915f46-aae2-4b17-bd2f-722c422d2331 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:23.157270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 393/765] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:23.163008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fc8ab-2d5c-44ed-a654-24076b5e1d40 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:23.169998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00201519-2413-4eb1-91e0-8b1b7ad61218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:23.171242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00201519-2413-4eb1-91e0-8b1b7ad61218 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:23.171742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00201519-2413-4eb1-91e0-8b1b7ad61218 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:23.172215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00201519-2413-4eb1-91e0-8b1b7ad61218 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:23.173218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00201519-2413-4eb1-91e0-8b1b7ad61218 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:23.174801 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00201519-2413-4eb1-91e0-8b1b7ad61218 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-00201519-2413-4eb1-91e0-8b1b7ad61218 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:23.189153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:23.190128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:37:23.191441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:23.196683 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 373/766] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Jul 11 15:37:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:23.202423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00201519-2413-4eb1-91e0-8b1b7ad61218 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:23.217436 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:23.314385 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fc8ab-2d5c-44ed-a654-24076b5e1d40 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:23.315373 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00201519-2413-4eb1-91e0-8b1b7ad61218 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:23.354291 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28422d-80b7-4b5a-9ab4-acceefd73f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:23.355372 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28422d-80b7-4b5a-9ab4-acceefd73f1d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:23.355908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28422d-80b7-4b5a-9ab4-acceefd73f1d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:23.356409 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28422d-80b7-4b5a-9ab4-acceefd73f1d None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:23.357409 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28422d-80b7-4b5a-9ab4-acceefd73f1d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:23.358012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28422d-80b7-4b5a-9ab4-acceefd73f1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:23.359706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28422d-80b7-4b5a-9ab4-acceefd73f1d None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:23.365480 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 374/767] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Jul 11 15:37:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:23.370459 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28422d-80b7-4b5a-9ab4-acceefd73f1d None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:23.384391 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200b04f-8958-4c5f-86b4-31c0463749b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:23.385298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200b04f-8958-4c5f-86b4-31c0463749b8 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:23.385577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200b04f-8958-4c5f-86b4-31c0463749b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:23.385846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200b04f-8958-4c5f-86b4-31c0463749b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:23.399492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200b04f-8958-4c5f-86b4-31c0463749b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:23.401090 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200b04f-8958-4c5f-86b4-31c0463749b8 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-4200b04f-8958-4c5f-86b4-31c0463749b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:23.429314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:23.430258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:23.431624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:23.431624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:23.431624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:23.431624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:23.431624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:23.431624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:23.431624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:23.431624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:23.431624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 394/768] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:23.437058 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200b04f-8958-4c5f-86b4-31c0463749b8 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:23.441787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:23.459254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:23.486734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28422d-80b7-4b5a-9ab4-acceefd73f1d None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:23.542861 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8567c9-f85e-4d1e-95ac-3b761beb7ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:23.543533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8567c9-f85e-4d1e-95ac-3b761beb7ed1 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:23.543812 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8567c9-f85e-4d1e-95ac-3b761beb7ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:23.544083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8567c9-f85e-4d1e-95ac-3b761beb7ed1 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:23.544831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8567c9-f85e-4d1e-95ac-3b761beb7ed1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:23.545190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8567c9-f85e-4d1e-95ac-3b761beb7ed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:23.546568 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8567c9-f85e-4d1e-95ac-3b761beb7ed1 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:23.559850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 375/769] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Jul 11 15:37:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:23.562675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8567c9-f85e-4d1e-95ac-3b761beb7ed1 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:23.618713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200b04f-8958-4c5f-86b4-31c0463749b8 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:23.696882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f2a83-7fcb-493f-ac1a-4ed21d043a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:23.697562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f2a83-7fcb-493f-ac1a-4ed21d043a24 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:23.697842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f2a83-7fcb-493f-ac1a-4ed21d043a24 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:23.698166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f2a83-7fcb-493f-ac1a-4ed21d043a24 None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:23.698976 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f2a83-7fcb-493f-ac1a-4ed21d043a24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:23.699284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f2a83-7fcb-493f-ac1a-4ed21d043a24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:23.701264 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f2a83-7fcb-493f-ac1a-4ed21d043a24 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:23.734472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 395/770] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:23.737689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f2a83-7fcb-493f-ac1a-4ed21d043a24 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:23.766442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8567c9-f85e-4d1e-95ac-3b761beb7ed1 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:23.830854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0a967-0a6d-4d9c-97b5-40d72595726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:23.831525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0a967-0a6d-4d9c-97b5-40d72595726a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:23.831824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0a967-0a6d-4d9c-97b5-40d72595726a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:23.832067 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0a967-0a6d-4d9c-97b5-40d72595726a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:23.832891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0a967-0a6d-4d9c-97b5-40d72595726a None admin] RBAC: Adding query filter params (interface=public, service_id=015b09eeb0ef431ca0554ce2ced9a463, region_id=RegionOne) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:23.833200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0a967-0a6d-4d9c-97b5-40d72595726a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:23.834579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0a967-0a6d-4d9c-97b5-40d72595726a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:23.842087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:23.856430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 376/771] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Jul 11 15:37:23 2022] GET /identity/v3/endpoints?service_id=015b09eeb0ef431ca0554ce2ced9a463&interface=public®ion_id=RegionOne => generated 194 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:23.861548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0a967-0a6d-4d9c-97b5-40d72595726a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:23.866769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:23.915140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f2a83-7fcb-493f-ac1a-4ed21d043a24 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:23.957935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ef447-81be-4dbe-a868-10ac883f3d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:23.958845 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ef447-81be-4dbe-a868-10ac883f3d21 None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:23.959128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ef447-81be-4dbe-a868-10ac883f3d21 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:23.959404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ef447-81be-4dbe-a868-10ac883f3d21 None admin] PATH_INFO: `/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/fa038a2e30f544aaa609d32e0e1ceaa0/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:23.961429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ef447-81be-4dbe-a868-10ac883f3d21 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fe17aeb94ad42dc990c9d963dac9af6, user_id=fa038a2e30f544aaa609d32e0e1ceaa0, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:23.963207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ef447-81be-4dbe-a868-10ac883f3d21 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:23.978442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 396/772] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:37:23 2022] PUT /identity/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/fa038a2e30f544aaa609d32e0e1ceaa0/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:37:24.018091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0a967-0a6d-4d9c-97b5-40d72595726a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:24.056555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d49fb-c9bd-41dd-a7d3-26622d025f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:24.057550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d49fb-c9bd-41dd-a7d3-26622d025f0e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:24.057694 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d49fb-c9bd-41dd-a7d3-26622d025f0e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:24.058028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d49fb-c9bd-41dd-a7d3-26622d025f0e None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:24.058668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d49fb-c9bd-41dd-a7d3-26622d025f0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:24.060059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d49fb-c9bd-41dd-a7d3-26622d025f0e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:24.066175 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 377/773] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Jul 11 15:37:23 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:24.303588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c4f32-2962-4b89-9572-06bf7d29cfde None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:24.304159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c4f32-2962-4b89-9572-06bf7d29cfde None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:24.304159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c4f32-2962-4b89-9572-06bf7d29cfde None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:24.305921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 397/774] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:24.312336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cecc9-4e1b-4e47-b244-615d0f3bd966 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:24.312969 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cecc9-4e1b-4e47-b244-615d0f3bd966 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:24.313435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cecc9-4e1b-4e47-b244-615d0f3bd966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:24.332633 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-fb6cecc9-4e1b-4e47-b244-615d0f3bd966 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:24.334190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fb6cecc9-4e1b-4e47-b244-615d0f3bd966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:24.405605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:24.418036 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 378/775] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:24.440486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c4f32-2962-4b89-9572-06bf7d29cfde None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:24.583370 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c4f32-2962-4b89-9572-06bf7d29cfde None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:24.614992 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:24.627855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc585c-70f3-4539-bf0a-c484ca3ada40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:24.628994 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc585c-70f3-4539-bf0a-c484ca3ada40 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:24.629497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc585c-70f3-4539-bf0a-c484ca3ada40 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:24.630104 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc585c-70f3-4539-bf0a-c484ca3ada40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:24.652714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc585c-70f3-4539-bf0a-c484ca3ada40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-9ccc585c-70f3-4539-bf0a-c484ca3ada40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:24.661163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:24.662097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:24.662937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:24.662937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:24.662937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:24.662937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:24.662937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:24.662937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:24.662937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:24.662937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:24.662937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:24.662937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:24.662937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:37:24.662937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:24.662937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 398/776] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:37:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:24.668556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cecc9-4e1b-4e47-b244-615d0f3bd966 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:24.819804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cecc9-4e1b-4e47-b244-615d0f3bd966 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:24.872140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afb101-296b-40e8-8e4a-ef8e9d27a05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:24.872843 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afb101-296b-40e8-8e4a-ef8e9d27a05b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:24.873154 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afb101-296b-40e8-8e4a-ef8e9d27a05b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:24.873946 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afb101-296b-40e8-8e4a-ef8e9d27a05b None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:24.874714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afb101-296b-40e8-8e4a-ef8e9d27a05b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:24.875024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afb101-296b-40e8-8e4a-ef8e9d27a05b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:24.876432 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afb101-296b-40e8-8e4a-ef8e9d27a05b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:24.885638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016d12-c9a9-40a6-8c2a-76874647b709 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:24.885926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016d12-c9a9-40a6-8c2a-76874647b709 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:24.886205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016d12-c9a9-40a6-8c2a-76874647b709 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:24.887690 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 399/777] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:37:24.893221 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 379/778] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:24.898241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afb101-296b-40e8-8e4a-ef8e9d27a05b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:24.898492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d84991-db3b-4f0a-a578-26a9fcf83b5c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:24.898782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d84991-db3b-4f0a-a578-26a9fcf83b5c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:24.899054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d84991-db3b-4f0a-a578-26a9fcf83b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:24.932660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-84d84991-db3b-4f0a-a578-26a9fcf83b5c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:24.933847 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-84d84991-db3b-4f0a-a578-26a9fcf83b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:25.001178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:25.065103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 400/779] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:25.068568 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afb101-296b-40e8-8e4a-ef8e9d27a05b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:25.101669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d84991-db3b-4f0a-a578-26a9fcf83b5c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:25.125055 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecab13-4f0e-4d97-a6aa-ada2fd3c3663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:25.125860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecab13-4f0e-4d97-a6aa-ada2fd3c3663 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:25.126136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecab13-4f0e-4d97-a6aa-ada2fd3c3663 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:25.126407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecab13-4f0e-4d97-a6aa-ada2fd3c3663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:25.139709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecab13-4f0e-4d97-a6aa-ada2fd3c3663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:25.141206 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecab13-4f0e-4d97-a6aa-ada2fd3c3663 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-ebecab13-4f0e-4d97-a6aa-ada2fd3c3663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:25.160632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:25.162713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:25.164825 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:25.164825 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:25.164825 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:25.164825 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:25.164825 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 380/780] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:25.169012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecab13-4f0e-4d97-a6aa-ada2fd3c3663 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:25.279526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d84991-db3b-4f0a-a578-26a9fcf83b5c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:25.304697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:25.335911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecab13-4f0e-4d97-a6aa-ada2fd3c3663 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:25.347285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab1cd7-6c11-48ed-99c9-2023a2cfaec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:25.348097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab1cd7-6c11-48ed-99c9-2023a2cfaec2 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:25.348401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab1cd7-6c11-48ed-99c9-2023a2cfaec2 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:25.348674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab1cd7-6c11-48ed-99c9-2023a2cfaec2 None admin] PATH_INFO: `/v3/services/network` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:25.349345 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab1cd7-6c11-48ed-99c9-2023a2cfaec2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:25.351042 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab1cd7-6c11-48ed-99c9-2023a2cfaec2 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:25.356033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-d2ab1cd7-6c11-48ed-99c9-2023a2cfaec2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:25.372624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:25.373693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:25.375360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 401/781] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:25 2022] GET /identity/v3/services/network => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:25.383201 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab1cd7-6c11-48ed-99c9-2023a2cfaec2 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:25.401452 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615a38f-5e8e-456b-8be5-a02d5ef4860e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:25.402184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615a38f-5e8e-456b-8be5-a02d5ef4860e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:25.402476 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615a38f-5e8e-456b-8be5-a02d5ef4860e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:25.402754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615a38f-5e8e-456b-8be5-a02d5ef4860e None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:25.403503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615a38f-5e8e-456b-8be5-a02d5ef4860e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:25.403815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615a38f-5e8e-456b-8be5-a02d5ef4860e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:25.405316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615a38f-5e8e-456b-8be5-a02d5ef4860e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:25.435834 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 381/782] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:25.440935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615a38f-5e8e-456b-8be5-a02d5ef4860e None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:25.553526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615a38f-5e8e-456b-8be5-a02d5ef4860e None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:25.572558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab1cd7-6c11-48ed-99c9-2023a2cfaec2 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:25.591135 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574ddf6-86b3-4953-9676-ced2f371cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:25.592091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ddf6-86b3-4953-9676-ced2f371cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:25.592482 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ddf6-86b3-4953-9676-ced2f371cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:25.592934 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ddf6-86b3-4953-9676-ced2f371cdc4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:25.600718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574ddf6-86b3-4953-9676-ced2f371cdc4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:25.602183 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574ddf6-86b3-4953-9676-ced2f371cdc4 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:25.614918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3113a4-72bd-4757-88ef-25f1e8285636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:25.615847 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3113a4-72bd-4757-88ef-25f1e8285636 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:25.616360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3113a4-72bd-4757-88ef-25f1e8285636 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:25.616834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3113a4-72bd-4757-88ef-25f1e8285636 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-3574ddf6-86b3-4953-9676-ced2f371cdc4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:25.617707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:25.618605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:25.619525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:25.619525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:25.619525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:25.619525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:25.619525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:25.619525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:25.619525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:25.619525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:25.619525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:37:25.619525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:25.619525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 382/783] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:37:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:25.620659 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3113a4-72bd-4757-88ef-25f1e8285636 None admin] RBAC: Adding query filter params (name=network) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:25.620933 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26a396-67f9-4e20-88ce-65d477fcbc23 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:25.621215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26a396-67f9-4e20-88ce-65d477fcbc23 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:25.621506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26a396-67f9-4e20-88ce-65d477fcbc23 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:25.621841 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3113a4-72bd-4757-88ef-25f1e8285636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:25.626910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 383/784] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:25.626910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26a396-67f9-4e20-88ce-65d477fcbc23 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:25.628005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3113a4-72bd-4757-88ef-25f1e8285636 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:25.634910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 402/785] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Jul 11 15:37:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:25.636875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ba152-9e5a-4a3c-bbdf-ec2f2a69510c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:25.637436 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ba152-9e5a-4a3c-bbdf-ec2f2a69510c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:25.637909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ba152-9e5a-4a3c-bbdf-ec2f2a69510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:25.657395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-828ba152-9e5a-4a3c-bbdf-ec2f2a69510c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:25.658906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-828ba152-9e5a-4a3c-bbdf-ec2f2a69510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:25.661394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:25.734895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:25.735298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 403/786] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:25.736493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ba152-9e5a-4a3c-bbdf-ec2f2a69510c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:25.736817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26a396-67f9-4e20-88ce-65d477fcbc23 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:25.774331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fda68-d028-4bee-adac-92c4901c233b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:25.775003 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fda68-d028-4bee-adac-92c4901c233b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:25.775282 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fda68-d028-4bee-adac-92c4901c233b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:25.775557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fda68-d028-4bee-adac-92c4901c233b None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:25.776850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fda68-d028-4bee-adac-92c4901c233b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:25.777159 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fda68-d028-4bee-adac-92c4901c233b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:25.778588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fda68-d028-4bee-adac-92c4901c233b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:25.800770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 384/787] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Jul 11 15:37:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:25.801515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fda68-d028-4bee-adac-92c4901c233b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:25.861860 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ba152-9e5a-4a3c-bbdf-ec2f2a69510c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:25.887689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:25.900277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ffeed-26c9-4e4d-b5ea-92490e715188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:25.901205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fda68-d028-4bee-adac-92c4901c233b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:25.901541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ffeed-26c9-4e4d-b5ea-92490e715188 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:25.902014 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ffeed-26c9-4e4d-b5ea-92490e715188 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:25.902596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ffeed-26c9-4e4d-b5ea-92490e715188 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:25.903611 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ffeed-26c9-4e4d-b5ea-92490e715188 None admin] RBAC: Adding query filter params (type=network) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:25.904112 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ffeed-26c9-4e4d-b5ea-92490e715188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:25.905853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ffeed-26c9-4e4d-b5ea-92490e715188 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:25.912937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 404/788] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Jul 11 15:37:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:25.913998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ffeed-26c9-4e4d-b5ea-92490e715188 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:25.943134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838dead-45c9-40a7-85f3-ce4883e53ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:25.943936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838dead-45c9-40a7-85f3-ce4883e53ff8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:25.944311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838dead-45c9-40a7-85f3-ce4883e53ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:25.944642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838dead-45c9-40a7-85f3-ce4883e53ff8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:25.955138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838dead-45c9-40a7-85f3-ce4883e53ff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-5838dead-45c9-40a7-85f3-ce4883e53ff8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:25.963060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:25.964034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:25.964897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:25.964897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:25.964897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:25.964897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:25.964897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:25.964897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:25.964897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:25.964897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:25.964897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:25.964897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:25.964897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:25.964897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:25.969429 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 385/789] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:25.970305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838dead-45c9-40a7-85f3-ce4883e53ff8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:26.040870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ffeed-26c9-4e4d-b5ea-92490e715188 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:26.044671 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:26.072077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838dead-45c9-40a7-85f3-ce4883e53ff8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:26.080042 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4813d6-4510-4fc4-a805-a211f7ab5e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:26.081318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4813d6-4510-4fc4-a805-a211f7ab5e07 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:26.081831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4813d6-4510-4fc4-a805-a211f7ab5e07 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:26.082398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4813d6-4510-4fc4-a805-a211f7ab5e07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:26.094450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4813d6-4510-4fc4-a805-a211f7ab5e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:26.096236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4813d6-4510-4fc4-a805-a211f7ab5e07 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:26.108125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338fb10-c856-4a23-a78d-a6c85969fb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:26.108825 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338fb10-c856-4a23-a78d-a6c85969fb7a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:26.109103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338fb10-c856-4a23-a78d-a6c85969fb7a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:26.109373 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338fb10-c856-4a23-a78d-a6c85969fb7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:26.110172 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338fb10-c856-4a23-a78d-a6c85969fb7a None admin] RBAC: Adding query filter params (interface=public, service_id=1d4bc9ce10fe419eb1d38d49418771dc, region_id=RegionOne) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:26.110482 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338fb10-c856-4a23-a78d-a6c85969fb7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:26.111868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338fb10-c856-4a23-a78d-a6c85969fb7a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-ae4813d6-4510-4fc4-a805-a211f7ab5e07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:26.117982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:26.118855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:26.119747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:26.119747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:26.119747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:26.119747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:26.120610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 386/790] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Jul 11 15:37:25 2022] GET /identity/v3/endpoints?service_id=1d4bc9ce10fe419eb1d38d49418771dc&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:26.121453 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338fb10-c856-4a23-a78d-a6c85969fb7a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:26.122410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 405/791] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:26.130474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4813d6-4510-4fc4-a805-a211f7ab5e07 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:26.142655 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:26.238575 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:26.255361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4813d6-4510-4fc4-a805-a211f7ab5e07 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:26.264776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338fb10-c856-4a23-a78d-a6c85969fb7a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:26.298333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec125c-3d97-415d-851a-08cc296499bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:26.299360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec125c-3d97-415d-851a-08cc296499bb None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:26.299888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec125c-3d97-415d-851a-08cc296499bb None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:26.300506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec125c-3d97-415d-851a-08cc296499bb None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:26.301401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec125c-3d97-415d-851a-08cc296499bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:26.303162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec125c-3d97-415d-851a-08cc296499bb None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:26.305546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007a7b9-e9ba-4845-8d90-4446f30301c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:26.308413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007a7b9-e9ba-4845-8d90-4446f30301c8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:26.308413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007a7b9-e9ba-4845-8d90-4446f30301c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:26.308413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007a7b9-e9ba-4845-8d90-4446f30301c8 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:26.308413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007a7b9-e9ba-4845-8d90-4446f30301c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:26.308413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007a7b9-e9ba-4845-8d90-4446f30301c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:26.309020 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007a7b9-e9ba-4845-8d90-4446f30301c8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:26.320738 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 406/793] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Jul 11 15:37:26 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:26.322400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec125c-3d97-415d-851a-08cc296499bb None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:26.322724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 387/793] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:37:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:26.323789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007a7b9-e9ba-4845-8d90-4446f30301c8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:26.435590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec125c-3d97-415d-851a-08cc296499bb None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:26.453852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:26.489399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0faf4b6-08c9-4f63-a1f6-a140820a5cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:26.490356 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0faf4b6-08c9-4f63-a1f6-a140820a5cf8 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:26.490642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0faf4b6-08c9-4f63-a1f6-a140820a5cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:26.490921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0faf4b6-08c9-4f63-a1f6-a140820a5cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:26.491691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0faf4b6-08c9-4f63-a1f6-a140820a5cf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:26.492002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0faf4b6-08c9-4f63-a1f6-a140820a5cf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:26.494562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0faf4b6-08c9-4f63-a1f6-a140820a5cf8 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:26.496802 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007a7b9-e9ba-4845-8d90-4446f30301c8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:26.508807 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 407/794] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:26.510155 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e1658-deaf-40f5-ad4e-5689372963a0 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:26.510445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e1658-deaf-40f5-ad4e-5689372963a0 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:26.510726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e1658-deaf-40f5-ad4e-5689372963a0 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:26.511956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 408/795] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:26.513051 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b0143-7cbb-457e-81dd-d6e7761aba27 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:26.513528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b0143-7cbb-457e-81dd-d6e7761aba27 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:26.514067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b0143-7cbb-457e-81dd-d6e7761aba27 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:26.516434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 409/796] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:26.517595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b0143-7cbb-457e-81dd-d6e7761aba27 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:26.530391 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:26.546072 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695c45d-5f0f-4947-830a-db65bede265a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:26.547038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695c45d-5f0f-4947-830a-db65bede265a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:26.547337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695c45d-5f0f-4947-830a-db65bede265a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:26.547606 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695c45d-5f0f-4947-830a-db65bede265a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:26.562138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695c45d-5f0f-4947-830a-db65bede265a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:26.563665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695c45d-5f0f-4947-830a-db65bede265a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-0695c45d-5f0f-4947-830a-db65bede265a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:26.582238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:26.583982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:26.584919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:26.584919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:26.584919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:26.584919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:26.584919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 388/797] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:26.584919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da60c-3652-4f15-beea-2c055ade21a0 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:26.585253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da60c-3652-4f15-beea-2c055ade21a0 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:26.585484 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da60c-3652-4f15-beea-2c055ade21a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:26.603794 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-df1da60c-3652-4f15-beea-2c055ade21a0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:26.605001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-df1da60c-3652-4f15-beea-2c055ade21a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:26.630070 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b0143-7cbb-457e-81dd-d6e7761aba27 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:26.667614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8db701-43cf-43f3-b0d8-045652e6b3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:26.668725 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8db701-43cf-43f3-b0d8-045652e6b3af None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:26.669159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8db701-43cf-43f3-b0d8-045652e6b3af None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:26.669507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8db701-43cf-43f3-b0d8-045652e6b3af None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:26.676044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 389/798] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:26.677199 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ee2a8-8bfb-40e1-9ad2-8797375228d0 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:26.677483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ee2a8-8bfb-40e1-9ad2-8797375228d0 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:26.677753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ee2a8-8bfb-40e1-9ad2-8797375228d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:26.680784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8db701-43cf-43f3-b0d8-045652e6b3af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:26.682889 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8db701-43cf-43f3-b0d8-045652e6b3af None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:26.694589 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-460ee2a8-8bfb-40e1-9ad2-8797375228d0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:26.695767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-460ee2a8-8bfb-40e1-9ad2-8797375228d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-ee8db701-43cf-43f3-b0d8-045652e6b3af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:26.701157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:26.702026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:26.702917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:26.702917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:26.702917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:26.702917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:26.702917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:26.702917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:26.702917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:26.702917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:26.705062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 410/799] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:26.705641 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8db701-43cf-43f3-b0d8-045652e6b3af None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:26.753359 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:26.772555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 390/800] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:26.773584 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ee2a8-8bfb-40e1-9ad2-8797375228d0 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:26.785216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:26.818785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8db701-43cf-43f3-b0d8-045652e6b3af None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:26.854160 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfb10e-57e3-4abd-ad1e-47ad8c3a84b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:26.854806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfb10e-57e3-4abd-ad1e-47ad8c3a84b9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:26.855089 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfb10e-57e3-4abd-ad1e-47ad8c3a84b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:26.855358 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfb10e-57e3-4abd-ad1e-47ad8c3a84b9 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:26.856085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfb10e-57e3-4abd-ad1e-47ad8c3a84b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:26.856417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfb10e-57e3-4abd-ad1e-47ad8c3a84b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:26.857834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfb10e-57e3-4abd-ad1e-47ad8c3a84b9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:26.875117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 411/801] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:26.875117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfb10e-57e3-4abd-ad1e-47ad8c3a84b9 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:26.896687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ee2a8-8bfb-40e1-9ad2-8797375228d0 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:26.935192 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74666f4e-38c0-49ad-b499-5d6961dcf6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:26.936476 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74666f4e-38c0-49ad-b499-5d6961dcf6ad None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:26.936930 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74666f4e-38c0-49ad-b499-5d6961dcf6ad None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:26.937316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74666f4e-38c0-49ad-b499-5d6961dcf6ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:26.938025 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74666f4e-38c0-49ad-b499-5d6961dcf6ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:26.939453 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74666f4e-38c0-49ad-b499-5d6961dcf6ad None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-74666f4e-38c0-49ad-b499-5d6961dcf6ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:26.952021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:26.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 15:37:26.953804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:26.956598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 391/802] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Jul 11 15:37:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:26.958071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74666f4e-38c0-49ad-b499-5d6961dcf6ad None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:26.982511 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfb10e-57e3-4abd-ad1e-47ad8c3a84b9 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:27.008785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:27.014629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:27.019978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14444c7-1dd1-4cd9-afa6-dfec24636c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:27.020686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14444c7-1dd1-4cd9-afa6-dfec24636c96 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:27.021207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14444c7-1dd1-4cd9-afa6-dfec24636c96 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:27.021543 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14444c7-1dd1-4cd9-afa6-dfec24636c96 None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:27.022346 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14444c7-1dd1-4cd9-afa6-dfec24636c96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:27.022654 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14444c7-1dd1-4cd9-afa6-dfec24636c96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:27.024095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14444c7-1dd1-4cd9-afa6-dfec24636c96 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:27.035814 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 412/803] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:27.043211 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14444c7-1dd1-4cd9-afa6-dfec24636c96 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:27.070345 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74666f4e-38c0-49ad-b499-5d6961dcf6ad None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:27.106568 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770b004-76da-42fc-a17d-44be0eacff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:27.107424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770b004-76da-42fc-a17d-44be0eacff8d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:27.107695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770b004-76da-42fc-a17d-44be0eacff8d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:27.107974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770b004-76da-42fc-a17d-44be0eacff8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:27.119076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770b004-76da-42fc-a17d-44be0eacff8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-6770b004-76da-42fc-a17d-44be0eacff8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:27.126719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:27.127690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:27.128537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:27.128537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:27.128537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:27.128537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:27.128537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:27.128537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:27.128537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:27.128537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:27.128537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:27.128537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:27.128537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:37:27.128537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:27.128537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 392/804] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:37:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:27.129217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770b004-76da-42fc-a17d-44be0eacff8d None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:27.160729 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14444c7-1dd1-4cd9-afa6-dfec24636c96 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:27.201513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37235ebc-b354-482c-9a3e-c4a95228bfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:27.202570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37235ebc-b354-482c-9a3e-c4a95228bfeb None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:27.202804 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37235ebc-b354-482c-9a3e-c4a95228bfeb None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:27.203082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37235ebc-b354-482c-9a3e-c4a95228bfeb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:27.210913 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37235ebc-b354-482c-9a3e-c4a95228bfeb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:27.212716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37235ebc-b354-482c-9a3e-c4a95228bfeb None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-37235ebc-b354-482c-9a3e-c4a95228bfeb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:27.227616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:27.228817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:27.229730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:27.229730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:27.229730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:27.229730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:27.229730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:27.229730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:27.229730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:27.229730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:27.229730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:37:27.229730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:27.232711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 413/805] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Jul 11 15:37:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:27.233751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37235ebc-b354-482c-9a3e-c4a95228bfeb None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:27.246947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770b004-76da-42fc-a17d-44be0eacff8d None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:27.258247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:27.285738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4637e86-fef2-4bf3-b71e-beed89c0ae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:27.286577 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637e86-fef2-4bf3-b71e-beed89c0ae40 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:27.286686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637e86-fef2-4bf3-b71e-beed89c0ae40 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:27.286938 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637e86-fef2-4bf3-b71e-beed89c0ae40 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:27.287307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:27.287646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4637e86-fef2-4bf3-b71e-beed89c0ae40 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:27.287949 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4637e86-fef2-4bf3-b71e-beed89c0ae40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:27.289416 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4637e86-fef2-4bf3-b71e-beed89c0ae40 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:27.298705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 393/806] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Jul 11 15:37:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:27.298705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4637e86-fef2-4bf3-b71e-beed89c0ae40 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:27.351368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37235ebc-b354-482c-9a3e-c4a95228bfeb None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:27.386049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c60331-e4d2-4722-8126-7329103643e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:27.386962 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c60331-e4d2-4722-8126-7329103643e8 None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:27.387219 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c60331-e4d2-4722-8126-7329103643e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:27.387483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c60331-e4d2-4722-8126-7329103643e8 None admin] PATH_INFO: `/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/8eaff8748f8b47e088e0cb7875992a4d/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:27.389693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c60331-e4d2-4722-8126-7329103643e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fe17aeb94ad42dc990c9d963dac9af6, user_id=8eaff8748f8b47e088e0cb7875992a4d, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:27.391145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c60331-e4d2-4722-8126-7329103643e8 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:27.403985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4637e86-fef2-4bf3-b71e-beed89c0ae40 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:27.405563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 414/807] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:37:27 2022] PUT /identity/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/8eaff8748f8b47e088e0cb7875992a4d/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:37:27.406344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c60331-e4d2-4722-8126-7329103643e8 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:27.454863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e8ea7-dc82-454d-845e-c44733b20648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:27.455535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e8ea7-dc82-454d-845e-c44733b20648 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:27.455822 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e8ea7-dc82-454d-845e-c44733b20648 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:27.456090 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e8ea7-dc82-454d-845e-c44733b20648 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:27.456886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e8ea7-dc82-454d-845e-c44733b20648 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:27.457191 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e8ea7-dc82-454d-845e-c44733b20648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:27.458589 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e8ea7-dc82-454d-845e-c44733b20648 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:27.468896 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 394/808] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:37:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:27.469773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e8ea7-dc82-454d-845e-c44733b20648 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:27.512227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:27.557190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c60331-e4d2-4722-8126-7329103643e8 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:27.569388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:27.590180 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e8ea7-dc82-454d-845e-c44733b20648 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:27.598860 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d05be6-e2bf-4636-a0a3-a9ecafa03a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:27.599851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d05be6-e2bf-4636-a0a3-a9ecafa03a10 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:27.600395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d05be6-e2bf-4636-a0a3-a9ecafa03a10 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:27.600732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d05be6-e2bf-4636-a0a3-a9ecafa03a10 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:27.601594 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d05be6-e2bf-4636-a0a3-a9ecafa03a10 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:27.601898 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d05be6-e2bf-4636-a0a3-a9ecafa03a10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:27.603329 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d05be6-e2bf-4636-a0a3-a9ecafa03a10 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:27.623140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 415/809] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Jul 11 15:37:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:27.623935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d05be6-e2bf-4636-a0a3-a9ecafa03a10 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:27.644055 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069ca65-989b-47cd-979e-8623ea7d0fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:27.645201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069ca65-989b-47cd-979e-8623ea7d0fd2 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:27.645740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069ca65-989b-47cd-979e-8623ea7d0fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:27.646213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069ca65-989b-47cd-979e-8623ea7d0fd2 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:27.647368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069ca65-989b-47cd-979e-8623ea7d0fd2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:27.648012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069ca65-989b-47cd-979e-8623ea7d0fd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:27.649811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069ca65-989b-47cd-979e-8623ea7d0fd2 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:27.656828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 395/810] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Jul 11 15:37:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:27.657949 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069ca65-989b-47cd-979e-8623ea7d0fd2 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:27.725901 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d05be6-e2bf-4636-a0a3-a9ecafa03a10 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:27.759772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71292f50-3d00-43a7-b903-56c97ab15335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:27.760352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71292f50-3d00-43a7-b903-56c97ab15335 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:27.760631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71292f50-3d00-43a7-b903-56c97ab15335 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:27.760900 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71292f50-3d00-43a7-b903-56c97ab15335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:27.767106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:27.770967 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069ca65-989b-47cd-979e-8623ea7d0fd2 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:27.771604 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71292f50-3d00-43a7-b903-56c97ab15335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:27.773131 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71292f50-3d00-43a7-b903-56c97ab15335 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-71292f50-3d00-43a7-b903-56c97ab15335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:27.790870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:27.791835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:27.792802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:27.792802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:27.792802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:27.792802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:27.792802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 416/811] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:27.793598 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71292f50-3d00-43a7-b903-56c97ab15335 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:27.811803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea164d9-fcce-4585-84cb-763d8ce1296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:27.813093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea164d9-fcce-4585-84cb-763d8ce1296e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:27.813708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea164d9-fcce-4585-84cb-763d8ce1296e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:27.814178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea164d9-fcce-4585-84cb-763d8ce1296e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:27.819786 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:27.828351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea164d9-fcce-4585-84cb-763d8ce1296e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:27.830703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea164d9-fcce-4585-84cb-763d8ce1296e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-fea164d9-fcce-4585-84cb-763d8ce1296e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:27.849736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:27.850673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:27.851551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:27.851551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:27.851551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:27.851551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:27.853859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 396/812] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:27.854954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea164d9-fcce-4585-84cb-763d8ce1296e None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:27.898953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71292f50-3d00-43a7-b903-56c97ab15335 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:27.936700 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8511f53-21f5-48db-a60d-c975fd37d8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:27.937467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8511f53-21f5-48db-a60d-c975fd37d8a2 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:27.937742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8511f53-21f5-48db-a60d-c975fd37d8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:27.938001 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8511f53-21f5-48db-a60d-c975fd37d8a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:27.938751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8511f53-21f5-48db-a60d-c975fd37d8a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:27.944332 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8511f53-21f5-48db-a60d-c975fd37d8a2 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:27.969572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 417/813] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Jul 11 15:37:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:37:27.971457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8511f53-21f5-48db-a60d-c975fd37d8a2 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:27.979965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea164d9-fcce-4585-84cb-763d8ce1296e None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:28.030443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4a7a2-5bb9-48a9-bae7-2b6c3d1d3c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:28.031280 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4a7a2-5bb9-48a9-bae7-2b6c3d1d3c3f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:28.031662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4a7a2-5bb9-48a9-bae7-2b6c3d1d3c3f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:28.032068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4a7a2-5bb9-48a9-bae7-2b6c3d1d3c3f None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:28.033051 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4a7a2-5bb9-48a9-bae7-2b6c3d1d3c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:28.033481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4a7a2-5bb9-48a9-bae7-2b6c3d1d3c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:28.035082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4a7a2-5bb9-48a9-bae7-2b6c3d1d3c3f None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:28.058245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 397/814] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:28.065332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4a7a2-5bb9-48a9-bae7-2b6c3d1d3c3f None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:28.094366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:28.098727 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:28.124758 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8511f53-21f5-48db-a60d-c975fd37d8a2 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:28.192327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320000a-0e69-4195-97d5-1d5b8c7f93a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:28.192327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320000a-0e69-4195-97d5-1d5b8c7f93a5 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:28.192327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320000a-0e69-4195-97d5-1d5b8c7f93a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:28.192327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320000a-0e69-4195-97d5-1d5b8c7f93a5 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:28.192694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320000a-0e69-4195-97d5-1d5b8c7f93a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:28.192694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320000a-0e69-4195-97d5-1d5b8c7f93a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:28.195772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320000a-0e69-4195-97d5-1d5b8c7f93a5 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:28.212151 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 418/815] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:28.213122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320000a-0e69-4195-97d5-1d5b8c7f93a5 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:28.267287 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4a7a2-5bb9-48a9-bae7-2b6c3d1d3c3f None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:28.304696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f49580-efe3-4686-b577-e4dec3d13573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:28.305807 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f49580-efe3-4686-b577-e4dec3d13573 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:28.305807 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f49580-efe3-4686-b577-e4dec3d13573 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:28.306031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f49580-efe3-4686-b577-e4dec3d13573 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:28.313592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f49580-efe3-4686-b577-e4dec3d13573 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:28.315062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f49580-efe3-4686-b577-e4dec3d13573 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:28.325765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320000a-0e69-4195-97d5-1d5b8c7f93a5 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-87f49580-efe3-4686-b577-e4dec3d13573 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:28.330985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:28.332108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:28.333336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:28.333336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:28.333336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:28.333336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:28.333336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:28.333336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:28.333336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:28.333336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:28.333336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:37:28.333336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:28.336932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 398/816] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Jul 11 15:37:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:28.338620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f49580-efe3-4686-b577-e4dec3d13573 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:28.369218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b005c1-c0b2-4e98-b882-fc61a2a8043c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:28.370730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b005c1-c0b2-4e98-b882-fc61a2a8043c None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:28.371287 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b005c1-c0b2-4e98-b882-fc61a2a8043c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:28.371754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b005c1-c0b2-4e98-b882-fc61a2a8043c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:28.379406 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b005c1-c0b2-4e98-b882-fc61a2a8043c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:28.381243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b005c1-c0b2-4e98-b882-fc61a2a8043c None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-b8b005c1-c0b2-4e98-b882-fc61a2a8043c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:28.397471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:28.398417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:28.399315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:28.399315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:28.399315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:28.399315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:28.399315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:28.399315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:28.399315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:28.399315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:28.401834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 419/817] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:28.402117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:28.408669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b005c1-c0b2-4e98-b882-fc61a2a8043c None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:28.412093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:28.487164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f49580-efe3-4686-b577-e4dec3d13573 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:28.518773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b005c1-c0b2-4e98-b882-fc61a2a8043c None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:28.533428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611868d8-2333-48f2-aeea-4b7001459c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:28.534107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611868d8-2333-48f2-aeea-4b7001459c51 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:28.534587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611868d8-2333-48f2-aeea-4b7001459c51 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:28.534701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611868d8-2333-48f2-aeea-4b7001459c51 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:28.535481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611868d8-2333-48f2-aeea-4b7001459c51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:28.535787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611868d8-2333-48f2-aeea-4b7001459c51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:28.537286 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611868d8-2333-48f2-aeea-4b7001459c51 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:28.554878 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 399/818] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Jul 11 15:37:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:28.555928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99cdfe-982e-4909-9012-a3edf42426d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:28.556194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fa0dc-ec3b-45ef-bfd0-9f351d73a2c5 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:28.557074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99cdfe-982e-4909-9012-a3edf42426d8 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:28.557591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99cdfe-982e-4909-9012-a3edf42426d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:28.558003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99cdfe-982e-4909-9012-a3edf42426d8 None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:28.558947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99cdfe-982e-4909-9012-a3edf42426d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:28.559396 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99cdfe-982e-4909-9012-a3edf42426d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:28.560651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fa0dc-ec3b-45ef-bfd0-9f351d73a2c5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:28.560950 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fa0dc-ec3b-45ef-bfd0-9f351d73a2c5 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:28.561375 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99cdfe-982e-4909-9012-a3edf42426d8 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:28.562717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 400/819] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:28.564108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fa0dc-ec3b-45ef-bfd0-9f351d73a2c5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:28.574984 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 420/820] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:28.576549 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18851227-39b1-445f-b6f3-f2f6bdc3122c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:28.576998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18851227-39b1-445f-b6f3-f2f6bdc3122c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:28.577401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18851227-39b1-445f-b6f3-f2f6bdc3122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:28.594060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-18851227-39b1-445f-b6f3-f2f6bdc3122c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:28.595455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-18851227-39b1-445f-b6f3-f2f6bdc3122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:28.648189 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:28.667054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 421/821] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:28.668179 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18851227-39b1-445f-b6f3-f2f6bdc3122c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:28.692086 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fa0dc-ec3b-45ef-bfd0-9f351d73a2c5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:28.730513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:28.741087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8786e-3697-407f-98a1-03ed6aef9e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:28.742256 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8786e-3697-407f-98a1-03ed6aef9e22 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:28.742949 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8786e-3697-407f-98a1-03ed6aef9e22 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:28.743369 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8786e-3697-407f-98a1-03ed6aef9e22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:28.811244 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18851227-39b1-445f-b6f3-f2f6bdc3122c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:28.830151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8786e-3697-407f-98a1-03ed6aef9e22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:28.832545 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8786e-3697-407f-98a1-03ed6aef9e22 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:28.854924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae858ae-892c-433e-9ff0-484d4afff4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:28.855927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae858ae-892c-433e-9ff0-484d4afff4ca None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:28.856279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae858ae-892c-433e-9ff0-484d4afff4ca None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:28.856653 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae858ae-892c-433e-9ff0-484d4afff4ca None admin] PATH_INFO: `/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/8c910084851040cf817aa92ede9d0d97/roles/c8fd28e5c32f4759a288774fddec4493` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:28.875324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae858ae-892c-433e-9ff0-484d4afff4ca None admin] RBAC: Authorizing `identity:create_grant(project_id=0fe17aeb94ad42dc990c9d963dac9af6, user_id=8c910084851040cf817aa92ede9d0d97, role_id=c8fd28e5c32f4759a288774fddec4493)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:28.876994 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae858ae-892c-433e-9ff0-484d4afff4ca None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:28.893870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 422/822] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:37:28 2022] PUT /identity/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/8c910084851040cf817aa92ede9d0d97/roles/c8fd28e5c32f4759a288774fddec4493 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:37:28.895809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae858ae-892c-433e-9ff0-484d4afff4ca None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:28.976546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:29.008458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 401/823] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:37:29.013052 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8786e-3697-407f-98a1-03ed6aef9e22 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:29.067748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:29.090384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae858ae-892c-433e-9ff0-484d4afff4ca None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:29.142047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af782e-b811-40b3-a794-6688a3275918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:29.142974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af782e-b811-40b3-a794-6688a3275918 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:29.143327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af782e-b811-40b3-a794-6688a3275918 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:29.143674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af782e-b811-40b3-a794-6688a3275918 None admin] PATH_INFO: `/v3/services/network` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:29.144691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af782e-b811-40b3-a794-6688a3275918 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:29.147116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af782e-b811-40b3-a794-6688a3275918 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-f1af782e-b811-40b3-a794-6688a3275918 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:29.163228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:29.164262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:29.165263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:29.165263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:29.165263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:29.165263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:29.165263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:29.165263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:29.165263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:29.165263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:29.165263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:29.165263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:29.165263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:29.165263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:29.165263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 15:37:29.165263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:29.170208 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 423/824] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:28 2022] GET /identity/v3/services/network => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:29.172417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af782e-b811-40b3-a794-6688a3275918 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:29.195592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8786e-3697-407f-98a1-03ed6aef9e22 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:29.250259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b00e5-f6ff-49dd-983c-f0ca7bb3023d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:29.251509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b00e5-f6ff-49dd-983c-f0ca7bb3023d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:29.251985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b00e5-f6ff-49dd-983c-f0ca7bb3023d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:29.252503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b00e5-f6ff-49dd-983c-f0ca7bb3023d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:29.264614 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b00e5-f6ff-49dd-983c-f0ca7bb3023d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:29.266504 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b00e5-f6ff-49dd-983c-f0ca7bb3023d None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-477b00e5-f6ff-49dd-983c-f0ca7bb3023d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:29.286546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:29.287913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:29.288835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:29.288835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:29.288835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:29.288835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:29.291005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:29.292521 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 402/825] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:29.294419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af782e-b811-40b3-a794-6688a3275918 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:29.298448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b00e5-f6ff-49dd-983c-f0ca7bb3023d None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:29.356623 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbdf54-12d8-4b05-bce7-86978660deb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:29.359486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbdf54-12d8-4b05-bce7-86978660deb0 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:29.360955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbdf54-12d8-4b05-bce7-86978660deb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:29.362099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbdf54-12d8-4b05-bce7-86978660deb0 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:29.363039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbdf54-12d8-4b05-bce7-86978660deb0 None admin] RBAC: Adding query filter params (name=network) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:29.364401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbdf54-12d8-4b05-bce7-86978660deb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:29.366015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbdf54-12d8-4b05-bce7-86978660deb0 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:29.383842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 424/826] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Jul 11 15:37:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:29.393450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbdf54-12d8-4b05-bce7-86978660deb0 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:29.438456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:29.467581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b00e5-f6ff-49dd-983c-f0ca7bb3023d None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:29.514856 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac12b7-de58-4424-9b80-7e39711baf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:29.515819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac12b7-de58-4424-9b80-7e39711baf25 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:29.516251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac12b7-de58-4424-9b80-7e39711baf25 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:29.516704 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac12b7-de58-4424-9b80-7e39711baf25 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:29.517596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac12b7-de58-4424-9b80-7e39711baf25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:29.518543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac12b7-de58-4424-9b80-7e39711baf25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:29.522014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac12b7-de58-4424-9b80-7e39711baf25 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:29.549138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 403/827] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:29.555103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac12b7-de58-4424-9b80-7e39711baf25 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:29.641443 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbdf54-12d8-4b05-bce7-86978660deb0 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:29.697204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac12b7-de58-4424-9b80-7e39711baf25 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:29.722439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a7802-d152-4e9e-b8e5-aac5091e5979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:29.723375 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a7802-d152-4e9e-b8e5-aac5091e5979 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:29.723806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a7802-d152-4e9e-b8e5-aac5091e5979 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:29.724259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a7802-d152-4e9e-b8e5-aac5091e5979 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:29.725148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a7802-d152-4e9e-b8e5-aac5091e5979 None admin] RBAC: Adding query filter params (type=network) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:29.725769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a7802-d152-4e9e-b8e5-aac5091e5979 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:29.727785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a7802-d152-4e9e-b8e5-aac5091e5979 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:29.739106 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 425/828] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Jul 11 15:37:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:29.739106 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf87c31-41f5-4195-a9d4-59433c9528ca None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:29.739106 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf87c31-41f5-4195-a9d4-59433c9528ca None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:29.739106 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf87c31-41f5-4195-a9d4-59433c9528ca None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:29.744061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 426/829] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:29.745032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf87c31-41f5-4195-a9d4-59433c9528ca None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:29.761559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda2571-fa86-4e42-b05e-481fb297eef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:29.762523 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2571-fa86-4e42-b05e-481fb297eef9 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:29.762917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2571-fa86-4e42-b05e-481fb297eef9 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:29.763289 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2571-fa86-4e42-b05e-481fb297eef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:29.771104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda2571-fa86-4e42-b05e-481fb297eef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:29.773090 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda2571-fa86-4e42-b05e-481fb297eef9 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:29.774734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:29.781962 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-2bda2571-fa86-4e42-b05e-481fb297eef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:29.791163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:29.792262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:29.793424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:29.793424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:29.793424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:29.793424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:29.793424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:29.793424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:29.793424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:29.793424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:29.795437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 404/830] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:29.796897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fe2e5-1861-4134-8d95-b48cb7ee5293 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:29.797330 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fe2e5-1861-4134-8d95-b48cb7ee5293 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:29.797707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fe2e5-1861-4134-8d95-b48cb7ee5293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:29.815331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-392fe2e5-1861-4134-8d95-b48cb7ee5293 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:29.816710 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-392fe2e5-1861-4134-8d95-b48cb7ee5293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:29.886416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf87c31-41f5-4195-a9d4-59433c9528ca None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:29.900637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 405/831] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:29.901714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fe2e5-1861-4134-8d95-b48cb7ee5293 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:29.928085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38fa34-1fcd-424a-b155-ea39cfa60836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:29.929050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38fa34-1fcd-424a-b155-ea39cfa60836 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:29.929481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38fa34-1fcd-424a-b155-ea39cfa60836 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:29.930323 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38fa34-1fcd-424a-b155-ea39cfa60836 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:29.931228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38fa34-1fcd-424a-b155-ea39cfa60836 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:29.933305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38fa34-1fcd-424a-b155-ea39cfa60836 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:29.966246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 427/832] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Jul 11 15:37:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:37:29.966246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38fa34-1fcd-424a-b155-ea39cfa60836 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:30.129623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fe2e5-1861-4134-8d95-b48cb7ee5293 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:30.151580 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:30.204251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:30.205774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38fa34-1fcd-424a-b155-ea39cfa60836 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:30.220581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d02ef-7df6-454a-84a0-2aa5b4c0ed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:30.222693 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d02ef-7df6-454a-84a0-2aa5b4c0ed44 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:30.222978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d02ef-7df6-454a-84a0-2aa5b4c0ed44 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:30.223255 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d02ef-7df6-454a-84a0-2aa5b4c0ed44 None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:30.224266 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d02ef-7df6-454a-84a0-2aa5b4c0ed44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:30.224819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d02ef-7df6-454a-84a0-2aa5b4c0ed44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:30.226838 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d02ef-7df6-454a-84a0-2aa5b4c0ed44 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:30.245021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 406/833] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:30.252510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05312afd-4646-434e-993e-6bcbee98cbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:30.252698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d02ef-7df6-454a-84a0-2aa5b4c0ed44 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:30.253791 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05312afd-4646-434e-993e-6bcbee98cbd1 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:30.254284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05312afd-4646-434e-993e-6bcbee98cbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:30.254762 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05312afd-4646-434e-993e-6bcbee98cbd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:30.272140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05312afd-4646-434e-993e-6bcbee98cbd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-05312afd-4646-434e-993e-6bcbee98cbd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:30.280496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:30.281485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:30.282350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:30.282350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:30.282350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:30.282350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:30.282350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:30.282350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:30.282350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:30.282350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:30.282350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:30.282350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:30.282350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:37:30.282350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:30.286286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 428/834] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:37:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:30.293718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05312afd-4646-434e-993e-6bcbee98cbd1 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:30.369874 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d02ef-7df6-454a-84a0-2aa5b4c0ed44 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:30.403585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05312afd-4646-434e-993e-6bcbee98cbd1 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:30.406921 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717d8a-d050-4688-a363-1c7e1041fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:30.408949 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717d8a-d050-4688-a363-1c7e1041fab2 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:30.409462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717d8a-d050-4688-a363-1c7e1041fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:30.409998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717d8a-d050-4688-a363-1c7e1041fab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:30.411086 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66717d8a-d050-4688-a363-1c7e1041fab2 None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=fa038a2e30f544aaa609d32e0e1ceaa0) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:30.411625 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66717d8a-d050-4688-a363-1c7e1041fab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:30.413411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66717d8a-d050-4688-a363-1c7e1041fab2 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:30.424580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 407/835] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:30 2022] GET /identity/v3/role_assignments?user.id=fa038a2e30f544aaa609d32e0e1ceaa0&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=32f5ce5800cf40d99d894960288d0155 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:30.456532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4642d-2214-4c0c-b104-ce9380b0ef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:30.457657 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4642d-2214-4c0c-b104-ce9380b0ef14 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:30.458176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4642d-2214-4c0c-b104-ce9380b0ef14 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:30.458683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4642d-2214-4c0c-b104-ce9380b0ef14 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:30.459704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4642d-2214-4c0c-b104-ce9380b0ef14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:30.460241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4642d-2214-4c0c-b104-ce9380b0ef14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:30.462251 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4642d-2214-4c0c-b104-ce9380b0ef14 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:30.477725 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 429/836] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:37:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:30.479502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717d8a-d050-4688-a363-1c7e1041fab2 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:30.539808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:30.595050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717d8a-d050-4688-a363-1c7e1041fab2 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:30.622071 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51509c-a5f3-4e4d-a674-c3c7aa08adb1 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:30.622393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51509c-a5f3-4e4d-a674-c3c7aa08adb1 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:30.622615 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51509c-a5f3-4e4d-a674-c3c7aa08adb1 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:30.624964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 430/837] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:37:30.629835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192a4d5-d4b6-4a0c-8571-c927167521ad None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:30.630103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192a4d5-d4b6-4a0c-8571-c927167521ad None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:30.630377 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192a4d5-d4b6-4a0c-8571-c927167521ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:30.630969 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795acb99-fb26-490d-b3e6-a1153331d38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:30.631784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795acb99-fb26-490d-b3e6-a1153331d38b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:30.632096 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795acb99-fb26-490d-b3e6-a1153331d38b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:30.632362 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795acb99-fb26-490d-b3e6-a1153331d38b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:30.636535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:30.645193 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795acb99-fb26-490d-b3e6-a1153331d38b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:30.646710 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795acb99-fb26-490d-b3e6-a1153331d38b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:30.651731 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-c192a4d5-d4b6-4a0c-8571-c927167521ad None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:30.653004 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c192a4d5-d4b6-4a0c-8571-c927167521ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-795acb99-fb26-490d-b3e6-a1153331d38b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:30.665714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:30.666587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:30.668478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:30.668478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:30.668478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:30.668478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:30.668478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 408/838] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:30.672407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795acb99-fb26-490d-b3e6-a1153331d38b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:30.756379 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 431/839] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:30.774043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192a4d5-d4b6-4a0c-8571-c927167521ad None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:30.802848 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795acb99-fb26-490d-b3e6-a1153331d38b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:30.806473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:30.849073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22160a5a-afa9-4061-a42d-06c2d893360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:30.850365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22160a5a-afa9-4061-a42d-06c2d893360c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:30.850871 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22160a5a-afa9-4061-a42d-06c2d893360c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:30.851362 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22160a5a-afa9-4061-a42d-06c2d893360c None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:30.852577 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22160a5a-afa9-4061-a42d-06c2d893360c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:30.853684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22160a5a-afa9-4061-a42d-06c2d893360c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:30.855542 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22160a5a-afa9-4061-a42d-06c2d893360c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:30.876217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 409/840] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:30.877288 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22160a5a-afa9-4061-a42d-06c2d893360c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:30.898534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192a4d5-d4b6-4a0c-8571-c927167521ad None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:30.935507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:30.941951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae616a-3280-4177-90cf-ddaddf564c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:30.943193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae616a-3280-4177-90cf-ddaddf564c7f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:30.943610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae616a-3280-4177-90cf-ddaddf564c7f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:30.944006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae616a-3280-4177-90cf-ddaddf564c7f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:30.944729 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae616a-3280-4177-90cf-ddaddf564c7f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:30.946563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae616a-3280-4177-90cf-ddaddf564c7f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-3cae616a-3280-4177-90cf-ddaddf564c7f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:30.962425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:30.963467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:30.964314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:30.964314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:30.964314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:30.964314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:30.964314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:30.964314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:30.964314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:30.964314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:30.964314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:30.964314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:30.964314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:30.964314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:30.964314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:37:30.964314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:30.968615 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 432/841] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:37:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:30.969863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae616a-3280-4177-90cf-ddaddf564c7f None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:31.012857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22160a5a-afa9-4061-a42d-06c2d893360c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:31.059396 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4c191-4fe8-436a-9247-049b92a9f8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:31.060228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4c191-4fe8-436a-9247-049b92a9f8a8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:31.061194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4c191-4fe8-436a-9247-049b92a9f8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:31.061483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4c191-4fe8-436a-9247-049b92a9f8a8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:31.069845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4c191-4fe8-436a-9247-049b92a9f8a8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:31.071291 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4c191-4fe8-436a-9247-049b92a9f8a8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:31.077907 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae616a-3280-4177-90cf-ddaddf564c7f None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-45b4c191-4fe8-436a-9247-049b92a9f8a8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:31.085943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:31.088558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:31.090806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:31.090806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:31.090806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:31.090806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:31.090806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:31.090806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:31.090806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:31.090806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:31.090806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 15:37:31.090806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:31.090806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 410/842] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:37:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:31.095824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4c191-4fe8-436a-9247-049b92a9f8a8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:31.124808 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0b76f-625f-4712-ad7a-54684887a396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:31.125477 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0b76f-625f-4712-ad7a-54684887a396 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:31.125825 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0b76f-625f-4712-ad7a-54684887a396 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:31.126331 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0b76f-625f-4712-ad7a-54684887a396 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:31.127249 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0b76f-625f-4712-ad7a-54684887a396 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:31.127369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0b76f-625f-4712-ad7a-54684887a396 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:31.129006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0b76f-625f-4712-ad7a-54684887a396 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:31.129896 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:31.137954 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 433/843] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:37:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:31.142808 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0b76f-625f-4712-ad7a-54684887a396 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:31.227801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:31.243697 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4c191-4fe8-436a-9247-049b92a9f8a8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:31.282627 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0b76f-625f-4712-ad7a-54684887a396 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:31.290763 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226cfab-fba0-47c2-bfde-b3c02e0107fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:31.291443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226cfab-fba0-47c2-bfde-b3c02e0107fe None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:31.291721 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226cfab-fba0-47c2-bfde-b3c02e0107fe None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:31.291999 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226cfab-fba0-47c2-bfde-b3c02e0107fe None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:31.292875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226cfab-fba0-47c2-bfde-b3c02e0107fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:31.293178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226cfab-fba0-47c2-bfde-b3c02e0107fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:31.294629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226cfab-fba0-47c2-bfde-b3c02e0107fe None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:31.314832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 411/844] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Jul 11 15:37:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:31.322156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226cfab-fba0-47c2-bfde-b3c02e0107fe None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:31.331346 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1090f-c699-4721-b83c-362478523390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:31.332024 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1090f-c699-4721-b83c-362478523390 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:31.332329 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1090f-c699-4721-b83c-362478523390 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:31.332616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1090f-c699-4721-b83c-362478523390 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:31.333860 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1090f-c699-4721-b83c-362478523390 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:31.334180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1090f-c699-4721-b83c-362478523390 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:31.335575 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1090f-c699-4721-b83c-362478523390 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:31.343160 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 434/845] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:37:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:31.345231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe1e74-955f-4b99-aabc-aa95cce68486 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:31.345537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe1e74-955f-4b99-aabc-aa95cce68486 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:31.345803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe1e74-955f-4b99-aabc-aa95cce68486 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:31.347441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 435/846] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:37:31.353012 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4843a-3589-4e98-8a7b-52731ac1a83a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:31.353327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4843a-3589-4e98-8a7b-52731ac1a83a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:31.353564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4843a-3589-4e98-8a7b-52731ac1a83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:31.371912 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-bfd4843a-3589-4e98-8a7b-52731ac1a83a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:31.373404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-bfd4843a-3589-4e98-8a7b-52731ac1a83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:31.438507 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:31.460076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226cfab-fba0-47c2-bfde-b3c02e0107fe None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:31.464710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 436/847] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:31.488215 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4843a-3589-4e98-8a7b-52731ac1a83a None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:31.511770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522a9ad-f3ff-40e8-ae04-5a33f22456bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:31.512465 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522a9ad-f3ff-40e8-ae04-5a33f22456bb None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:31.512743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522a9ad-f3ff-40e8-ae04-5a33f22456bb None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:31.513014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522a9ad-f3ff-40e8-ae04-5a33f22456bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:31.552432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:31.592244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522a9ad-f3ff-40e8-ae04-5a33f22456bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:31.593849 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522a9ad-f3ff-40e8-ae04-5a33f22456bb None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:31.613478 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4843a-3589-4e98-8a7b-52731ac1a83a None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:31.658965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54959078-e02e-40cf-a953-b0d347a873ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:31.660161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54959078-e02e-40cf-a953-b0d347a873ac None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:31.660902 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54959078-e02e-40cf-a953-b0d347a873ac None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:31.661324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54959078-e02e-40cf-a953-b0d347a873ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:31.679339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54959078-e02e-40cf-a953-b0d347a873ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:31.688243 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-54959078-e02e-40cf-a953-b0d347a873ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:31.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:31.692560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:31.693595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:31.693595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:31.693595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:31.693595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:31.693595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:31.693595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:31.693595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:31.693595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:31.693595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:31.693595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:31.693595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:37:31.693595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:31.697166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 437/848] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:37:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:31.703036 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54959078-e02e-40cf-a953-b0d347a873ac None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:31.723334 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 412/849] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:37:31.724461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522a9ad-f3ff-40e8-ae04-5a33f22456bb None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:31.834783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522a9ad-f3ff-40e8-ae04-5a33f22456bb None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:31.835701 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54959078-e02e-40cf-a953-b0d347a873ac None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:31.852540 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:31.874202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14116ef-0a01-421f-9f4d-3b2928c46e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:31.875223 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14116ef-0a01-421f-9f4d-3b2928c46e3f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:31.875577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14116ef-0a01-421f-9f4d-3b2928c46e3f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:31.875922 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14116ef-0a01-421f-9f4d-3b2928c46e3f None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:31.876780 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14116ef-0a01-421f-9f4d-3b2928c46e3f None admin] RBAC: Adding query filter params (name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:31.877154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14116ef-0a01-421f-9f4d-3b2928c46e3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:31.878611 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14116ef-0a01-421f-9f4d-3b2928c46e3f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:31.880521 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809b9e4-8c73-4ab3-a8c4-5fa39d8fb1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:31.881807 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809b9e4-8c73-4ab3-a8c4-5fa39d8fb1db None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:31.882282 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809b9e4-8c73-4ab3-a8c4-5fa39d8fb1db None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:31.882729 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809b9e4-8c73-4ab3-a8c4-5fa39d8fb1db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:31.893730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 438/850] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:37:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:31.894842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14116ef-0a01-421f-9f4d-3b2928c46e3f None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:31.897444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809b9e4-8c73-4ab3-a8c4-5fa39d8fb1db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:31.899125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809b9e4-8c73-4ab3-a8c4-5fa39d8fb1db None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-f809b9e4-8c73-4ab3-a8c4-5fa39d8fb1db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:31.917557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:31.918470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:31.919338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:31.919338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:31.919338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:31.919338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:31.921984 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 413/851] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:31.927736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809b9e4-8c73-4ab3-a8c4-5fa39d8fb1db None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:31.967944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:32.003719 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14116ef-0a01-421f-9f4d-3b2928c46e3f None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:32.038352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cbaa6-d72e-46c2-9406-ddca70ba0781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:32.039143 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cbaa6-d72e-46c2-9406-ddca70ba0781 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:32.039424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cbaa6-d72e-46c2-9406-ddca70ba0781 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:32.039695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cbaa6-d72e-46c2-9406-ddca70ba0781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:32.040690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809b9e4-8c73-4ab3-a8c4-5fa39d8fb1db None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:32.051234 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cbaa6-d72e-46c2-9406-ddca70ba0781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:32.052450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cbaa6-d72e-46c2-9406-ddca70ba0781 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-914cbaa6-d72e-46c2-9406-ddca70ba0781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:32.074116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:32.075066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:32.075971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:32.075971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:32.075971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:32.075971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:32.079867 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 439/852] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:32.081329 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cbaa6-d72e-46c2-9406-ddca70ba0781 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:32.084984 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f75cf9-4c41-4e15-b470-7a1bc47d99ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:32.085725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f75cf9-4c41-4e15-b470-7a1bc47d99ea None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:32.086011 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f75cf9-4c41-4e15-b470-7a1bc47d99ea None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:32.086286 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f75cf9-4c41-4e15-b470-7a1bc47d99ea None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:32.087738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f75cf9-4c41-4e15-b470-7a1bc47d99ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:32.087738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f75cf9-4c41-4e15-b470-7a1bc47d99ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:32.089113 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f75cf9-4c41-4e15-b470-7a1bc47d99ea None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:32.106325 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 414/853] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:32.107399 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f75cf9-4c41-4e15-b470-7a1bc47d99ea None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:32.120614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:32.220333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cbaa6-d72e-46c2-9406-ddca70ba0781 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:32.237386 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:32.246727 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f75cf9-4c41-4e15-b470-7a1bc47d99ea None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:32.266521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99aff4c-334d-43de-ae9d-6afb019f46b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:32.267205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aff4c-334d-43de-ae9d-6afb019f46b8 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:32.267557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aff4c-334d-43de-ae9d-6afb019f46b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:32.267900 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aff4c-334d-43de-ae9d-6afb019f46b8 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:32.268978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99aff4c-334d-43de-ae9d-6afb019f46b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:32.269353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99aff4c-334d-43de-ae9d-6afb019f46b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:32.271339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99aff4c-334d-43de-ae9d-6afb019f46b8 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:32.291901 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 440/854] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:32.293387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99aff4c-334d-43de-ae9d-6afb019f46b8 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:32.294382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98a34d-cfe2-42c6-ba4f-88bdb040910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:32.295241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98a34d-cfe2-42c6-ba4f-88bdb040910c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:32.295525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98a34d-cfe2-42c6-ba4f-88bdb040910c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:32.295796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98a34d-cfe2-42c6-ba4f-88bdb040910c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:32.303761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98a34d-cfe2-42c6-ba4f-88bdb040910c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:32.305487 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98a34d-cfe2-42c6-ba4f-88bdb040910c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-ca98a34d-cfe2-42c6-ba4f-88bdb040910c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:32.320478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:32.321368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:32.322248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:32.322248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:32.322248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:32.322248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:32.322248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:32.322248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:32.322248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:32.322248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:32.326645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 415/855] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:32.327705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98a34d-cfe2-42c6-ba4f-88bdb040910c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:32.389414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:32.401793 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99aff4c-334d-43de-ae9d-6afb019f46b8 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:32.436543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98a34d-cfe2-42c6-ba4f-88bdb040910c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:32.437896 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec9ea1-d763-4f2b-9804-e1d9ef798d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:32.438948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec9ea1-d763-4f2b-9804-e1d9ef798d1d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:32.439417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec9ea1-d763-4f2b-9804-e1d9ef798d1d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:32.439909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec9ea1-d763-4f2b-9804-e1d9ef798d1d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:32.447735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec9ea1-d763-4f2b-9804-e1d9ef798d1d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:32.449615 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec9ea1-d763-4f2b-9804-e1d9ef798d1d None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-34ec9ea1-d763-4f2b-9804-e1d9ef798d1d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:32.466452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:32.468055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:32.469067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:32.469067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:32.469067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:32.469067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:32.469067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:32.469067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:32.469067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:32.469067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:32.469067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:37:32.469067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:32.476419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 441/856] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Jul 11 15:37:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:32.477962 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec9ea1-d763-4f2b-9804-e1d9ef798d1d None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:32.480665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972b00a-0560-48b9-bf9b-d58eecd3caa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:32.481351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972b00a-0560-48b9-bf9b-d58eecd3caa4 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:32.481628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972b00a-0560-48b9-bf9b-d58eecd3caa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:32.481902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972b00a-0560-48b9-bf9b-d58eecd3caa4 None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:32.482885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972b00a-0560-48b9-bf9b-d58eecd3caa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:32.483205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972b00a-0560-48b9-bf9b-d58eecd3caa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:32.484991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972b00a-0560-48b9-bf9b-d58eecd3caa4 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:32.502617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 416/857] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:32.503861 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972b00a-0560-48b9-bf9b-d58eecd3caa4 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:32.521371 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:32.583252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec9ea1-d763-4f2b-9804-e1d9ef798d1d None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:32.614649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972b00a-0560-48b9-bf9b-d58eecd3caa4 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:32.618148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9d1e0-3218-4349-a953-a775b4ffd92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:32.618981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9d1e0-3218-4349-a953-a775b4ffd92f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:32.619401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9d1e0-3218-4349-a953-a775b4ffd92f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:32.619811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9d1e0-3218-4349-a953-a775b4ffd92f None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:32.620856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9d1e0-3218-4349-a953-a775b4ffd92f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:32.621304 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9d1e0-3218-4349-a953-a775b4ffd92f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:32.622918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9d1e0-3218-4349-a953-a775b4ffd92f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:32.646579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 442/858] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Jul 11 15:37:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:32.646579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffabe8d-3375-45bd-8abc-059a82200702 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:32.646579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffabe8d-3375-45bd-8abc-059a82200702 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:32.646579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffabe8d-3375-45bd-8abc-059a82200702 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:32.646579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 443/859] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:32.648019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffabe8d-3375-45bd-8abc-059a82200702 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:32.657064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:32.658845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf20bb0-1588-49d3-b1b3-2002568f0329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:32.659660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf20bb0-1588-49d3-b1b3-2002568f0329 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:32.660241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf20bb0-1588-49d3-b1b3-2002568f0329 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:32.660562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf20bb0-1588-49d3-b1b3-2002568f0329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:32.661734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf20bb0-1588-49d3-b1b3-2002568f0329 None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=8eaff8748f8b47e088e0cb7875992a4d) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:32.662049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf20bb0-1588-49d3-b1b3-2002568f0329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:32.663486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf20bb0-1588-49d3-b1b3-2002568f0329 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:32.675910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 417/860] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:32 2022] GET /identity/v3/role_assignments?user.id=8eaff8748f8b47e088e0cb7875992a4d&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=32f5ce5800cf40d99d894960288d0155 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:32.675910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7aff-4747-4054-96f5-e8a441c29998 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:32.675910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7aff-4747-4054-96f5-e8a441c29998 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:32.675910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7aff-4747-4054-96f5-e8a441c29998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:32.692919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-252e7aff-4747-4054-96f5-e8a441c29998 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:32.694430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-252e7aff-4747-4054-96f5-e8a441c29998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:32.771348 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffabe8d-3375-45bd-8abc-059a82200702 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:32.799820 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 418/861] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:32.816319 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553981a4-6c14-46be-8bf6-574bf5d0b43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:32.816998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553981a4-6c14-46be-8bf6-574bf5d0b43a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:32.817277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553981a4-6c14-46be-8bf6-574bf5d0b43a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:32.817550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553981a4-6c14-46be-8bf6-574bf5d0b43a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:32.819477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e7aff-4747-4054-96f5-e8a441c29998 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:32.833050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:32.895207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553981a4-6c14-46be-8bf6-574bf5d0b43a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:32.896814 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553981a4-6c14-46be-8bf6-574bf5d0b43a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:32.907246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:32.945643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e7aff-4747-4054-96f5-e8a441c29998 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:32.993589 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517f174-a213-4e3e-89bf-bee6bad5e7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:32.995467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517f174-a213-4e3e-89bf-bee6bad5e7c6 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:32.995958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517f174-a213-4e3e-89bf-bee6bad5e7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:32.996698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517f174-a213-4e3e-89bf-bee6bad5e7c6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:32.997892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517f174-a213-4e3e-89bf-bee6bad5e7c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:33.000051 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517f174-a213-4e3e-89bf-bee6bad5e7c6 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-b517f174-a213-4e3e-89bf-bee6bad5e7c6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:33.014616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:33.015578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:33.016433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 419/862] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Jul 11 15:37:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:33.023283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 444/863] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 15:37:33.024508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517f174-a213-4e3e-89bf-bee6bad5e7c6 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:33.026096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553981a4-6c14-46be-8bf6-574bf5d0b43a None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:33.109665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:33.138769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553981a4-6c14-46be-8bf6-574bf5d0b43a None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:33.147978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:33.150335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517f174-a213-4e3e-89bf-bee6bad5e7c6 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:33.177739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744b20f-721d-4cac-bfb6-435f7840d240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:33.178543 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744b20f-721d-4cac-bfb6-435f7840d240 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:33.178827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744b20f-721d-4cac-bfb6-435f7840d240 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:33.179108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744b20f-721d-4cac-bfb6-435f7840d240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:33.193296 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744b20f-721d-4cac-bfb6-435f7840d240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:33.195084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744b20f-721d-4cac-bfb6-435f7840d240 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:33.208102 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae13ab-6224-4e42-a479-6b35f9b56780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:33.208864 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae13ab-6224-4e42-a479-6b35f9b56780 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:33.209382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae13ab-6224-4e42-a479-6b35f9b56780 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:33.209667 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae13ab-6224-4e42-a479-6b35f9b56780 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:33.210398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae13ab-6224-4e42-a479-6b35f9b56780 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:33.210710 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae13ab-6224-4e42-a479-6b35f9b56780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:33.212449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae13ab-6224-4e42-a479-6b35f9b56780 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:33.218538 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 420/864] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Jul 11 15:37:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-7744b20f-721d-4cac-bfb6-435f7840d240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:33.220622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:33.221499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:33.222393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:33.222393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:33.222393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:33.222393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:33.224372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 445/865] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:33.225422 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae13ab-6224-4e42-a479-6b35f9b56780 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:33.231261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744b20f-721d-4cac-bfb6-435f7840d240 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:33.352994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae13ab-6224-4e42-a479-6b35f9b56780 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:33.355328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744b20f-721d-4cac-bfb6-435f7840d240 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:33.389136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127669f-e04e-47e8-aab4-d3f8f2ea3b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:33.390168 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127669f-e04e-47e8-aab4-d3f8f2ea3b9a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:33.390708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127669f-e04e-47e8-aab4-d3f8f2ea3b9a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:33.391185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127669f-e04e-47e8-aab4-d3f8f2ea3b9a None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:33.392131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127669f-e04e-47e8-aab4-d3f8f2ea3b9a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:33.392610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127669f-e04e-47e8-aab4-d3f8f2ea3b9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:33.394173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127669f-e04e-47e8-aab4-d3f8f2ea3b9a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:33.396567 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:33.398689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fd361-63ab-4c6e-8438-e01d18a58ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:33.399357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fd361-63ab-4c6e-8438-e01d18a58ed9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:33.399640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fd361-63ab-4c6e-8438-e01d18a58ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:33.399909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fd361-63ab-4c6e-8438-e01d18a58ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:33.400727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fd361-63ab-4c6e-8438-e01d18a58ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:33.400983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fd361-63ab-4c6e-8438-e01d18a58ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:33.402366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fd361-63ab-4c6e-8438-e01d18a58ed9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:33.404479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 421/866] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Jul 11 15:37:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:33.406919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bd08c-8eda-4557-b167-5ee94c6c11d0 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:33.407518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bd08c-8eda-4557-b167-5ee94c6c11d0 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:33.407992 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bd08c-8eda-4557-b167-5ee94c6c11d0 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:33.414339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 422/867] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:33.418039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43700d63-2bfb-47b0-8e2d-5a58043d09ff None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:33.418360 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43700d63-2bfb-47b0-8e2d-5a58043d09ff None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:33.418592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43700d63-2bfb-47b0-8e2d-5a58043d09ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:33.422971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 446/868] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:33.428490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fd361-63ab-4c6e-8438-e01d18a58ed9 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:33.437988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-43700d63-2bfb-47b0-8e2d-5a58043d09ff None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:33.439748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-43700d63-2bfb-47b0-8e2d-5a58043d09ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:33.451275 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:33.524316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 423/869] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:33.542320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43700d63-2bfb-47b0-8e2d-5a58043d09ff None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:33.553575 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fd361-63ab-4c6e-8438-e01d18a58ed9 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:33.601066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412ad31-1335-4628-9313-184103f223f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:33.602035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412ad31-1335-4628-9313-184103f223f2 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:33.602417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412ad31-1335-4628-9313-184103f223f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:33.602789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412ad31-1335-4628-9313-184103f223f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:33.611407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412ad31-1335-4628-9313-184103f223f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:33.613025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412ad31-1335-4628-9313-184103f223f2 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-2412ad31-1335-4628-9313-184103f223f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:33.628998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:33.629906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:33.630782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:33.630782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:33.630782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:33.630782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:33.630782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:33.630782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:33.630782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:33.630782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:33.630782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 447/870] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:33.636075 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412ad31-1335-4628-9313-184103f223f2 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:33.661745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43700d63-2bfb-47b0-8e2d-5a58043d09ff None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:33.696551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:33.710260 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f6ee7-73f1-45de-ab3f-4f8c6c0981db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:33.710936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f6ee7-73f1-45de-ab3f-4f8c6c0981db None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:33.711216 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f6ee7-73f1-45de-ab3f-4f8c6c0981db None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:33.711825 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f6ee7-73f1-45de-ab3f-4f8c6c0981db None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:33.713297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f6ee7-73f1-45de-ab3f-4f8c6c0981db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:33.713978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f6ee7-73f1-45de-ab3f-4f8c6c0981db None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:33.733280 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 424/871] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Jul 11 15:37:33 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:37:33.741064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:33.774243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412ad31-1335-4628-9313-184103f223f2 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:33.822463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4672642-21f7-4928-9d80-afe435a47d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:33.823150 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4672642-21f7-4928-9d80-afe435a47d4f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:33.823660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4672642-21f7-4928-9d80-afe435a47d4f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:33.823937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4672642-21f7-4928-9d80-afe435a47d4f None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:33.824883 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4672642-21f7-4928-9d80-afe435a47d4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:33.825188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4672642-21f7-4928-9d80-afe435a47d4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:33.826988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4672642-21f7-4928-9d80-afe435a47d4f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:33.842397 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 448/872] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:33.848473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f6ee7-73f1-45de-ab3f-4f8c6c0981db None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:33.960395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f6ee7-73f1-45de-ab3f-4f8c6c0981db None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:33.995891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae8b27-4ee1-4790-aa63-62b87a52816d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:33.996596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae8b27-4ee1-4790-aa63-62b87a52816d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:33.996877 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae8b27-4ee1-4790-aa63-62b87a52816d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:33.997147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae8b27-4ee1-4790-aa63-62b87a52816d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:33.998018 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae8b27-4ee1-4790-aa63-62b87a52816d None admin] RBAC: Adding query filter params (role.id=c8fd28e5c32f4759a288774fddec4493, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=8c910084851040cf817aa92ede9d0d97) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:33.998324 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae8b27-4ee1-4790-aa63-62b87a52816d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:33.999915 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae8b27-4ee1-4790-aa63-62b87a52816d None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:34.006693 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 425/873] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:33 2022] GET /identity/v3/role_assignments?user.id=8c910084851040cf817aa92ede9d0d97&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c8fd28e5c32f4759a288774fddec4493 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:34.859856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49c476-876d-42be-a836-a30518549321 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:34.860417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49c476-876d-42be-a836-a30518549321 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:34.860417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49c476-876d-42be-a836-a30518549321 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:34.862050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 449/874] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:34.867193 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbd296-65a1-4427-ad6e-ba282aeb371b None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:34.867677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbd296-65a1-4427-ad6e-ba282aeb371b None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:34.867757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbd296-65a1-4427-ad6e-ba282aeb371b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:34.884369 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-61fbd296-65a1-4427-ad6e-ba282aeb371b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:34.885536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-61fbd296-65a1-4427-ad6e-ba282aeb371b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:34.935126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:34.955899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 426/875] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:34.978504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49c476-876d-42be-a836-a30518549321 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:35.083930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49c476-876d-42be-a836-a30518549321 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:35.120258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954b906-1c25-4340-9b0c-2ae9714ef458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:35.121033 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b906-1c25-4340-9b0c-2ae9714ef458 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:35.121311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b906-1c25-4340-9b0c-2ae9714ef458 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:35.121582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b906-1c25-4340-9b0c-2ae9714ef458 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:35.122241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954b906-1c25-4340-9b0c-2ae9714ef458 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:35.123875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954b906-1c25-4340-9b0c-2ae9714ef458 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-c954b906-1c25-4340-9b0c-2ae9714ef458 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:35.137002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:35.138025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:35.138914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 450/876] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Jul 11 15:37:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:35.145506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbd296-65a1-4427-ad6e-ba282aeb371b None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:35.254868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbd296-65a1-4427-ad6e-ba282aeb371b None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:35.294916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d44dc-44de-4d61-b7e0-99f9234c1927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:35.294916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d44dc-44de-4d61-b7e0-99f9234c1927 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:35.294916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d44dc-44de-4d61-b7e0-99f9234c1927 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:35.295321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d44dc-44de-4d61-b7e0-99f9234c1927 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:35.295966 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d44dc-44de-4d61-b7e0-99f9234c1927 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:35.296313 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d44dc-44de-4d61-b7e0-99f9234c1927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:35.297749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d44dc-44de-4d61-b7e0-99f9234c1927 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:35.307645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 427/877] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Jul 11 15:37:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:35.308612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954b906-1c25-4340-9b0c-2ae9714ef458 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:35.415313 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954b906-1c25-4340-9b0c-2ae9714ef458 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:35.449486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29979beb-d554-485f-8d7e-5c9684bf121e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:35.450216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29979beb-d554-485f-8d7e-5c9684bf121e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:35.450514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29979beb-d554-485f-8d7e-5c9684bf121e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:35.450787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29979beb-d554-485f-8d7e-5c9684bf121e None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:35.451587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29979beb-d554-485f-8d7e-5c9684bf121e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:35.451893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29979beb-d554-485f-8d7e-5c9684bf121e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:35.453367 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29979beb-d554-485f-8d7e-5c9684bf121e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:35.458697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 451/878] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Jul 11 15:37:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:35.544449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037906c-b9a8-424e-8f29-a7d46ca3c50a None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:35.544868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037906c-b9a8-424e-8f29-a7d46ca3c50a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:35.545074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037906c-b9a8-424e-8f29-a7d46ca3c50a None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:35.546790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 428/879] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:35.554174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d20ba8-b969-476b-80a8-e74d3cc1a283 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:35.554489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d20ba8-b969-476b-80a8-e74d3cc1a283 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:35.554782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d20ba8-b969-476b-80a8-e74d3cc1a283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:35.574978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-71d20ba8-b969-476b-80a8-e74d3cc1a283 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:35.576871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-71d20ba8-b969-476b-80a8-e74d3cc1a283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:35.640655 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:35.653233 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 452/880] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:35.676821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037906c-b9a8-424e-8f29-a7d46ca3c50a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:35.736687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:35.786701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037906c-b9a8-424e-8f29-a7d46ca3c50a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:35.822836 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b984698-1f08-4fcb-9806-848994c8a9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:35.823782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b984698-1f08-4fcb-9806-848994c8a9ad None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:35.824224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b984698-1f08-4fcb-9806-848994c8a9ad None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:35.824657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b984698-1f08-4fcb-9806-848994c8a9ad None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:35.825538 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b984698-1f08-4fcb-9806-848994c8a9ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:35.827097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b984698-1f08-4fcb-9806-848994c8a9ad None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:35.845264 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 429/881] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Jul 11 15:37:35 2022] POST /identity/v3/services => generated 269 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:37:36.018915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d773cc-e1b2-4707-b61e-3bb1feb3666f None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:36.019423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d773cc-e1b2-4707-b61e-3bb1feb3666f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:36.019423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d773cc-e1b2-4707-b61e-3bb1feb3666f None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:36.021097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 453/882] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:36.026660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e477-a519-4b88-8162-b77f04b88702 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:36.027102 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e477-a519-4b88-8162-b77f04b88702 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:36.027181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e477-a519-4b88-8162-b77f04b88702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:36.044773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-1502e477-a519-4b88-8162-b77f04b88702 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:36.045986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1502e477-a519-4b88-8162-b77f04b88702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:36.128443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 430/883] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:36.145624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d773cc-e1b2-4707-b61e-3bb1feb3666f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:36.168098 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b086-02be-4199-a293-ec3d2fb10285 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:36.168698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b086-02be-4199-a293-ec3d2fb10285 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:36.169177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b086-02be-4199-a293-ec3d2fb10285 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:36.171275 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 431/884] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:37:36.176273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12164c-17ce-47e6-8bcc-2b1b1db3c76d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:36.176830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12164c-17ce-47e6-8bcc-2b1b1db3c76d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:36.177294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12164c-17ce-47e6-8bcc-2b1b1db3c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:36.194400 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-dd12164c-17ce-47e6-8bcc-2b1b1db3c76d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:36.195858 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-dd12164c-17ce-47e6-8bcc-2b1b1db3c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:36.233154 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:36.275782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d773cc-e1b2-4707-b61e-3bb1feb3666f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:36.281142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 432/885] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:36.303720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12164c-17ce-47e6-8bcc-2b1b1db3c76d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:36.324941 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dc57e-d1af-4a1c-b05f-b6dba6f54937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:36.326892 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dc57e-d1af-4a1c-b05f-b6dba6f54937 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:36.327186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dc57e-d1af-4a1c-b05f-b6dba6f54937 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:36.327605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dc57e-d1af-4a1c-b05f-b6dba6f54937 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:36.328447 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dc57e-d1af-4a1c-b05f-b6dba6f54937 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:36.330399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dc57e-d1af-4a1c-b05f-b6dba6f54937 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-dd2dc57e-d1af-4a1c-b05f-b6dba6f54937 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:36.345386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:36.346359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:36.347184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:36.347184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:36.347184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:36.347184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:36.347184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:36.347184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:36.347184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:36.347184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:36.347184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:36.347184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:36.347184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:36.347184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:36.347184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:37:36.347184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:36.350022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 454/886] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:37:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:36.355794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dc57e-d1af-4a1c-b05f-b6dba6f54937 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:36.414945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12164c-17ce-47e6-8bcc-2b1b1db3c76d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:36.436047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:36.454432 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787860e-fe43-4ead-8254-a0266dc4ff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:36.455489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787860e-fe43-4ead-8254-a0266dc4ff2f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:36.456521 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787860e-fe43-4ead-8254-a0266dc4ff2f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:36.456963 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787860e-fe43-4ead-8254-a0266dc4ff2f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:36.471990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787860e-fe43-4ead-8254-a0266dc4ff2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:36.482159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dc57e-d1af-4a1c-b05f-b6dba6f54937 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-d787860e-fe43-4ead-8254-a0266dc4ff2f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:36.483666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:36.484854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:36.485821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:36.485821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:36.485821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:36.485821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:36.485821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:36.485821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:36.485821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:36.485821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:36.485821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:36.485821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:36.485821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:37:36.485821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:36.485821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 433/887] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Jul 11 15:37:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:36.490633 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787860e-fe43-4ead-8254-a0266dc4ff2f None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:36.524643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:36.526475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d5fce-b47b-45cb-a593-71979169c802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:36.527383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d5fce-b47b-45cb-a593-71979169c802 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:36.527879 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d5fce-b47b-45cb-a593-71979169c802 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:36.528370 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d5fce-b47b-45cb-a593-71979169c802 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:36.529515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d5fce-b47b-45cb-a593-71979169c802 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:36.530024 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d5fce-b47b-45cb-a593-71979169c802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:36.531605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d5fce-b47b-45cb-a593-71979169c802 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:36.537085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 455/888] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:37:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:36.548342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d5fce-b47b-45cb-a593-71979169c802 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:36.623106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787860e-fe43-4ead-8254-a0266dc4ff2f None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:36.661495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17ee57-3537-41aa-90a0-79df95ecc98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:36.662177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17ee57-3537-41aa-90a0-79df95ecc98f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:36.662461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17ee57-3537-41aa-90a0-79df95ecc98f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:36.662754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17ee57-3537-41aa-90a0-79df95ecc98f None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:36.663512 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17ee57-3537-41aa-90a0-79df95ecc98f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:36.663825 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17ee57-3537-41aa-90a0-79df95ecc98f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:36.665364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17ee57-3537-41aa-90a0-79df95ecc98f None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:36.674246 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 434/889] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Jul 11 15:37:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:36.675633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d5fce-b47b-45cb-a593-71979169c802 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:36.688376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17ee57-3537-41aa-90a0-79df95ecc98f None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:36.702330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:36.727906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90458e53-3cf5-451f-b7a6-12d9d4c7c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:36.729010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90458e53-3cf5-451f-b7a6-12d9d4c7c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:36.729550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90458e53-3cf5-451f-b7a6-12d9d4c7c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:36.729831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90458e53-3cf5-451f-b7a6-12d9d4c7c8b9 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:36.730784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90458e53-3cf5-451f-b7a6-12d9d4c7c8b9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:36.731101 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90458e53-3cf5-451f-b7a6-12d9d4c7c8b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:36.733510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90458e53-3cf5-451f-b7a6-12d9d4c7c8b9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:36.740772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 456/890] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:37:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:36.746395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90458e53-3cf5-451f-b7a6-12d9d4c7c8b9 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:36.767010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:36.782460 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17ee57-3537-41aa-90a0-79df95ecc98f None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:36.816978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd55c15-079e-4ba2-8674-392562e939f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:36.817950 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd55c15-079e-4ba2-8674-392562e939f7 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:36.818326 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd55c15-079e-4ba2-8674-392562e939f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:36.818715 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd55c15-079e-4ba2-8674-392562e939f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:36.830358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd55c15-079e-4ba2-8674-392562e939f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:36.831949 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd55c15-079e-4ba2-8674-392562e939f7 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-ebd55c15-079e-4ba2-8674-392562e939f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:36.849556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:36.850641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:36.851748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:36.851748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:36.851748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:36.851748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:36.856723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 435/891] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:36.859123 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd55c15-079e-4ba2-8674-392562e939f7 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:36.860168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90458e53-3cf5-451f-b7a6-12d9d4c7c8b9 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:36.899819 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b55a3-8125-4bac-974e-0dce300a2bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:36.900533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b55a3-8125-4bac-974e-0dce300a2bad None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:36.900869 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b55a3-8125-4bac-974e-0dce300a2bad None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:36.901147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b55a3-8125-4bac-974e-0dce300a2bad None admin] PATH_INFO: `/v3/endpoints` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:36.901964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b55a3-8125-4bac-974e-0dce300a2bad None admin] RBAC: Adding query filter params (interface=public, service_id=3dffcf91b99c4b8bade13bd1b01af5ad, region_id=RegionOne) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:36.902274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b55a3-8125-4bac-974e-0dce300a2bad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:36.903734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b55a3-8125-4bac-974e-0dce300a2bad None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:36.913628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 457/892] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Jul 11 15:37:36 2022] GET /identity/v3/endpoints?service_id=3dffcf91b99c4b8bade13bd1b01af5ad&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:36.925465 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b55a3-8125-4bac-974e-0dce300a2bad None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:36.988656 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:37.041501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b55a3-8125-4bac-974e-0dce300a2bad None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:37.078072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6827a0-c3e9-4fe9-b963-55bc36b138f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:37.079184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6827a0-c3e9-4fe9-b963-55bc36b138f1 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:37.079754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6827a0-c3e9-4fe9-b963-55bc36b138f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:37.080248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6827a0-c3e9-4fe9-b963-55bc36b138f1 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:37.081177 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6827a0-c3e9-4fe9-b963-55bc36b138f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:37.082485 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd55c15-079e-4ba2-8674-392562e939f7 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:37.082952 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6827a0-c3e9-4fe9-b963-55bc36b138f1 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:37.089757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 458/893] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Jul 11 15:37:36 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:37:37.120559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e1b1b-56d1-4733-871f-a11ea7be7e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:37.121246 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e1b1b-56d1-4733-871f-a11ea7be7e52 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:37.121637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e1b1b-56d1-4733-871f-a11ea7be7e52 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:37.121910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e1b1b-56d1-4733-871f-a11ea7be7e52 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:37.122761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e1b1b-56d1-4733-871f-a11ea7be7e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:37.123065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e1b1b-56d1-4733-871f-a11ea7be7e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:37.124763 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e1b1b-56d1-4733-871f-a11ea7be7e52 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:37.138016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 436/894] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:37.142803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:37.144234 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6827a0-c3e9-4fe9-b963-55bc36b138f1 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:37.266363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6827a0-c3e9-4fe9-b963-55bc36b138f1 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:37.281710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:37.304544 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19c6dd-ac99-4eed-beee-d826d2f72bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:37.305343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19c6dd-ac99-4eed-beee-d826d2f72bab None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:37.305630 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19c6dd-ac99-4eed-beee-d826d2f72bab None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:37.305904 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19c6dd-ac99-4eed-beee-d826d2f72bab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:37.314904 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19c6dd-ac99-4eed-beee-d826d2f72bab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:37.316463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19c6dd-ac99-4eed-beee-d826d2f72bab None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-1f19c6dd-ac99-4eed-beee-d826d2f72bab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:37.332461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:37.333493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:37.334601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:37.334601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:37.334601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:37.334601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:37.334601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:37.334601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:37.334601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:37.334601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:37.334601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:37:37.334601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:37.334601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 459/895] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Jul 11 15:37:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:37.339821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e1b1b-56d1-4733-871f-a11ea7be7e52 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:37.443136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e1b1b-56d1-4733-871f-a11ea7be7e52 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:37.478256 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f640fc-e5c1-4e15-a8da-202ebc94dabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:37.479306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f640fc-e5c1-4e15-a8da-202ebc94dabf None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:37.479789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f640fc-e5c1-4e15-a8da-202ebc94dabf None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:37.480275 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f640fc-e5c1-4e15-a8da-202ebc94dabf None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:37.481353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f640fc-e5c1-4e15-a8da-202ebc94dabf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:37.481864 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f640fc-e5c1-4e15-a8da-202ebc94dabf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:37.483609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f640fc-e5c1-4e15-a8da-202ebc94dabf None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:37.502708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 437/896] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Jul 11 15:37:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:37.508800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19c6dd-ac99-4eed-beee-d826d2f72bab None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:37.615056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19c6dd-ac99-4eed-beee-d826d2f72bab None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:37.652557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4166ef-302f-47fe-8d64-4abed3a7673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:37.652936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856f5cb-b4d0-4162-8b49-7f61d765a363 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:37.653224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856f5cb-b4d0-4162-8b49-7f61d765a363 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:37.653498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856f5cb-b4d0-4162-8b49-7f61d765a363 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:37.654314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4166ef-302f-47fe-8d64-4abed3a7673b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:37.654939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4166ef-302f-47fe-8d64-4abed3a7673b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:37.655401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4166ef-302f-47fe-8d64-4abed3a7673b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:37.655852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 438/897] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:37:37.660727 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362f122-5bd1-43af-b784-6ed8c94c1d94 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:37.661011 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362f122-5bd1-43af-b784-6ed8c94c1d94 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:37.661285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362f122-5bd1-43af-b784-6ed8c94c1d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:37.679148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-6362f122-5bd1-43af-b784-6ed8c94c1d94 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:37.680373 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6362f122-5bd1-43af-b784-6ed8c94c1d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:37.707234 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:37.739441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:37.743400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4166ef-302f-47fe-8d64-4abed3a7673b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:37.745579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4166ef-302f-47fe-8d64-4abed3a7673b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:37.764648 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 439/898] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:37.783893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362f122-5bd1-43af-b784-6ed8c94c1d94 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:37.865495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 460/899] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:37 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:37:37.867720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4166ef-302f-47fe-8d64-4abed3a7673b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:37.903533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362f122-5bd1-43af-b784-6ed8c94c1d94 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:37.944090 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68c71d-b990-4ba0-ab94-8dfa40bd8ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:37.944790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68c71d-b990-4ba0-ab94-8dfa40bd8ce7 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:37.945071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68c71d-b990-4ba0-ab94-8dfa40bd8ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:37.945350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68c71d-b990-4ba0-ab94-8dfa40bd8ce7 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:37.946078 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68c71d-b990-4ba0-ab94-8dfa40bd8ce7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:37.947464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68c71d-b990-4ba0-ab94-8dfa40bd8ce7 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:37.956252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:37.962337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 440/900] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Jul 11 15:37:37 2022] POST /identity/v3/services => generated 241 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:37:37.970054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a2f5b-08da-4233-9357-56bfed604a4b None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:37.970346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a2f5b-08da-4233-9357-56bfed604a4b None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:37.970625 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a2f5b-08da-4233-9357-56bfed604a4b None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:37.972081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 441/901] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:37.978059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3b9be-3728-4b77-906d-a1b443d18584 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:37.978361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3b9be-3728-4b77-906d-a1b443d18584 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:37.978627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3b9be-3728-4b77-906d-a1b443d18584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:37.997206 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-8df3b9be-3728-4b77-906d-a1b443d18584 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:37.998777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8df3b9be-3728-4b77-906d-a1b443d18584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:38.002774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4166ef-302f-47fe-8d64-4abed3a7673b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:38.050407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:38.060420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee85d5-9ce5-4fef-816f-f115b3b85026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:38.062805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee85d5-9ce5-4fef-816f-f115b3b85026 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:38.063273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee85d5-9ce5-4fef-816f-f115b3b85026 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:38.063719 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee85d5-9ce5-4fef-816f-f115b3b85026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:38.079761 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee85d5-9ce5-4fef-816f-f115b3b85026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:38.081655 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee85d5-9ce5-4fef-816f-f115b3b85026 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:38.088811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 442/902] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-e5ee85d5-9ce5-4fef-816f-f115b3b85026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:38.102460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:38.103407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:38.104263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:38.104263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:38.104263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:38.104263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:38.106641 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 461/903] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:38.111616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3b9be-3728-4b77-906d-a1b443d18584 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:38.113956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee85d5-9ce5-4fef-816f-f115b3b85026 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:38.237841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3b9be-3728-4b77-906d-a1b443d18584 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:38.243070 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee85d5-9ce5-4fef-816f-f115b3b85026 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:38.273882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:38.274828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c5948-d7d8-4a29-8dce-ae408472b6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:38.275513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c5948-d7d8-4a29-8dce-ae408472b6f0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:38.275832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c5948-d7d8-4a29-8dce-ae408472b6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:38.276073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c5948-d7d8-4a29-8dce-ae408472b6f0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:38.276769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c5948-d7d8-4a29-8dce-ae408472b6f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:38.278174 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c5948-d7d8-4a29-8dce-ae408472b6f0 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-f35c5948-d7d8-4a29-8dce-ae408472b6f0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:38.292377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:38.293351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:38.299391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 443/904] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Jul 11 15:37:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:38.302346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c5948-d7d8-4a29-8dce-ae408472b6f0 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:38.305108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472dedf5-44f6-4b72-8fe3-91a4ba097cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:38.305778 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dedf5-44f6-4b72-8fe3-91a4ba097cfe None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:38.306064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dedf5-44f6-4b72-8fe3-91a4ba097cfe None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:38.306342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dedf5-44f6-4b72-8fe3-91a4ba097cfe None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:38.307132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dedf5-44f6-4b72-8fe3-91a4ba097cfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:38.307437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dedf5-44f6-4b72-8fe3-91a4ba097cfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:38.308934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dedf5-44f6-4b72-8fe3-91a4ba097cfe None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:38.321521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 462/905] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:38.329310 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472dedf5-44f6-4b72-8fe3-91a4ba097cfe None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:38.356631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:38.435876 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c5948-d7d8-4a29-8dce-ae408472b6f0 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:38.440351 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472dedf5-44f6-4b72-8fe3-91a4ba097cfe None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:38.476627 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36421c6-b87e-4cc6-a52f-ebd2974b57dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:38.477452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36421c6-b87e-4cc6-a52f-ebd2974b57dd None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:38.477688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36421c6-b87e-4cc6-a52f-ebd2974b57dd None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:38.477956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36421c6-b87e-4cc6-a52f-ebd2974b57dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:38.481618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf689b0-ff0b-4e34-a7a6-2345df9b8531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:38.482527 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf689b0-ff0b-4e34-a7a6-2345df9b8531 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:38.483063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf689b0-ff0b-4e34-a7a6-2345df9b8531 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:38.483487 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf689b0-ff0b-4e34-a7a6-2345df9b8531 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:38.484668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf689b0-ff0b-4e34-a7a6-2345df9b8531 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:38.484972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36421c6-b87e-4cc6-a52f-ebd2974b57dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:38.485295 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf689b0-ff0b-4e34-a7a6-2345df9b8531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:38.486486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36421c6-b87e-4cc6-a52f-ebd2974b57dd None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:38.487129 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf689b0-ff0b-4e34-a7a6-2345df9b8531 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:38.493633 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 444/906] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Jul 11 15:37:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:38.498852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf689b0-ff0b-4e34-a7a6-2345df9b8531 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-e36421c6-b87e-4cc6-a52f-ebd2974b57dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:38.504422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:38.505265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:38.506134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:38.506134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:38.506134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:38.506134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:38.506134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:38.506134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:38.506134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:38.506134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:38.506134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 463/907] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:38.513391 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36421c6-b87e-4cc6-a52f-ebd2974b57dd None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:38.557753 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:38.612372 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf689b0-ff0b-4e34-a7a6-2345df9b8531 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:38.615698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:38.636650 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36421c6-b87e-4cc6-a52f-ebd2974b57dd None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:38.650678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abecc7-5b81-4215-aaf9-cd606222a3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:38.651349 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abecc7-5b81-4215-aaf9-cd606222a3c4 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:38.651840 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abecc7-5b81-4215-aaf9-cd606222a3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:38.651946 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abecc7-5b81-4215-aaf9-cd606222a3c4 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:38.652650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abecc7-5b81-4215-aaf9-cd606222a3c4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:38.652958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abecc7-5b81-4215-aaf9-cd606222a3c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:38.655152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abecc7-5b81-4215-aaf9-cd606222a3c4 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:38.665581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 445/908] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Jul 11 15:37:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:38.666658 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abecc7-5b81-4215-aaf9-cd606222a3c4 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:38.687034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99de5d6-5d5f-48b6-b23d-832e0f5fe78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:38.688472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99de5d6-5d5f-48b6-b23d-832e0f5fe78e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:38.688953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99de5d6-5d5f-48b6-b23d-832e0f5fe78e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:38.689418 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99de5d6-5d5f-48b6-b23d-832e0f5fe78e None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:38.690986 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99de5d6-5d5f-48b6-b23d-832e0f5fe78e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:38.691505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99de5d6-5d5f-48b6-b23d-832e0f5fe78e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:38.693700 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99de5d6-5d5f-48b6-b23d-832e0f5fe78e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:38.714624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 464/909] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:38.718154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99de5d6-5d5f-48b6-b23d-832e0f5fe78e None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:38.786151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abecc7-5b81-4215-aaf9-cd606222a3c4 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:38.831908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96ef5d-25e1-4f5a-96c3-fad99ed4e310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:38.832864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:38.833072 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ef5d-25e1-4f5a-96c3-fad99ed4e310 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:38.833359 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ef5d-25e1-4f5a-96c3-fad99ed4e310 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:38.833636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ef5d-25e1-4f5a-96c3-fad99ed4e310 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:38.834443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96ef5d-25e1-4f5a-96c3-fad99ed4e310 None admin] RBAC: Adding query filter params (interface=public, service_id=d1ad5ed86db14a38afeca0b50a47eb67, region_id=RegionOne) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:38.834800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96ef5d-25e1-4f5a-96c3-fad99ed4e310 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:38.836130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96ef5d-25e1-4f5a-96c3-fad99ed4e310 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:38.840470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99de5d6-5d5f-48b6-b23d-832e0f5fe78e None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:38.851093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 446/910] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Jul 11 15:37:38 2022] GET /identity/v3/endpoints?service_id=d1ad5ed86db14a38afeca0b50a47eb67&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:38.852705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96ef5d-25e1-4f5a-96c3-fad99ed4e310 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:38.879380 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac8647-d224-401d-bbeb-fc5984b839e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:38.880043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac8647-d224-401d-bbeb-fc5984b839e5 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:38.880349 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac8647-d224-401d-bbeb-fc5984b839e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:38.880629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac8647-d224-401d-bbeb-fc5984b839e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:38.881578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac8647-d224-401d-bbeb-fc5984b839e5 None admin] RBAC: Adding query filter params (role.id=c3aba0dfe1734a90bbf4770537e6c77c, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=8c910084851040cf817aa92ede9d0d97) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:38.881893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac8647-d224-401d-bbeb-fc5984b839e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:38.883560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac8647-d224-401d-bbeb-fc5984b839e5 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:38.896314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 465/911] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:38 2022] GET /identity/v3/role_assignments?user.id=8c910084851040cf817aa92ede9d0d97&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c3aba0dfe1734a90bbf4770537e6c77c => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:38.901875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:38.982830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96ef5d-25e1-4f5a-96c3-fad99ed4e310 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:39.025931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf49bf-09bb-4aca-8365-6b33276af195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:39.026993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf49bf-09bb-4aca-8365-6b33276af195 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:39.027469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf49bf-09bb-4aca-8365-6b33276af195 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:39.027932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf49bf-09bb-4aca-8365-6b33276af195 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:39.028917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf49bf-09bb-4aca-8365-6b33276af195 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:39.030690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf49bf-09bb-4aca-8365-6b33276af195 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:39.038235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 447/912] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Jul 11 15:37:38 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:37:39.182079 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a5d65-5cad-403b-8b3b-8f39c353a1a4 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:39.182609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a5d65-5cad-403b-8b3b-8f39c353a1a4 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:39.182609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a5d65-5cad-403b-8b3b-8f39c353a1a4 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:39.184318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 466/913] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:39.190089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53234341-b2a2-49ac-a590-b4f0fbe88f19 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:39.190649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53234341-b2a2-49ac-a590-b4f0fbe88f19 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:39.190649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53234341-b2a2-49ac-a590-b4f0fbe88f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:39.208524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-53234341-b2a2-49ac-a590-b4f0fbe88f19 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:39.210077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-53234341-b2a2-49ac-a590-b4f0fbe88f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:39.283028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 448/914] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:39.305991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a5d65-5cad-403b-8b3b-8f39c353a1a4 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:39.426248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a5d65-5cad-403b-8b3b-8f39c353a1a4 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:39.462044 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7f2de-74b7-4d0c-9291-ee0813c5a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:39.462837 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7f2de-74b7-4d0c-9291-ee0813c5a970 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:39.463113 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7f2de-74b7-4d0c-9291-ee0813c5a970 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:39.463386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7f2de-74b7-4d0c-9291-ee0813c5a970 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:39.464043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7f2de-74b7-4d0c-9291-ee0813c5a970 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:39.465528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7f2de-74b7-4d0c-9291-ee0813c5a970 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-21e7f2de-74b7-4d0c-9291-ee0813c5a970 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:39.477642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:39.478665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:39.479510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 467/915] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:37:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:39.487218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53234341-b2a2-49ac-a590-b4f0fbe88f19 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:39.514945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:39.591649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53234341-b2a2-49ac-a590-b4f0fbe88f19 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:39.626734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e49b4-a50d-4791-b857-1ad284f37892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:39.627828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e49b4-a50d-4791-b857-1ad284f37892 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:39.628387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e49b4-a50d-4791-b857-1ad284f37892 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:39.628852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e49b4-a50d-4791-b857-1ad284f37892 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:39.629751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e49b4-a50d-4791-b857-1ad284f37892 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:39.630257 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e49b4-a50d-4791-b857-1ad284f37892 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:39.631812 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e49b4-a50d-4791-b857-1ad284f37892 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:39.637358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 449/916] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:37:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:39.643196 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7f2de-74b7-4d0c-9291-ee0813c5a970 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:39.673651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:39.747111 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7f2de-74b7-4d0c-9291-ee0813c5a970 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:39.781698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58015c7d-c675-4fd0-81b0-2fe159e6cd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:39.782761 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58015c7d-c675-4fd0-81b0-2fe159e6cd53 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:39.783257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58015c7d-c675-4fd0-81b0-2fe159e6cd53 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:39.783726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58015c7d-c675-4fd0-81b0-2fe159e6cd53 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:39.784658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58015c7d-c675-4fd0-81b0-2fe159e6cd53 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:39.785156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58015c7d-c675-4fd0-81b0-2fe159e6cd53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:39.786743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58015c7d-c675-4fd0-81b0-2fe159e6cd53 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:39.796611 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 468/917] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Jul 11 15:37:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:39.798854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e49b4-a50d-4791-b857-1ad284f37892 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:39.889782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:39.900040 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e49b4-a50d-4791-b857-1ad284f37892 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:39.934425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b9461-714f-43d1-9b0d-cbc39891de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:39.935883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b9461-714f-43d1-9b0d-cbc39891de64 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:39.936389 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b9461-714f-43d1-9b0d-cbc39891de64 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:39.936888 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b9461-714f-43d1-9b0d-cbc39891de64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:39.937829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b9461-714f-43d1-9b0d-cbc39891de64 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:39.939421 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b9461-714f-43d1-9b0d-cbc39891de64 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:39.962589 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 450/918] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Jul 11 15:37:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:37:40.129265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aee0f-8835-4a47-beeb-e6e060482a70 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:40.130047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aee0f-8835-4a47-beeb-e6e060482a70 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:40.137351 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aee0f-8835-4a47-beeb-e6e060482a70 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:40.138286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 469/919] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:40.143578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999d24c-214f-4b7e-91c3-f3ee10b26753 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:40.143790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999d24c-214f-4b7e-91c3-f3ee10b26753 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:40.144042 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999d24c-214f-4b7e-91c3-f3ee10b26753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:40.166805 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-9999d24c-214f-4b7e-91c3-f3ee10b26753 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:40.168444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9999d24c-214f-4b7e-91c3-f3ee10b26753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:40.246935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 451/920] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:40.270273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aee0f-8835-4a47-beeb-e6e060482a70 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:40.365087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:40.374768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aee0f-8835-4a47-beeb-e6e060482a70 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:40.412506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e16e42-9914-4b5f-9228-87b73f64a3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:40.413281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e16e42-9914-4b5f-9228-87b73f64a3b9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:40.413611 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e16e42-9914-4b5f-9228-87b73f64a3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:40.413887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e16e42-9914-4b5f-9228-87b73f64a3b9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:40.414552 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e16e42-9914-4b5f-9228-87b73f64a3b9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:40.415940 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e16e42-9914-4b5f-9228-87b73f64a3b9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-64e16e42-9914-4b5f-9228-87b73f64a3b9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:40.428680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:40.429712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:40.430612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:40.430612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:40.430612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:40.430612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:40.430612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:40.430612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:40.430612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:40.430612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:40.430612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:40.430612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:40.430612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:40.430612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:40.430612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:40.430612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:40.434995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 470/921] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Jul 11 15:37:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:40.436998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999d24c-214f-4b7e-91c3-f3ee10b26753 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:40.508620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:40.542086 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999d24c-214f-4b7e-91c3-f3ee10b26753 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:40.582647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d391be5-f97e-495e-9c84-b48a118d210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:40.583325 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d391be5-f97e-495e-9c84-b48a118d210a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:40.583606 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d391be5-f97e-495e-9c84-b48a118d210a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:40.583875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d391be5-f97e-495e-9c84-b48a118d210a None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:40.584623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d391be5-f97e-495e-9c84-b48a118d210a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:40.584933 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d391be5-f97e-495e-9c84-b48a118d210a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:40.586324 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d391be5-f97e-495e-9c84-b48a118d210a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:40.592682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 452/922] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Jul 11 15:37:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:40.598225 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e16e42-9914-4b5f-9228-87b73f64a3b9 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:40.704498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e16e42-9914-4b5f-9228-87b73f64a3b9 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:40.739441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1833a8-bc89-4b6e-a69b-62ff3624b44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:40.740110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1833a8-bc89-4b6e-a69b-62ff3624b44f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:40.740415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1833a8-bc89-4b6e-a69b-62ff3624b44f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:40.740688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1833a8-bc89-4b6e-a69b-62ff3624b44f None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:40.741402 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1833a8-bc89-4b6e-a69b-62ff3624b44f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:40.741704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1833a8-bc89-4b6e-a69b-62ff3624b44f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:40.743076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1833a8-bc89-4b6e-a69b-62ff3624b44f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:40.748523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 471/923] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Jul 11 15:37:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:40.754397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d391be5-f97e-495e-9c84-b48a118d210a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:40.861444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d391be5-f97e-495e-9c84-b48a118d210a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:40.896773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea19a47-737e-4c92-9e67-425fd18e8b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:40.897549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea19a47-737e-4c92-9e67-425fd18e8b98 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:40.897834 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea19a47-737e-4c92-9e67-425fd18e8b98 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:40.898109 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea19a47-737e-4c92-9e67-425fd18e8b98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:40.898908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea19a47-737e-4c92-9e67-425fd18e8b98 None admin] RBAC: Adding query filter params (interface=public, service_id=a3df5ed114774c8bbeea08691db43353, region_id=RegionOne) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:40.899218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea19a47-737e-4c92-9e67-425fd18e8b98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:40.900626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea19a47-737e-4c92-9e67-425fd18e8b98 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:40.902997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:40.907015 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 453/924] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Jul 11 15:37:40 2022] GET /identity/v3/endpoints?service_id=a3df5ed114774c8bbeea08691db43353&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:40.913392 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1833a8-bc89-4b6e-a69b-62ff3624b44f None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:40.945395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:41.017221 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1833a8-bc89-4b6e-a69b-62ff3624b44f None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:41.026365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0768-7a71-40e6-ab43-103e06a7c7a7 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:41.026856 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0768-7a71-40e6-ab43-103e06a7c7a7 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:41.027296 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0768-7a71-40e6-ab43-103e06a7c7a7 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:41.029422 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 454/925] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:41.035399 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23d5dd-0257-4bef-b760-fa1716cfa947 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:41.035936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23d5dd-0257-4bef-b760-fa1716cfa947 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:41.036456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23d5dd-0257-4bef-b760-fa1716cfa947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:41.052278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed7619-94b4-4a2e-a214-4ac9a0723132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:41.052975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7619-94b4-4a2e-a214-4ac9a0723132 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:41.053256 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7619-94b4-4a2e-a214-4ac9a0723132 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:41.053531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7619-94b4-4a2e-a214-4ac9a0723132 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:41.054236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed7619-94b4-4a2e-a214-4ac9a0723132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:41.055703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed7619-94b4-4a2e-a214-4ac9a0723132 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:41.056896 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-ce23d5dd-0257-4bef-b760-fa1716cfa947 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:41.058417 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ce23d5dd-0257-4bef-b760-fa1716cfa947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:41.063265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 472/926] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Jul 11 15:37:40 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:37:41.144035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 455/927] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:41.174617 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed7619-94b4-4a2e-a214-4ac9a0723132 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:41.208943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dde6f0-9313-427a-af12-75af37adada6 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:41.209258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dde6f0-9313-427a-af12-75af37adada6 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:41.209500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dde6f0-9313-427a-af12-75af37adada6 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:41.211794 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 456/928] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:37:41.218623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5b716-5b87-4dcd-931d-7e1fd87f2d3b None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:41.218912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5b716-5b87-4dcd-931d-7e1fd87f2d3b None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:41.219178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5b716-5b87-4dcd-931d-7e1fd87f2d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:41.239450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-d8c5b716-5b87-4dcd-931d-7e1fd87f2d3b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:41.240647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d8c5b716-5b87-4dcd-931d-7e1fd87f2d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:41.277167 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:41.297867 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed7619-94b4-4a2e-a214-4ac9a0723132 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:41.334652 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 457/929] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:41.335883 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc89f0-e050-498e-affd-86be813c7efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:41.337327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc89f0-e050-498e-affd-86be813c7efb None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:41.337824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc89f0-e050-498e-affd-86be813c7efb None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:41.338295 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc89f0-e050-498e-affd-86be813c7efb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:41.353399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc89f0-e050-498e-affd-86be813c7efb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:41.358253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5b716-5b87-4dcd-931d-7e1fd87f2d3b None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-afbc89f0-e050-498e-affd-86be813c7efb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:41.365559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:41.366579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:41.367429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:41.367429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:41.367429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:41.367429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:41.367429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:41.367429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:41.367429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:41.367429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:41.367429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:41.367429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:41.367429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:37:41.367429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:41.375781 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 473/930] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Jul 11 15:37:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:41.377165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc89f0-e050-498e-affd-86be813c7efb None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:41.436986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:41.490733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5b716-5b87-4dcd-931d-7e1fd87f2d3b None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:41.496048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc89f0-e050-498e-affd-86be813c7efb None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:41.532402 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab0150-29c5-49bc-99dd-dba2046333ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:41.533092 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab0150-29c5-49bc-99dd-dba2046333ad None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:41.533630 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab0150-29c5-49bc-99dd-dba2046333ad None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:41.534125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab0150-29c5-49bc-99dd-dba2046333ad None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:41.535020 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab0150-29c5-49bc-99dd-dba2046333ad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:41.535331 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab0150-29c5-49bc-99dd-dba2046333ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:41.536958 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab0150-29c5-49bc-99dd-dba2046333ad None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:41.538064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f74af-599c-49c2-a968-ae385a2e4507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:41.539808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f74af-599c-49c2-a968-ae385a2e4507 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:41.540348 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f74af-599c-49c2-a968-ae385a2e4507 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:41.540885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f74af-599c-49c2-a968-ae385a2e4507 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:41.541762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f74af-599c-49c2-a968-ae385a2e4507 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:41.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f74af-599c-49c2-a968-ae385a2e4507 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:41.551408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 474/931] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Jul 11 15:37:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:41.552322 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab0150-29c5-49bc-99dd-dba2046333ad None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-4a4f74af-599c-49c2-a968-ae385a2e4507 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:41.559628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:41.560647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 15:37:41.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:41.563490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:41.566301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 458/932] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Jul 11 15:37:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:41.571641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f74af-599c-49c2-a968-ae385a2e4507 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:41.676581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab0150-29c5-49bc-99dd-dba2046333ad None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:41.685307 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f74af-599c-49c2-a968-ae385a2e4507 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:41.709257 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:41.713515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70173069-9986-40c5-945c-7ffd16b1ae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:41.714475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70173069-9986-40c5-945c-7ffd16b1ae62 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:41.714603 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70173069-9986-40c5-945c-7ffd16b1ae62 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:41.714866 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70173069-9986-40c5-945c-7ffd16b1ae62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:41.722994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56e9c7-e99f-46da-af04-539f7ecb38ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:41.723984 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56e9c7-e99f-46da-af04-539f7ecb38ea None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:41.724489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56e9c7-e99f-46da-af04-539f7ecb38ea None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:41.724977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56e9c7-e99f-46da-af04-539f7ecb38ea None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:41.725916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56e9c7-e99f-46da-af04-539f7ecb38ea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:41.726412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56e9c7-e99f-46da-af04-539f7ecb38ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:41.727926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70173069-9986-40c5-945c-7ffd16b1ae62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:41.728209 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56e9c7-e99f-46da-af04-539f7ecb38ea None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:41.729555 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70173069-9986-40c5-945c-7ffd16b1ae62 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:41.734265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 459/933] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Jul 11 15:37:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:41.740370 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56e9c7-e99f-46da-af04-539f7ecb38ea None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-70173069-9986-40c5-945c-7ffd16b1ae62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:41.752734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:41.753665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:41.754526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:41.754526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:41.754526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:41.754526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:41.758784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 475/934] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:41.759926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70173069-9986-40c5-945c-7ffd16b1ae62 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:41.827061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:41.846089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56e9c7-e99f-46da-af04-539f7ecb38ea None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:41.876054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70173069-9986-40c5-945c-7ffd16b1ae62 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:41.880908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a9ecc-15df-485d-b566-4b6fba77700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:41.881679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9ecc-15df-485d-b566-4b6fba77700d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:41.882023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9ecc-15df-485d-b566-4b6fba77700d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:41.882363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9ecc-15df-485d-b566-4b6fba77700d None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:41.883148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a9ecc-15df-485d-b566-4b6fba77700d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:41.883511 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a9ecc-15df-485d-b566-4b6fba77700d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:41.884996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a9ecc-15df-485d-b566-4b6fba77700d None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:41.895187 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 460/935] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Jul 11 15:37:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:41.896603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a9ecc-15df-485d-b566-4b6fba77700d None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:41.923137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bed31-4dcb-4fe3-a3cb-48a02d89fc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:41.924205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bed31-4dcb-4fe3-a3cb-48a02d89fc1f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:41.924689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bed31-4dcb-4fe3-a3cb-48a02d89fc1f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:41.925186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bed31-4dcb-4fe3-a3cb-48a02d89fc1f None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:41.926053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bed31-4dcb-4fe3-a3cb-48a02d89fc1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:41.926567 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bed31-4dcb-4fe3-a3cb-48a02d89fc1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:41.928406 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bed31-4dcb-4fe3-a3cb-48a02d89fc1f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:41.946943 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 476/936] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:41.948061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bed31-4dcb-4fe3-a3cb-48a02d89fc1f None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:41.949726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:41.998593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a9ecc-15df-485d-b566-4b6fba77700d None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:42.033208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e859d-35ba-4d6d-8553-660bc2645738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:42.034002 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e859d-35ba-4d6d-8553-660bc2645738 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:42.034343 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e859d-35ba-4d6d-8553-660bc2645738 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:42.034682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e859d-35ba-4d6d-8553-660bc2645738 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:42.035522 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e859d-35ba-4d6d-8553-660bc2645738 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:42.036979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e859d-35ba-4d6d-8553-660bc2645738 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:42.072318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 461/937] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Jul 11 15:37:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:37:42.072537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bed31-4dcb-4fe3-a3cb-48a02d89fc1f None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:42.091249 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:42.118777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605989b-827a-4804-9e8a-b91f200bf5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:42.119667 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605989b-827a-4804-9e8a-b91f200bf5cf None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:42.119950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605989b-827a-4804-9e8a-b91f200bf5cf None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:42.120386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605989b-827a-4804-9e8a-b91f200bf5cf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:42.125641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799aa41-6217-4118-ab0d-b0734772442a None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:42.125946 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799aa41-6217-4118-ab0d-b0734772442a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:42.126194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799aa41-6217-4118-ab0d-b0734772442a None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:42.127906 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 462/938] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:37:42.129952 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605989b-827a-4804-9e8a-b91f200bf5cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:42.131550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605989b-827a-4804-9e8a-b91f200bf5cf None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:42.133440 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8624d9-8b87-45b7-9fd3-830fa6df774d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:42.133727 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8624d9-8b87-45b7-9fd3-830fa6df774d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:42.134000 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8624d9-8b87-45b7-9fd3-830fa6df774d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:42.155394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-db8624d9-8b87-45b7-9fd3-830fa6df774d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:42.157077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-db8624d9-8b87-45b7-9fd3-830fa6df774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-5605989b-827a-4804-9e8a-b91f200bf5cf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:42.157395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:42.158316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:42.159292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:42.159292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:42.159292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:42.159292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:42.159292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:42.159292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:42.159292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:42.159292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:42.159292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:37:42.159292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:42.159292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 477/939] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Jul 11 15:37:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:42.164469 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605989b-827a-4804-9e8a-b91f200bf5cf None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:42.249571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 463/940] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:42.275151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8624d9-8b87-45b7-9fd3-830fa6df774d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:42.280227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605989b-827a-4804-9e8a-b91f200bf5cf None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:42.323566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2de3-d1d8-46f2-868d-47a2680f34e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:42.323977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:42.324864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2de3-d1d8-46f2-868d-47a2680f34e6 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:42.325436 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2de3-d1d8-46f2-868d-47a2680f34e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:42.325436 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2de3-d1d8-46f2-868d-47a2680f34e6 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:42.326530 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d2de3-d1d8-46f2-868d-47a2680f34e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:42.326923 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d2de3-d1d8-46f2-868d-47a2680f34e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:42.329101 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d2de3-d1d8-46f2-868d-47a2680f34e6 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:42.351461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 478/941] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Jul 11 15:37:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:42.357385 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2de3-d1d8-46f2-868d-47a2680f34e6 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:42.394795 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:42.404523 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8624d9-8b87-45b7-9fd3-830fa6df774d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:42.446903 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0918a-3632-4ab0-ac99-5afc40f2325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:42.447677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0918a-3632-4ab0-ac99-5afc40f2325e None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:42.448023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0918a-3632-4ab0-ac99-5afc40f2325e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:42.448396 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0918a-3632-4ab0-ac99-5afc40f2325e None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:42.449256 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0918a-3632-4ab0-ac99-5afc40f2325e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:42.450877 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0918a-3632-4ab0-ac99-5afc40f2325e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:42.452970 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: WARNING keystone.server.flask.common [None req-ecf0918a-3632-4ab0-ac99-5afc40f2325e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 15:37:42.489800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.sql.core [None req-ecf0918a-3632-4ab0-ac99-5afc40f2325e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 15:37:42.489800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 15:37:42.489800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [parameters: {'id': '2d81e76e4d4c489889012fe7142ccb50', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 15:37:42.489800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86734) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 15:37:42.498551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2de3-d1d8-46f2-868d-47a2680f34e6 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:42.499904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-ecf0918a-3632-4ab0-ac99-5afc40f2325e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2d81e76e4d4c489889012fe7142ccb50.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2d81e76e4d4c489889012fe7142ccb50. Jul 11 15:37:42.499904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:42.499904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:37:42.499904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:37:42.499904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:37:42.499904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:37:42.499904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:37:42.499904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:37:42.499904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:37:42.499904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:37:42.499904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:37:42.499904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:37:42.499904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application result.read() Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 11 15:37:42.500746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application yield resource Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise self.value Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application session.commit() Jul 11 15:37:42.501762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self.session.flush() Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application compat.raise_( Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 15:37:42.502676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 15:37:42.503570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application result.read() Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:37:42.504395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [parameters: {'id': '2d81e76e4d4c489889012fe7142ccb50', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:42.505247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:42.506016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:42.506907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:42.506907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 11 15:37:42.506907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 11 15:37:42.506907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:42.506907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:42.506907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 11 15:37:42.506907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 11 15:37:42.506907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2d81e76e4d4c489889012fe7142ccb50. Jul 11 15:37:42.506907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:42.506907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 464/942] 10.222.0.26 () {60 vars in 1140 bytes} [Mon Jul 11 15:37:42 2022] POST /identity/v3/projects => generated 262 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:42.507473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0918a-3632-4ab0-ac99-5afc40f2325e None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:42.548998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86386e75-ce6e-4607-8e19-dd553335a93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:42.550226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86386e75-ce6e-4607-8e19-dd553335a93d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:42.550707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86386e75-ce6e-4607-8e19-dd553335a93d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:42.551183 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86386e75-ce6e-4607-8e19-dd553335a93d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:42.562708 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86386e75-ce6e-4607-8e19-dd553335a93d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:42.564317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86386e75-ce6e-4607-8e19-dd553335a93d None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-86386e75-ce6e-4607-8e19-dd553335a93d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:42.583843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:42.585006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:42.586117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:42.586117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:42.586117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:42.586117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:42.592530 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 479/943] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:42.593608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86386e75-ce6e-4607-8e19-dd553335a93d None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:42.612576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:42.621469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0918a-3632-4ab0-ac99-5afc40f2325e None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:42.666526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ffaeb-d65f-4ebc-8c79-c6c11fb27445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:42.667972 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ffaeb-d65f-4ebc-8c79-c6c11fb27445 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:42.668376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ffaeb-d65f-4ebc-8c79-c6c11fb27445 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:42.668881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ffaeb-d65f-4ebc-8c79-c6c11fb27445 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:42.676385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ffaeb-d65f-4ebc-8c79-c6c11fb27445 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:42.678146 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ffaeb-d65f-4ebc-8c79-c6c11fb27445 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:42.686523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-a10ffaeb-d65f-4ebc-8c79-c6c11fb27445 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:42.693238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:42.694140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:42.695046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:42.695046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:42.695046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:42.695046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:42.695046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:42.695046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:42.695046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:42.695046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:42.695046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 465/944] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:42.701907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ffaeb-d65f-4ebc-8c79-c6c11fb27445 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:42.706834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86386e75-ce6e-4607-8e19-dd553335a93d None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:42.750188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ca9a8-549d-424f-9f69-9baff14850e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:42.751224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ca9a8-549d-424f-9f69-9baff14850e9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:42.751731 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ca9a8-549d-424f-9f69-9baff14850e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:42.752200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ca9a8-549d-424f-9f69-9baff14850e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:42.753257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ca9a8-549d-424f-9f69-9baff14850e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:42.753771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ca9a8-549d-424f-9f69-9baff14850e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:42.755446 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ca9a8-549d-424f-9f69-9baff14850e9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:42.768418 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 480/945] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:42.774779 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ca9a8-549d-424f-9f69-9baff14850e9 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:42.822122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ffaeb-d65f-4ebc-8c79-c6c11fb27445 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:42.859565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24227032-b131-4e3b-b7cd-07a8c5c16d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:42.860856 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24227032-b131-4e3b-b7cd-07a8c5c16d2b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:42.861550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24227032-b131-4e3b-b7cd-07a8c5c16d2b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:42.862217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24227032-b131-4e3b-b7cd-07a8c5c16d2b None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:42.863776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24227032-b131-4e3b-b7cd-07a8c5c16d2b None admin] RBAC: Adding query filter params (name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:42.864551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24227032-b131-4e3b-b7cd-07a8c5c16d2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:42.866298 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24227032-b131-4e3b-b7cd-07a8c5c16d2b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:42.894976 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ca9a8-549d-424f-9f69-9baff14850e9 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:42.896004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 466/946] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Jul 11 15:37:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:42.939966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5c2f4-a6df-432c-83e0-234f8bf3d62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:42.941250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5c2f4-a6df-432c-83e0-234f8bf3d62a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:42.941780 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5c2f4-a6df-432c-83e0-234f8bf3d62a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:42.942236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5c2f4-a6df-432c-83e0-234f8bf3d62a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:42.951147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5c2f4-a6df-432c-83e0-234f8bf3d62a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:42.953134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5c2f4-a6df-432c-83e0-234f8bf3d62a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-02f5c2f4-a6df-432c-83e0-234f8bf3d62a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:42.970591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:42.971554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:42.972472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:42.972472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:42.972472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:42.972472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:42.972472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:42.972472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:42.972472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:42.972472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:42.975136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 481/947] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:42.981510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24227032-b131-4e3b-b7cd-07a8c5c16d2b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:42.999228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:43.093322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24227032-b131-4e3b-b7cd-07a8c5c16d2b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:43.131641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a527c6f-0e45-4e8c-aeea-5bf9fdd16ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:43.132737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a527c6f-0e45-4e8c-aeea-5bf9fdd16ba4 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:43.133276 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a527c6f-0e45-4e8c-aeea-5bf9fdd16ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:43.133764 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a527c6f-0e45-4e8c-aeea-5bf9fdd16ba4 None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:43.134767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a527c6f-0e45-4e8c-aeea-5bf9fdd16ba4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:43.135276 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a527c6f-0e45-4e8c-aeea-5bf9fdd16ba4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:43.136960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a527c6f-0e45-4e8c-aeea-5bf9fdd16ba4 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:43.150355 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 467/948] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:43.156840 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5c2f4-a6df-432c-83e0-234f8bf3d62a None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:43.161031 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:43.200379 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6751-c8c2-46f3-8090-7b0fde0329f4 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:43.200835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6751-c8c2-46f3-8090-7b0fde0329f4 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:43.201443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6751-c8c2-46f3-8090-7b0fde0329f4 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:43.204685 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 468/949] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:37:43.209085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3a2f5-b9bf-49c0-86ca-58693ab4b983 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:43.209537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3a2f5-b9bf-49c0-86ca-58693ab4b983 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:43.209979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3a2f5-b9bf-49c0-86ca-58693ab4b983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:43.228856 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-03c3a2f5-b9bf-49c0-86ca-58693ab4b983 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:43.231303 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-03c3a2f5-b9bf-49c0-86ca-58693ab4b983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:43.273963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5c2f4-a6df-432c-83e0-234f8bf3d62a None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:43.317220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 469/950] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:43.320099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9ca41-623d-4dc3-b102-ed76b7f4b052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:43.320099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9ca41-623d-4dc3-b102-ed76b7f4b052 None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:43.320099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9ca41-623d-4dc3-b102-ed76b7f4b052 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:43.320099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9ca41-623d-4dc3-b102-ed76b7f4b052 None admin] PATH_INFO: `/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/8c910084851040cf817aa92ede9d0d97/roles/c3aba0dfe1734a90bbf4770537e6c77c` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:43.322127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9ca41-623d-4dc3-b102-ed76b7f4b052 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fe17aeb94ad42dc990c9d963dac9af6, user_id=8c910084851040cf817aa92ede9d0d97, role_id=c3aba0dfe1734a90bbf4770537e6c77c)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:43.323577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9ca41-623d-4dc3-b102-ed76b7f4b052 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:43.340217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3a2f5-b9bf-49c0-86ca-58693ab4b983 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:43.341172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 482/951] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:37:43 2022] PUT /identity/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/8c910084851040cf817aa92ede9d0d97/roles/c3aba0dfe1734a90bbf4770537e6c77c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:37:43.344803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:43.463449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3a2f5-b9bf-49c0-86ca-58693ab4b983 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:43.504321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0941f1-650c-4077-a429-3e962817df3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:43.505156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0941f1-650c-4077-a429-3e962817df3c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:43.505438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0941f1-650c-4077-a429-3e962817df3c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:43.505715 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0941f1-650c-4077-a429-3e962817df3c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:43.506381 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0941f1-650c-4077-a429-3e962817df3c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:43.507762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0941f1-650c-4077-a429-3e962817df3c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-8d0941f1-650c-4077-a429-3e962817df3c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:43.520562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:43.521821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:43.522863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 470/952] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Jul 11 15:37:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:43.529245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9ca41-623d-4dc3-b102-ed76b7f4b052 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:43.593565 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:43.632647 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9ca41-623d-4dc3-b102-ed76b7f4b052 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:43.666272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e727a-d9a3-4499-beba-b8cf94932498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:43.666948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e727a-d9a3-4499-beba-b8cf94932498 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:43.667233 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e727a-d9a3-4499-beba-b8cf94932498 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:43.667508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e727a-d9a3-4499-beba-b8cf94932498 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:43.668230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e727a-d9a3-4499-beba-b8cf94932498 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:43.668585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e727a-d9a3-4499-beba-b8cf94932498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:43.670072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e727a-d9a3-4499-beba-b8cf94932498 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:43.675416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 483/953] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Jul 11 15:37:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:43.680931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0941f1-650c-4077-a429-3e962817df3c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:43.751268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:43.791180 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0941f1-650c-4077-a429-3e962817df3c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:43.827376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec310a-9361-4a85-ba14-253b595f5ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:43.828471 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec310a-9361-4a85-ba14-253b595f5ed4 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:43.828986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec310a-9361-4a85-ba14-253b595f5ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:43.829486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec310a-9361-4a85-ba14-253b595f5ed4 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:43.830415 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec310a-9361-4a85-ba14-253b595f5ed4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:43.830921 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec310a-9361-4a85-ba14-253b595f5ed4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:43.832538 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec310a-9361-4a85-ba14-253b595f5ed4 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:43.839302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 471/954] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Jul 11 15:37:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:43.844724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e727a-d9a3-4499-beba-b8cf94932498 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:43.947881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e727a-d9a3-4499-beba-b8cf94932498 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:43.974769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:43.982917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adaac27-0b61-4be5-aeff-590daa23ed10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:43.983864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaac27-0b61-4be5-aeff-590daa23ed10 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:43.984468 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaac27-0b61-4be5-aeff-590daa23ed10 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:43.984751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaac27-0b61-4be5-aeff-590daa23ed10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:43.985891 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adaac27-0b61-4be5-aeff-590daa23ed10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:43.987278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adaac27-0b61-4be5-aeff-590daa23ed10 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:44.007619 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 484/955] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Jul 11 15:37:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:37:44.319517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5a99f-99b1-463d-8f72-79f39c57a490 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:44.319898 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5a99f-99b1-463d-8f72-79f39c57a490 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:44.320072 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5a99f-99b1-463d-8f72-79f39c57a490 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:44.321926 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 472/956] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:44.327680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26f0d-d2f2-47df-b6ad-683de56d792e None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:44.328193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26f0d-d2f2-47df-b6ad-683de56d792e None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:44.328276 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26f0d-d2f2-47df-b6ad-683de56d792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:44.345860 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3fc26f0d-d2f2-47df-b6ad-683de56d792e None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:44.347045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3fc26f0d-d2f2-47df-b6ad-683de56d792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:44.420844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 485/957] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:44.443127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5a99f-99b1-463d-8f72-79f39c57a490 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:44.555790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5a99f-99b1-463d-8f72-79f39c57a490 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:44.588107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:44.594558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face2ae0-b6da-4559-9100-7de9b93d85e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:44.595667 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2ae0-b6da-4559-9100-7de9b93d85e6 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:44.596178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2ae0-b6da-4559-9100-7de9b93d85e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:44.596745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2ae0-b6da-4559-9100-7de9b93d85e6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:44.597636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face2ae0-b6da-4559-9100-7de9b93d85e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:44.599235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face2ae0-b6da-4559-9100-7de9b93d85e6 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-face2ae0-b6da-4559-9100-7de9b93d85e6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:44.612063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:44.613227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:44.614156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:44.614156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:44.614156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:44.614156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:44.614156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:44.614156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:44.614156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:44.614156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:44.614156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:44.614156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:44.614156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:44.614156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:44.614156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:37:44.614156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:44.621768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 473/958] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:44.623384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26f0d-d2f2-47df-b6ad-683de56d792e None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:44.722744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26f0d-d2f2-47df-b6ad-683de56d792e None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:44.734421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:44.759221 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac933fa9-ffdb-449d-8c43-916545498e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:44.759956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac933fa9-ffdb-449d-8c43-916545498e37 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:44.760245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac933fa9-ffdb-449d-8c43-916545498e37 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:44.760550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac933fa9-ffdb-449d-8c43-916545498e37 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:44.761273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac933fa9-ffdb-449d-8c43-916545498e37 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:44.761581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac933fa9-ffdb-449d-8c43-916545498e37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:44.762980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac933fa9-ffdb-449d-8c43-916545498e37 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:44.772400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 486/959] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Jul 11 15:37:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:44.774293 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face2ae0-b6da-4559-9100-7de9b93d85e6 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:44.878348 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face2ae0-b6da-4559-9100-7de9b93d85e6 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:44.912624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851ffcf-3ed6-4a9d-a403-f5d2255b0a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:44.913302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851ffcf-3ed6-4a9d-a403-f5d2255b0a95 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:44.913584 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851ffcf-3ed6-4a9d-a403-f5d2255b0a95 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:44.913860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851ffcf-3ed6-4a9d-a403-f5d2255b0a95 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:44.914591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851ffcf-3ed6-4a9d-a403-f5d2255b0a95 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:44.914899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851ffcf-3ed6-4a9d-a403-f5d2255b0a95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:44.916281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851ffcf-3ed6-4a9d-a403-f5d2255b0a95 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:44.928469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 474/960] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Jul 11 15:37:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:45.152952 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328caef-87bd-4257-8ed6-277d29d9c7bb None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:45.153155 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328caef-87bd-4257-8ed6-277d29d9c7bb None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:45.153495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328caef-87bd-4257-8ed6-277d29d9c7bb None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:45.155399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 487/961] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:45.160994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ba0d4-b2ed-4896-a64f-a7dd271a3fa7 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:45.161291 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ba0d4-b2ed-4896-a64f-a7dd271a3fa7 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:45.161571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ba0d4-b2ed-4896-a64f-a7dd271a3fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:45.182127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-238ba0d4-b2ed-4896-a64f-a7dd271a3fa7 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:45.188747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-238ba0d4-b2ed-4896-a64f-a7dd271a3fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:45.253105 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:45.265337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 475/962] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:45.289569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328caef-87bd-4257-8ed6-277d29d9c7bb None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:45.393156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328caef-87bd-4257-8ed6-277d29d9c7bb None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:45.428709 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997afc7e-60bb-4cf4-bb30-db0481465fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:45.429710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afc7e-60bb-4cf4-bb30-db0481465fb5 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:45.430213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afc7e-60bb-4cf4-bb30-db0481465fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:45.430747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afc7e-60bb-4cf4-bb30-db0481465fb5 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:45.431638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997afc7e-60bb-4cf4-bb30-db0481465fb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:45.433308 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997afc7e-60bb-4cf4-bb30-db0481465fb5 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:45.434823 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: WARNING keystone.server.flask.common [None req-997afc7e-60bb-4cf4-bb30-db0481465fb5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 15:37:45.448809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.sql.core [None req-997afc7e-60bb-4cf4-bb30-db0481465fb5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 15:37:45.448809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 15:37:45.448809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [parameters: {'user_id': 'ee44a225df61476bb00511364852b851', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 15:37:45.448809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86735) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-997afc7e-60bb-4cf4-bb30-db0481465fb5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application result.read() Jul 11 15:37:45.466938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:37:45.467915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application yield resource Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application next(self.gen) Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise self.value Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application session.commit() Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 15:37:45.468908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self.session.flush() Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application compat.raise_( Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 15:37:45.469803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 15:37:45.470674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application conn.query(q) Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application result.read() Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 15:37:45.471505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ee44a225df61476bb00511364852b851', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:45.473412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 11 15:37:45.475248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 11 15:37:45.477383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 11 15:37:45.477383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 11 15:37:45.477383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 15:37:45.477383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 15:37:45.477383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 15:37:45.477383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:45.479920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 488/963] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Jul 11 15:37:45 2022] POST /identity/v3/users => generated 160 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:45.485118 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414e097-4470-436b-9bec-2ea45141190a None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:45.485436 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414e097-4470-436b-9bec-2ea45141190a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:45.485696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414e097-4470-436b-9bec-2ea45141190a None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:45.485979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997afc7e-60bb-4cf4-bb30-db0481465fb5 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:45.487195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 476/964] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:45.494731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4e734-057c-4eee-9127-738c524a35b1 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:45.495021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4e734-057c-4eee-9127-738c524a35b1 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:45.495301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4e734-057c-4eee-9127-738c524a35b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:45.514719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-99e4e734-057c-4eee-9127-738c524a35b1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:45.515920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-99e4e734-057c-4eee-9127-738c524a35b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:45.531714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:45.598399 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 477/965] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:45.620958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4e734-057c-4eee-9127-738c524a35b1 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:45.623654 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997afc7e-60bb-4cf4-bb30-db0481465fb5 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:45.666452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41996245-d237-4b0e-9d3d-7fab2a2fcce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:45.667252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41996245-d237-4b0e-9d3d-7fab2a2fcce0 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:45.667531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41996245-d237-4b0e-9d3d-7fab2a2fcce0 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:45.667800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41996245-d237-4b0e-9d3d-7fab2a2fcce0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:45.678379 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41996245-d237-4b0e-9d3d-7fab2a2fcce0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:45.680113 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41996245-d237-4b0e-9d3d-7fab2a2fcce0 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-41996245-d237-4b0e-9d3d-7fab2a2fcce0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:45.695059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:45.696060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:45.697041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:45.697041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:45.697041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:45.697041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:45.697041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:45.697041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:45.697041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:45.697041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:45.697041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 15:37:45.697041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:45.700668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 489/966] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:37:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:45.702208 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41996245-d237-4b0e-9d3d-7fab2a2fcce0 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:45.741173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4e734-057c-4eee-9127-738c524a35b1 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:45.766739 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:45.786530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc67851-766d-4e97-b1b6-4cbf9de172f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:45.788442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc67851-766d-4e97-b1b6-4cbf9de172f4 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:45.789306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc67851-766d-4e97-b1b6-4cbf9de172f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:45.789798 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc67851-766d-4e97-b1b6-4cbf9de172f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:45.800989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:45.805946 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc67851-766d-4e97-b1b6-4cbf9de172f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:45.807725 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41996245-d237-4b0e-9d3d-7fab2a2fcce0 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-7bc67851-766d-4e97-b1b6-4cbf9de172f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:45.816533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:45.817731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:45.818804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:45.818804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:45.818804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:45.818804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:45.818804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:45.818804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:45.818804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:45.818804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:45.818804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:45.818804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:45.818804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:37:45.818804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:45.821681 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 478/967] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Jul 11 15:37:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:45.828392 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc67851-766d-4e97-b1b6-4cbf9de172f4 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:45.853529 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce66ac8-ace5-48bd-a116-3dc991fb02c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:45.854339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce66ac8-ace5-48bd-a116-3dc991fb02c0 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:45.854878 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce66ac8-ace5-48bd-a116-3dc991fb02c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:45.855264 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce66ac8-ace5-48bd-a116-3dc991fb02c0 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:45.856172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce66ac8-ace5-48bd-a116-3dc991fb02c0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:45.856594 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce66ac8-ace5-48bd-a116-3dc991fb02c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:45.858395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce66ac8-ace5-48bd-a116-3dc991fb02c0 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:45.900661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 490/968] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Jul 11 15:37:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:45.947534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc67851-766d-4e97-b1b6-4cbf9de172f4 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:45.987619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716b105-7c61-4417-a3e1-460b89e0f572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:45.988635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716b105-7c61-4417-a3e1-460b89e0f572 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:45.989084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716b105-7c61-4417-a3e1-460b89e0f572 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:45.989522 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716b105-7c61-4417-a3e1-460b89e0f572 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:45.990447 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716b105-7c61-4417-a3e1-460b89e0f572 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:45.990907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716b105-7c61-4417-a3e1-460b89e0f572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:45.992503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716b105-7c61-4417-a3e1-460b89e0f572 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:46.002714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 479/969] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Jul 11 15:37:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:46.010961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce66ac8-ace5-48bd-a116-3dc991fb02c0 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:46.075144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfe712-755d-4e4a-a0f7-16db2c76fad5 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:46.075791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfe712-755d-4e4a-a0f7-16db2c76fad5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:46.076222 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfe712-755d-4e4a-a0f7-16db2c76fad5 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:46.077896 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 480/970] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:37:46.084126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992c45b-e117-4ce8-8de6-169f7e50debe None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:46.084503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992c45b-e117-4ce8-8de6-169f7e50debe None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:46.084751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992c45b-e117-4ce8-8de6-169f7e50debe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:46.105601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-b992c45b-e117-4ce8-8de6-169f7e50debe None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:46.107247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b992c45b-e117-4ce8-8de6-169f7e50debe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:46.128537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce66ac8-ace5-48bd-a116-3dc991fb02c0 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:46.155016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:46.170318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1493525-c8a9-4f41-8358-19705b0e1264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:46.171140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1493525-c8a9-4f41-8358-19705b0e1264 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:46.171426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1493525-c8a9-4f41-8358-19705b0e1264 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:46.171702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1493525-c8a9-4f41-8358-19705b0e1264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:46.184592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1493525-c8a9-4f41-8358-19705b0e1264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:46.187062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1493525-c8a9-4f41-8358-19705b0e1264 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:46.202196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 481/971] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-f1493525-c8a9-4f41-8358-19705b0e1264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:46.209523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:46.210437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:46.211317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:46.211317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:46.211317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:46.211317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:46.212195 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 491/972] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:46.218007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992c45b-e117-4ce8-8de6-169f7e50debe None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:46.225610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1493525-c8a9-4f41-8358-19705b0e1264 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:46.235664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:46.326367 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992c45b-e117-4ce8-8de6-169f7e50debe None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:46.331289 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1493525-c8a9-4f41-8358-19705b0e1264 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:46.362134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ed8b-20dd-4163-b089-6f411dc11051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:46.362829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ed8b-20dd-4163-b089-6f411dc11051 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:46.363081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ed8b-20dd-4163-b089-6f411dc11051 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:46.363353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ed8b-20dd-4163-b089-6f411dc11051 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:46.364083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809ed8b-20dd-4163-b089-6f411dc11051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:46.364419 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809ed8b-20dd-4163-b089-6f411dc11051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:46.365783 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86793049-1187-4a0f-bd4c-e2a80fea5faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:46.365925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809ed8b-20dd-4163-b089-6f411dc11051 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:46.366650 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793049-1187-4a0f-bd4c-e2a80fea5faf None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:46.366937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793049-1187-4a0f-bd4c-e2a80fea5faf None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:46.367210 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793049-1187-4a0f-bd4c-e2a80fea5faf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:46.367867 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86793049-1187-4a0f-bd4c-e2a80fea5faf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:46.369265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86793049-1187-4a0f-bd4c-e2a80fea5faf None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:46.377265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 482/973] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-86793049-1187-4a0f-bd4c-e2a80fea5faf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:46.381362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:46.382333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:46.383147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:46.383147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:46.383147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:46.383147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:46.383147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:46.383147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:46.383147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:46.383147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:46.383147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:46.383147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:46.383147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:46.383147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:46.383147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:46.383147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:46.383877 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ed8b-20dd-4163-b089-6f411dc11051 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:46.383964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 492/974] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Jul 11 15:37:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:46.388553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86793049-1187-4a0f-bd4c-e2a80fea5faf None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:46.415293 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:46.473595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:46.484635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ed8b-20dd-4163-b089-6f411dc11051 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:46.512616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86793049-1187-4a0f-bd4c-e2a80fea5faf None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:46.517772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ccd2d-c995-4e8e-8f65-5b2a82f362d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:46.518585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ccd2d-c995-4e8e-8f65-5b2a82f362d0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:46.518868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ccd2d-c995-4e8e-8f65-5b2a82f362d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:46.519138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ccd2d-c995-4e8e-8f65-5b2a82f362d0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:46.526822 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ccd2d-c995-4e8e-8f65-5b2a82f362d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:46.528274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ccd2d-c995-4e8e-8f65-5b2a82f362d0 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-150ccd2d-c995-4e8e-8f65-5b2a82f362d0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:46.543195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:46.544179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:46.545230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:46.545230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:46.545230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:46.545230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:46.545230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:46.545230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:46.545230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:46.545230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:46.545230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 15:37:46.545230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:46.545230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 483/975] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Jul 11 15:37:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:46.550547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ccd2d-c995-4e8e-8f65-5b2a82f362d0 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:46.553915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81086991-0200-4d3c-a248-b1f3ad0dac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:46.555681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81086991-0200-4d3c-a248-b1f3ad0dac74 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:46.556128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81086991-0200-4d3c-a248-b1f3ad0dac74 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:46.556613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81086991-0200-4d3c-a248-b1f3ad0dac74 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:46.557544 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81086991-0200-4d3c-a248-b1f3ad0dac74 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:46.558006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81086991-0200-4d3c-a248-b1f3ad0dac74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:46.559624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81086991-0200-4d3c-a248-b1f3ad0dac74 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:46.572027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 493/976] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Jul 11 15:37:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:46.573145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81086991-0200-4d3c-a248-b1f3ad0dac74 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:46.654084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:46.665368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ccd2d-c995-4e8e-8f65-5b2a82f362d0 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:46.683735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81086991-0200-4d3c-a248-b1f3ad0dac74 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:46.699516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a92f64-7d00-4ccd-9217-2363e8bb2401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:46.700190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a92f64-7d00-4ccd-9217-2363e8bb2401 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:46.700493 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a92f64-7d00-4ccd-9217-2363e8bb2401 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:46.700831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a92f64-7d00-4ccd-9217-2363e8bb2401 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:46.701817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a92f64-7d00-4ccd-9217-2363e8bb2401 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:46.702122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a92f64-7d00-4ccd-9217-2363e8bb2401 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:46.703577 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a92f64-7d00-4ccd-9217-2363e8bb2401 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:46.721712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 484/977] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Jul 11 15:37:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:46.723765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7be41-4660-4296-aa2a-f6553756441c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:46.724732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7be41-4660-4296-aa2a-f6553756441c None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:46.725216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7be41-4660-4296-aa2a-f6553756441c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:46.725709 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7be41-4660-4296-aa2a-f6553756441c None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:46.726671 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7be41-4660-4296-aa2a-f6553756441c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:46.727043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7be41-4660-4296-aa2a-f6553756441c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:46.727347 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a92f64-7d00-4ccd-9217-2363e8bb2401 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:46.728614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7be41-4660-4296-aa2a-f6553756441c None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:46.729992 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:46.740320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 494/978] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Jul 11 15:37:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:46.741756 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7be41-4660-4296-aa2a-f6553756441c None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:46.841751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a92f64-7d00-4ccd-9217-2363e8bb2401 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:46.846186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7be41-4660-4296-aa2a-f6553756441c None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:46.878686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f4b69-e5d9-40e8-8036-255788d60d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:46.879351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f4b69-e5d9-40e8-8036-255788d60d0b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:46.879660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f4b69-e5d9-40e8-8036-255788d60d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:46.879893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f4b69-e5d9-40e8-8036-255788d60d0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:46.880309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5691c20-5bd2-440e-af4c-a09279a413a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:46.880995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5691c20-5bd2-440e-af4c-a09279a413a9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:46.881280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5691c20-5bd2-440e-af4c-a09279a413a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:46.881559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5691c20-5bd2-440e-af4c-a09279a413a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:46.882377 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5691c20-5bd2-440e-af4c-a09279a413a9 None admin] RBAC: Adding query filter params (interface=admin, service_id=a3df5ed114774c8bbeea08691db43353, region_id=RegionOne) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:46.882695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5691c20-5bd2-440e-af4c-a09279a413a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:46.884096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5691c20-5bd2-440e-af4c-a09279a413a9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:46.889770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 495/979] 10.222.0.26 () {56 vars in 1249 bytes} [Mon Jul 11 15:37:46 2022] GET /identity/v3/endpoints?service_id=a3df5ed114774c8bbeea08691db43353&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:46.895255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5691c20-5bd2-440e-af4c-a09279a413a9 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:46.904116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:46.957873 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f4b69-e5d9-40e8-8036-255788d60d0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:46.959730 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f4b69-e5d9-40e8-8036-255788d60d0b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:46.960800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:47.000834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5691c20-5bd2-440e-af4c-a09279a413a9 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:47.034072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e21edf-4d68-47db-8b8c-4b3e579d3f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:47.034745 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e21edf-4d68-47db-8b8c-4b3e579d3f5b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:47.035029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e21edf-4d68-47db-8b8c-4b3e579d3f5b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:47.035308 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e21edf-4d68-47db-8b8c-4b3e579d3f5b None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:47.036003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e21edf-4d68-47db-8b8c-4b3e579d3f5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:47.037420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e21edf-4d68-47db-8b8c-4b3e579d3f5b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:47.043466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 496/980] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Jul 11 15:37:46 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:37:47.044992 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659cecc-fb52-484b-9712-85c6ec33cf6e None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:47.045288 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659cecc-fb52-484b-9712-85c6ec33cf6e None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:47.045569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659cecc-fb52-484b-9712-85c6ec33cf6e None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:47.048456 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 497/981] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:47.052671 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e82500-ce31-42a4-8304-bac2d6f0293a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:47.052964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e82500-ce31-42a4-8304-bac2d6f0293a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:47.053242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e82500-ce31-42a4-8304-bac2d6f0293a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:47.072946 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 485/982] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:46 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:37:47.074816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-65e82500-ce31-42a4-8304-bac2d6f0293a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:47.075318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f4b69-e5d9-40e8-8036-255788d60d0b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:47.076504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-65e82500-ce31-42a4-8304-bac2d6f0293a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:47.131518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:47.156076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 498/983] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:47.179308 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e82500-ce31-42a4-8304-bac2d6f0293a None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:47.191048 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f4b69-e5d9-40e8-8036-255788d60d0b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:47.229741 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76585b-c400-4745-a018-202243128f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:47.230540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76585b-c400-4745-a018-202243128f17 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:47.230826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76585b-c400-4745-a018-202243128f17 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:47.231090 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76585b-c400-4745-a018-202243128f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:47.241824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76585b-c400-4745-a018-202243128f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:47.243299 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76585b-c400-4745-a018-202243128f17 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:47.246502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-bd76585b-c400-4745-a018-202243128f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:47.261603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:47.262537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:47.263503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:47.263503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:47.263503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:47.263503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:47.263503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 486/984] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:47.268725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76585b-c400-4745-a018-202243128f17 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:47.301009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e82500-ce31-42a4-8304-bac2d6f0293a None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:47.343965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6eec1-cda3-429f-a87a-a29c65339fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:47.344688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6eec1-cda3-429f-a87a-a29c65339fcf None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:47.344972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6eec1-cda3-429f-a87a-a29c65339fcf None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:47.345252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6eec1-cda3-429f-a87a-a29c65339fcf None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:47.345982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6eec1-cda3-429f-a87a-a29c65339fcf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:47.347393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6eec1-cda3-429f-a87a-a29c65339fcf None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:47.364224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 499/985] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Jul 11 15:37:47 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:37:47.375163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76585b-c400-4745-a018-202243128f17 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:47.377571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:47.423662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418320a4-a7b9-4e03-a10c-2a66b4fce42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:47.424754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418320a4-a7b9-4e03-a10c-2a66b4fce42a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:47.425283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418320a4-a7b9-4e03-a10c-2a66b4fce42a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:47.425758 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418320a4-a7b9-4e03-a10c-2a66b4fce42a None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:47.426753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418320a4-a7b9-4e03-a10c-2a66b4fce42a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:47.427281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418320a4-a7b9-4e03-a10c-2a66b4fce42a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:47.429012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418320a4-a7b9-4e03-a10c-2a66b4fce42a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:47.443739 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 487/986] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:47.449604 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6eec1-cda3-429f-a87a-a29c65339fcf None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:47.564576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6eec1-cda3-429f-a87a-a29c65339fcf None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:47.581752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:47.601789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b511b34-1dbf-4ec2-a719-496aa131b998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:47.602588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b511b34-1dbf-4ec2-a719-496aa131b998 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:47.602865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b511b34-1dbf-4ec2-a719-496aa131b998 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:47.603133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b511b34-1dbf-4ec2-a719-496aa131b998 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:47.610314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b511b34-1dbf-4ec2-a719-496aa131b998 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:47.611758 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b511b34-1dbf-4ec2-a719-496aa131b998 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-3b511b34-1dbf-4ec2-a719-496aa131b998 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:47.625622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:47.626502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:47.627429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:47.627429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:47.627429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:47.627429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:47.627429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:47.627429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:47.627429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:47.627429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:47.627429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 500/987] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:47.633629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418320a4-a7b9-4e03-a10c-2a66b4fce42a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:47.736593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418320a4-a7b9-4e03-a10c-2a66b4fce42a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:47.770429 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dc66a-9831-4439-a06f-b67c037343cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:47.771087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc66a-9831-4439-a06f-b67c037343cb None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:47.771364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc66a-9831-4439-a06f-b67c037343cb None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:47.771634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc66a-9831-4439-a06f-b67c037343cb None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:47.772454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dc66a-9831-4439-a06f-b67c037343cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:47.772762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dc66a-9831-4439-a06f-b67c037343cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:47.774189 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dc66a-9831-4439-a06f-b67c037343cb None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:47.786600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 488/988] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:47.792529 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b511b34-1dbf-4ec2-a719-496aa131b998 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:47.898053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b511b34-1dbf-4ec2-a719-496aa131b998 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:47.932039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac727dd8-19e5-41fb-aff3-be894db00279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:47.932730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac727dd8-19e5-41fb-aff3-be894db00279 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:47.933011 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac727dd8-19e5-41fb-aff3-be894db00279 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:47.933281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac727dd8-19e5-41fb-aff3-be894db00279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:47.934187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac727dd8-19e5-41fb-aff3-be894db00279 None admin] RBAC: Adding query filter params (role.id=c3aba0dfe1734a90bbf4770537e6c77c, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=8c910084851040cf817aa92ede9d0d97) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:47.934504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac727dd8-19e5-41fb-aff3-be894db00279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:47.936329 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac727dd8-19e5-41fb-aff3-be894db00279 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:47.948320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 501/989] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:47 2022] GET /identity/v3/role_assignments?user.id=8c910084851040cf817aa92ede9d0d97&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c3aba0dfe1734a90bbf4770537e6c77c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:49.048569 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf9ec0-2d3d-4563-972d-503cbf0b26ad None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:49.049133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf9ec0-2d3d-4563-972d-503cbf0b26ad None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:49.049133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf9ec0-2d3d-4563-972d-503cbf0b26ad None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:49.050749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 489/990] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:49.056500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dfcc7-1d4e-4107-aa52-bd9ac74e790f None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:49.057039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dfcc7-1d4e-4107-aa52-bd9ac74e790f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:49.057039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dfcc7-1d4e-4107-aa52-bd9ac74e790f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:49.074339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-4c9dfcc7-1d4e-4107-aa52-bd9ac74e790f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:49.075513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4c9dfcc7-1d4e-4107-aa52-bd9ac74e790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:49.112871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:49.147451 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 502/991] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:49.170665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf9ec0-2d3d-4563-972d-503cbf0b26ad None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:49.197838 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:49.288469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf9ec0-2d3d-4563-972d-503cbf0b26ad None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:49.324136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d3719-e2c7-4df8-9d87-f305dbd71914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:49.324911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d3719-e2c7-4df8-9d87-f305dbd71914 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:49.325172 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d3719-e2c7-4df8-9d87-f305dbd71914 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:49.325500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d3719-e2c7-4df8-9d87-f305dbd71914 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:49.326240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d3719-e2c7-4df8-9d87-f305dbd71914 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:49.327646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d3719-e2c7-4df8-9d87-f305dbd71914 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-a11d3719-e2c7-4df8-9d87-f305dbd71914 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:49.340917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:49.347549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:49.348438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 490/992] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Jul 11 15:37:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:49.350949 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dfcc7-1d4e-4107-aa52-bd9ac74e790f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:49.434737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead892-1f47-408c-ac7c-b4a2015adf75 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:49.435351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead892-1f47-408c-ac7c-b4a2015adf75 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:49.435593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead892-1f47-408c-ac7c-b4a2015adf75 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:49.437220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 491/993] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:37:49.441947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd3b4e-b531-42fc-8819-3f21a4b9c61f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:49.442227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd3b4e-b531-42fc-8819-3f21a4b9c61f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:49.442498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd3b4e-b531-42fc-8819-3f21a4b9c61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:49.460601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-b5bd3b4e-b531-42fc-8819-3f21a4b9c61f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:49.462119 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b5bd3b4e-b531-42fc-8819-3f21a4b9c61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:49.462692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dfcc7-1d4e-4107-aa52-bd9ac74e790f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:49.501588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9e20d-7a21-4500-8835-96f583ae281d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:49.502362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9e20d-7a21-4500-8835-96f583ae281d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:49.502564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9e20d-7a21-4500-8835-96f583ae281d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:49.502807 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9e20d-7a21-4500-8835-96f583ae281d None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:49.503517 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9e20d-7a21-4500-8835-96f583ae281d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:49.503822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9e20d-7a21-4500-8835-96f583ae281d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:49.505255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9e20d-7a21-4500-8835-96f583ae281d None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:49.510378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 503/994] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Jul 11 15:37:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:49.516479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9e20d-7a21-4500-8835-96f583ae281d None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:49.539603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 492/995] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:49.551199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:49.561644 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd3b4e-b531-42fc-8819-3f21a4b9c61f None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:49.578193 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:49.622665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9e20d-7a21-4500-8835-96f583ae281d None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:49.657271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf27719-5441-4ddd-ab29-b5123ef56c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:49.657938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf27719-5441-4ddd-ab29-b5123ef56c6f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:49.658223 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf27719-5441-4ddd-ab29-b5123ef56c6f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:49.658493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf27719-5441-4ddd-ab29-b5123ef56c6f None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:49.659199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf27719-5441-4ddd-ab29-b5123ef56c6f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:49.659494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf27719-5441-4ddd-ab29-b5123ef56c6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:49.660913 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf27719-5441-4ddd-ab29-b5123ef56c6f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:49.666739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 504/996] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Jul 11 15:37:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:49.667899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd3b4e-b531-42fc-8819-3f21a4b9c61f None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:49.672133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf27719-5441-4ddd-ab29-b5123ef56c6f None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:49.703776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474b10d-f33c-4178-bfc7-8fc4d79fd19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:49.704583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474b10d-f33c-4178-bfc7-8fc4d79fd19b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:49.704874 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474b10d-f33c-4178-bfc7-8fc4d79fd19b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:49.705155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474b10d-f33c-4178-bfc7-8fc4d79fd19b None admin] PATH_INFO: `/v3/services/compute` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:49.705819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474b10d-f33c-4178-bfc7-8fc4d79fd19b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:49.707193 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474b10d-f33c-4178-bfc7-8fc4d79fd19b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-6474b10d-f33c-4178-bfc7-8fc4d79fd19b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:49.719410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:49.720560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:49.721393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 493/997] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:49.726374 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474b10d-f33c-4178-bfc7-8fc4d79fd19b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:49.777514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:49.782337 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf27719-5441-4ddd-ab29-b5123ef56c6f None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:49.804084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:49.820365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c67f5-62f1-4850-99e0-8c14df5531f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:49.821048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c67f5-62f1-4850-99e0-8c14df5531f3 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:49.821354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c67f5-62f1-4850-99e0-8c14df5531f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:49.821603 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c67f5-62f1-4850-99e0-8c14df5531f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:49.822354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c67f5-62f1-4850-99e0-8c14df5531f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:49.823784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c67f5-62f1-4850-99e0-8c14df5531f3 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:49.831133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474b10d-f33c-4178-bfc7-8fc4d79fd19b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:49.840014 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 505/998] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Jul 11 15:37:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:37:49.884854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da565416-91c7-4f4c-8b05-75cede556aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:49.885539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565416-91c7-4f4c-8b05-75cede556aa1 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:49.885823 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565416-91c7-4f4c-8b05-75cede556aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:49.886095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565416-91c7-4f4c-8b05-75cede556aa1 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:49.886816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da565416-91c7-4f4c-8b05-75cede556aa1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:49.887123 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da565416-91c7-4f4c-8b05-75cede556aa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:49.888701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da565416-91c7-4f4c-8b05-75cede556aa1 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:49.895023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 494/999] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Jul 11 15:37:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:49.900911 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c67f5-62f1-4850-99e0-8c14df5531f3 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:49.979583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b896bd-0ff2-4f19-9e9c-106701372688 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:49.979929 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b896bd-0ff2-4f19-9e9c-106701372688 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:49.980148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b896bd-0ff2-4f19-9e9c-106701372688 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:49.982657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 495/1000] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:37:49.988274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ae7d8-01cc-404a-9c67-a7a9f3371def None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:49.988593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ae7d8-01cc-404a-9c67-a7a9f3371def None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:49.988854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ae7d8-01cc-404a-9c67-a7a9f3371def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:50.006595 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-bf3ae7d8-01cc-404a-9c67-a7a9f3371def None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:50.007782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-bf3ae7d8-01cc-404a-9c67-a7a9f3371def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:50.015917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c67f5-62f1-4850-99e0-8c14df5531f3 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:50.056134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f062b99-46f1-4a48-8e60-76aa69933e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:50.056918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f062b99-46f1-4a48-8e60-76aa69933e7e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:50.057481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f062b99-46f1-4a48-8e60-76aa69933e7e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:50.057481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f062b99-46f1-4a48-8e60-76aa69933e7e None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:50.058170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f062b99-46f1-4a48-8e60-76aa69933e7e None admin] RBAC: Adding query filter params (type=compute) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:50.058478 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f062b99-46f1-4a48-8e60-76aa69933e7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:50.059877 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f062b99-46f1-4a48-8e60-76aa69933e7e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:50.065433 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 506/1001] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Jul 11 15:37:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:50.071026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f062b99-46f1-4a48-8e60-76aa69933e7e None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:50.093639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 496/1002] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:49 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:50.097616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:50.115780 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ae7d8-01cc-404a-9c67-a7a9f3371def None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:50.179830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f062b99-46f1-4a48-8e60-76aa69933e7e None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:50.180481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:50.222845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ae7d8-01cc-404a-9c67-a7a9f3371def None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:50.236752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b5639-a352-4785-8f4a-bb77e824b413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:50.237411 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b5639-a352-4785-8f4a-bb77e824b413 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:50.237683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b5639-a352-4785-8f4a-bb77e824b413 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:50.237954 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b5639-a352-4785-8f4a-bb77e824b413 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:50.245469 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b5639-a352-4785-8f4a-bb77e824b413 None admin] RBAC: Adding query filter params (interface=public, service_id=0f462f039eb848d5a8856d0c4633103b, region_id=RegionOne) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:50.245807 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b5639-a352-4785-8f4a-bb77e824b413 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:50.247220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b5639-a352-4785-8f4a-bb77e824b413 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:50.253769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 507/1003] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Jul 11 15:37:50 2022] GET /identity/v3/endpoints?service_id=0f462f039eb848d5a8856d0c4633103b&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:50.258989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b5639-a352-4785-8f4a-bb77e824b413 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:50.259906 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e197a-4753-43a0-8b48-caa123dbddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:50.260734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e197a-4753-43a0-8b48-caa123dbddcb None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:50.261020 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e197a-4753-43a0-8b48-caa123dbddcb None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:50.261294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e197a-4753-43a0-8b48-caa123dbddcb None admin] PATH_INFO: `/v3/services/image` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:50.261958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e197a-4753-43a0-8b48-caa123dbddcb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:50.263822 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e197a-4753-43a0-8b48-caa123dbddcb None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-d31e197a-4753-43a0-8b48-caa123dbddcb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:50.275444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:50.276502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:50.277328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 497/1004] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Jul 11 15:37:50 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:50.282457 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e197a-4753-43a0-8b48-caa123dbddcb None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:50.355761 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:50.371957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b5639-a352-4785-8f4a-bb77e824b413 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:50.386291 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e197a-4753-43a0-8b48-caa123dbddcb None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:50.407480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcb760-3f2e-4932-826a-11e889d46856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:50.408166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb760-3f2e-4932-826a-11e889d46856 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:50.408482 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb760-3f2e-4932-826a-11e889d46856 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:50.408763 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb760-3f2e-4932-826a-11e889d46856 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:50.409460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcb760-3f2e-4932-826a-11e889d46856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:50.410843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcb760-3f2e-4932-826a-11e889d46856 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:50.415745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:50.418409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 508/1005] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Jul 11 15:37:50 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:37:50.422868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2382ef2-7a1d-4862-85e3-5a0d0581b40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:50.423564 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2382ef2-7a1d-4862-85e3-5a0d0581b40e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:50.423852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2382ef2-7a1d-4862-85e3-5a0d0581b40e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:50.424128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2382ef2-7a1d-4862-85e3-5a0d0581b40e None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:50.424894 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2382ef2-7a1d-4862-85e3-5a0d0581b40e None admin] RBAC: Adding query filter params (name=image) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:50.425206 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2382ef2-7a1d-4862-85e3-5a0d0581b40e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:50.426624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2382ef2-7a1d-4862-85e3-5a0d0581b40e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:50.432590 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 498/1006] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:50.438334 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcb760-3f2e-4932-826a-11e889d46856 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:50.563605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcb760-3f2e-4932-826a-11e889d46856 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:50.603005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec7b1c-50d8-4d97-b267-539094798bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:50.603692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec7b1c-50d8-4d97-b267-539094798bd3 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:50.603979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec7b1c-50d8-4d97-b267-539094798bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:50.604252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec7b1c-50d8-4d97-b267-539094798bd3 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:50.605019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec7b1c-50d8-4d97-b267-539094798bd3 None admin] RBAC: Adding query filter params (type=image) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:50.605329 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec7b1c-50d8-4d97-b267-539094798bd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:50.606903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec7b1c-50d8-4d97-b267-539094798bd3 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:50.612194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 509/1007] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:51.891241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f561152-b56b-420d-a6f4-45eb27a4eae8 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:51.891789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f561152-b56b-420d-a6f4-45eb27a4eae8 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:51.891789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f561152-b56b-420d-a6f4-45eb27a4eae8 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:51.893370 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 499/1008] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:51.898545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188be5c-c581-4ad4-818e-6a30094210d6 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:51.898952 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188be5c-c581-4ad4-818e-6a30094210d6 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:51.899138 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188be5c-c581-4ad4-818e-6a30094210d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:51.916335 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-1188be5c-c581-4ad4-818e-6a30094210d6 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:51.917532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1188be5c-c581-4ad4-818e-6a30094210d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:51.928023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:51.991674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 510/1009] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:52.015367 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f561152-b56b-420d-a6f4-45eb27a4eae8 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:52.120702 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f561152-b56b-420d-a6f4-45eb27a4eae8 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:52.156618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c19ca-5df8-4235-aebf-b17f9635ec5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:52.157339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c19ca-5df8-4235-aebf-b17f9635ec5e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:52.157623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c19ca-5df8-4235-aebf-b17f9635ec5e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:52.157905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c19ca-5df8-4235-aebf-b17f9635ec5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:52.159097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c19ca-5df8-4235-aebf-b17f9635ec5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:52.160574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c19ca-5df8-4235-aebf-b17f9635ec5e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:52.162376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 500/1010] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:52.168194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188be5c-c581-4ad4-818e-6a30094210d6 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:52.278675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188be5c-c581-4ad4-818e-6a30094210d6 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:52.315722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c9121-319c-4d35-910e-9efb13a67322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:52.316425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c9121-319c-4d35-910e-9efb13a67322 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:52.316704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c9121-319c-4d35-910e-9efb13a67322 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:52.316978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c9121-319c-4d35-910e-9efb13a67322 None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:52.317713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c9121-319c-4d35-910e-9efb13a67322 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:52.319167 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c9121-319c-4d35-910e-9efb13a67322 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:52.334273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:52.349704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 511/1011] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Jul 11 15:37:52 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:37:52.465076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558db5c-49eb-40a7-8a98-c1083e886e49 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:52.465257 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558db5c-49eb-40a7-8a98-c1083e886e49 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:52.465532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558db5c-49eb-40a7-8a98-c1083e886e49 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:52.467324 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 501/1012] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:52.473291 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317dfbb-1cc9-4dc9-8a09-dba2bcf12640 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:52.473654 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317dfbb-1cc9-4dc9-8a09-dba2bcf12640 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:52.473822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317dfbb-1cc9-4dc9-8a09-dba2bcf12640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:52.492136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-1317dfbb-1cc9-4dc9-8a09-dba2bcf12640 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:52.493350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1317dfbb-1cc9-4dc9-8a09-dba2bcf12640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:52.567824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 512/1013] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:52.591590 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558db5c-49eb-40a7-8a98-c1083e886e49 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:52.622141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd9bb8-b3e6-40b9-a294-159bea3f8d04 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:52.622527 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd9bb8-b3e6-40b9-a294-159bea3f8d04 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:52.622815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd9bb8-b3e6-40b9-a294-159bea3f8d04 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:52.624498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 513/1014] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:37:52.629655 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1effa-cefe-45e1-af1a-7a47b6f951c5 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:52.629945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1effa-cefe-45e1-af1a-7a47b6f951c5 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:52.630230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1effa-cefe-45e1-af1a-7a47b6f951c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:52.648430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-b2d1effa-cefe-45e1-af1a-7a47b6f951c5 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:52.649958 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b2d1effa-cefe-45e1-af1a-7a47b6f951c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:52.656875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:52.700740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558db5c-49eb-40a7-8a98-c1083e886e49 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:52.728703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 514/1015] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:52.741091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fc683-c3c2-451e-88b8-465efee690e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:52.741982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fc683-c3c2-451e-88b8-465efee690e5 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:52.742341 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fc683-c3c2-451e-88b8-465efee690e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:52.742705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fc683-c3c2-451e-88b8-465efee690e5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:52.743442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fc683-c3c2-451e-88b8-465efee690e5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:52.744940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fc683-c3c2-451e-88b8-465efee690e5 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:52.751046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1effa-cefe-45e1-af1a-7a47b6f951c5 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-6a5fc683-c3c2-451e-88b8-465efee690e5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:52.757920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:52.758944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:52.759879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:52.759879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:52.759879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:52.759879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:52.759879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:52.759879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:52.759879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:52.759879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:52.759879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:52.759879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:52.759879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:52.759879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:52.759879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 15:37:52.759879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:52.764419 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 502/1016] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:52.765215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fc683-c3c2-451e-88b8-465efee690e5 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:52.813557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:52.862847 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1effa-cefe-45e1-af1a-7a47b6f951c5 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:52.872947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fc683-c3c2-451e-88b8-465efee690e5 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:52.897034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148fe0d-d372-4f26-be83-817bef65aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:52.897710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148fe0d-d372-4f26-be83-817bef65aea3 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:52.897995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148fe0d-d372-4f26-be83-817bef65aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:52.898270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148fe0d-d372-4f26-be83-817bef65aea3 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:52.899022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148fe0d-d372-4f26-be83-817bef65aea3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:52.900422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148fe0d-d372-4f26-be83-817bef65aea3 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:52.905247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:52.916489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57c56d-0c8b-4be8-a08c-2b51c26fe0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:52.917247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57c56d-0c8b-4be8-a08c-2b51c26fe0af None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:52.917533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57c56d-0c8b-4be8-a08c-2b51c26fe0af None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:52.917811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57c56d-0c8b-4be8-a08c-2b51c26fe0af None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:52.918530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57c56d-0c8b-4be8-a08c-2b51c26fe0af None admin] RBAC: Adding query filter params (name=compute) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:52.918843 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57c56d-0c8b-4be8-a08c-2b51c26fe0af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:52.920336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57c56d-0c8b-4be8-a08c-2b51c26fe0af None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:52.925967 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 515/1017] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Jul 11 15:37:52 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:37:52.926154 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 503/1018] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Jul 11 15:37:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:52.931862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148fe0d-d372-4f26-be83-817bef65aea3 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:53.053512 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148fe0d-d372-4f26-be83-817bef65aea3 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:53.068281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:53.096807 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfeea4-3a4d-4a88-8a57-9928d4c5960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:53.097466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfeea4-3a4d-4a88-8a57-9928d4c5960a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:53.097749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfeea4-3a4d-4a88-8a57-9928d4c5960a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:53.098023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfeea4-3a4d-4a88-8a57-9928d4c5960a None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:53.098759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfeea4-3a4d-4a88-8a57-9928d4c5960a None admin] RBAC: Adding query filter params (type=compute) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:53.099050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfeea4-3a4d-4a88-8a57-9928d4c5960a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:53.100471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfeea4-3a4d-4a88-8a57-9928d4c5960a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:53.105760 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 516/1019] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Jul 11 15:37:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:53.111558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57c56d-0c8b-4be8-a08c-2b51c26fe0af None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:53.218834 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57c56d-0c8b-4be8-a08c-2b51c26fe0af None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:53.252458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a238b-7430-41b0-9359-b3534c1b366a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:53.253117 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a238b-7430-41b0-9359-b3534c1b366a None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:53.253478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a238b-7430-41b0-9359-b3534c1b366a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:53.253750 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a238b-7430-41b0-9359-b3534c1b366a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:53.254548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a238b-7430-41b0-9359-b3534c1b366a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:53.255910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a238b-7430-41b0-9359-b3534c1b366a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:53.275908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 504/1020] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Jul 11 15:37:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:37:54.468257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f402f-40ca-4f98-a5c6-361b023a13d6 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:54.468810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f402f-40ca-4f98-a5c6-361b023a13d6 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:54.468810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f402f-40ca-4f98-a5c6-361b023a13d6 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:54.470398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 517/1021] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:54.476071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498201e8-bd74-41d5-9a60-5fb22179e2a0 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:54.476635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498201e8-bd74-41d5-9a60-5fb22179e2a0 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:54.476635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498201e8-bd74-41d5-9a60-5fb22179e2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:54.494225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-498201e8-bd74-41d5-9a60-5fb22179e2a0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:54.495418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-498201e8-bd74-41d5-9a60-5fb22179e2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:54.542464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:54.576996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 505/1022] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:54.601932 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f402f-40ca-4f98-a5c6-361b023a13d6 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:54.711895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f402f-40ca-4f98-a5c6-361b023a13d6 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:54.747747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c53da-b8a4-4c86-9a59-78c8c88a829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:54.748568 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c53da-b8a4-4c86-9a59-78c8c88a829e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:54.748856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c53da-b8a4-4c86-9a59-78c8c88a829e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:54.749132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c53da-b8a4-4c86-9a59-78c8c88a829e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:54.750390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c53da-b8a4-4c86-9a59-78c8c88a829e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:54.751846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c53da-b8a4-4c86-9a59-78c8c88a829e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:54.758124 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 518/1023] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:54.759445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498201e8-bd74-41d5-9a60-5fb22179e2a0 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:54.867410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498201e8-bd74-41d5-9a60-5fb22179e2a0 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:54.903999 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62eb954-0e77-4d12-896e-b2a77537cf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:54.904387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eb954-0e77-4d12-896e-b2a77537cf4a None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:54.904593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eb954-0e77-4d12-896e-b2a77537cf4a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:54.904864 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eb954-0e77-4d12-896e-b2a77537cf4a None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:54.905606 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62eb954-0e77-4d12-896e-b2a77537cf4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:54.907259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62eb954-0e77-4d12-896e-b2a77537cf4a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:54.930040 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 506/1024] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:37:54 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:37:55.016169 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd71cf6-61e4-4cda-a20b-a01b02ace914 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:55.016408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd71cf6-61e4-4cda-a20b-a01b02ace914 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:55.016742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd71cf6-61e4-4cda-a20b-a01b02ace914 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:55.018185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 519/1025] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:55.024148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da40c32-fbc7-44b4-bcbf-960a0df17765 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:55.024496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da40c32-fbc7-44b4-bcbf-960a0df17765 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:55.024709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da40c32-fbc7-44b4-bcbf-960a0df17765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:55.042892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-2da40c32-fbc7-44b4-bcbf-960a0df17765 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:55.044135 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2da40c32-fbc7-44b4-bcbf-960a0df17765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:55.071822 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:55.132396 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 507/1026] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:55.148661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd71cf6-61e4-4cda-a20b-a01b02ace914 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:55.202330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:55.259610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd71cf6-61e4-4cda-a20b-a01b02ace914 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:55.295355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e3140-d13a-4cb9-a411-ee5c8d6ef697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:55.296151 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3140-d13a-4cb9-a411-ee5c8d6ef697 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:55.296468 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3140-d13a-4cb9-a411-ee5c8d6ef697 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:55.296742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3140-d13a-4cb9-a411-ee5c8d6ef697 None admin] PATH_INFO: `/v3/services/image` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:55.297401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e3140-d13a-4cb9-a411-ee5c8d6ef697 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:55.298772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e3140-d13a-4cb9-a411-ee5c8d6ef697 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-fc2e3140-d13a-4cb9-a411-ee5c8d6ef697 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:55.310974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:55.312050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:55.318127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 520/1027] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Jul 11 15:37:55 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:55.320668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da40c32-fbc7-44b4-bcbf-960a0df17765 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:55.384083 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8b467-9704-4694-b4f5-a6446e958b0e None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:55.384494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8b467-9704-4694-b4f5-a6446e958b0e None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:55.384717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8b467-9704-4694-b4f5-a6446e958b0e None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:55.386125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 521/1028] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:37:55.390837 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cffbc5-006a-47b7-82af-ca1765759e87 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:55.391118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cffbc5-006a-47b7-82af-ca1765759e87 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:55.391390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cffbc5-006a-47b7-82af-ca1765759e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:55.408153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-76cffbc5-006a-47b7-82af-ca1765759e87 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:55.409371 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-76cffbc5-006a-47b7-82af-ca1765759e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:55.430273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da40c32-fbc7-44b4-bcbf-960a0df17765 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:55.467355 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fc598-a21a-4fd8-b18b-200a068637c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:55.468026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fc598-a21a-4fd8-b18b-200a068637c6 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:55.468326 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fc598-a21a-4fd8-b18b-200a068637c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:55.470196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fc598-a21a-4fd8-b18b-200a068637c6 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:55.470196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fc598-a21a-4fd8-b18b-200a068637c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:55.470196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fc598-a21a-4fd8-b18b-200a068637c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:55.470979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fc598-a21a-4fd8-b18b-200a068637c6 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:55.481244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 508/1029] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:55.481903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 522/1030] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:55.483761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fc598-a21a-4fd8-b18b-200a068637c6 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:55.504061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cffbc5-006a-47b7-82af-ca1765759e87 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:55.516915 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:55.552688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:55.608049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fc598-a21a-4fd8-b18b-200a068637c6 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:55.617958 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cffbc5-006a-47b7-82af-ca1765759e87 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:55.644869 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205c676-8759-4d8e-a651-35420c0aabd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:55.645546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205c676-8759-4d8e-a651-35420c0aabd6 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:55.645830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205c676-8759-4d8e-a651-35420c0aabd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:55.646320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205c676-8759-4d8e-a651-35420c0aabd6 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:55.646823 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205c676-8759-4d8e-a651-35420c0aabd6 None admin] RBAC: Adding query filter params (type=image) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:55.647130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205c676-8759-4d8e-a651-35420c0aabd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:55.648583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205c676-8759-4d8e-a651-35420c0aabd6 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:55.658703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 509/1031] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:55.659711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472528c-455d-47fc-bd8f-3cced121ecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:55.659839 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205c676-8759-4d8e-a651-35420c0aabd6 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:55.660574 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472528c-455d-47fc-bd8f-3cced121ecac None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:55.660852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472528c-455d-47fc-bd8f-3cced121ecac None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:55.661124 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472528c-455d-47fc-bd8f-3cced121ecac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:55.675018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472528c-455d-47fc-bd8f-3cced121ecac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-e472528c-455d-47fc-bd8f-3cced121ecac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:55.683174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:55.684132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:55.685059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:55.685059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:55.685059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:55.685059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:55.685059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:55.685059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:55.685059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:55.685059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:55.685059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:55.685059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:55.685059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:37:55.685059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:55.685059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 523/1032] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Jul 11 15:37:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:55.690414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472528c-455d-47fc-bd8f-3cced121ecac None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:55.754169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:55.770301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205c676-8759-4d8e-a651-35420c0aabd6 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:55.792136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:55.795930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472528c-455d-47fc-bd8f-3cced121ecac None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:55.809525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42276b-284f-49d2-b62e-4d7702c116af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:55.810270 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42276b-284f-49d2-b62e-4d7702c116af None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:55.810555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42276b-284f-49d2-b62e-4d7702c116af None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:55.811033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42276b-284f-49d2-b62e-4d7702c116af None admin] PATH_INFO: `/v3/endpoints` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:55.811624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42276b-284f-49d2-b62e-4d7702c116af None admin] RBAC: Adding query filter params (interface=public, service_id=18caeb8053444f8092d4817b3b0ff32b, region_id=RegionOne) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:55.811936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42276b-284f-49d2-b62e-4d7702c116af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:55.813354 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42276b-284f-49d2-b62e-4d7702c116af None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:55.822871 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 510/1033] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Jul 11 15:37:55 2022] GET /identity/v3/endpoints?service_id=18caeb8053444f8092d4817b3b0ff32b&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:55.824095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42276b-284f-49d2-b62e-4d7702c116af None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:55.837396 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e5859-6e52-4a3c-bac0-68358c8cd149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:55.838228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e5859-6e52-4a3c-bac0-68358c8cd149 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:55.838589 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e5859-6e52-4a3c-bac0-68358c8cd149 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:55.838927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e5859-6e52-4a3c-bac0-68358c8cd149 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:55.839755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e5859-6e52-4a3c-bac0-68358c8cd149 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:55.840422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e5859-6e52-4a3c-bac0-68358c8cd149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:55.841511 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e5859-6e52-4a3c-bac0-68358c8cd149 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:55.849919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 524/1034] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Jul 11 15:37:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:55.855454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e5859-6e52-4a3c-bac0-68358c8cd149 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:55.927227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42276b-284f-49d2-b62e-4d7702c116af None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:55.956830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e5859-6e52-4a3c-bac0-68358c8cd149 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:55.963450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08add58f-800c-4ed1-b060-67c1ffb9af86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:55.964123 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08add58f-800c-4ed1-b060-67c1ffb9af86 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:55.964579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08add58f-800c-4ed1-b060-67c1ffb9af86 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:55.964825 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08add58f-800c-4ed1-b060-67c1ffb9af86 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:55.965512 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08add58f-800c-4ed1-b060-67c1ffb9af86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:55.967138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08add58f-800c-4ed1-b060-67c1ffb9af86 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:55.974630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 511/1035] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Jul 11 15:37:55 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:37:56.006171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c48cf-8fda-409f-b236-3c9c4e367f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:56.007450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c48cf-8fda-409f-b236-3c9c4e367f95 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:56.007924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c48cf-8fda-409f-b236-3c9c4e367f95 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:56.008430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c48cf-8fda-409f-b236-3c9c4e367f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:56.021106 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c48cf-8fda-409f-b236-3c9c4e367f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:56.022904 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c48cf-8fda-409f-b236-3c9c4e367f95 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-b52c48cf-8fda-409f-b236-3c9c4e367f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:56.042439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:56.043408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:56.044688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:56.044688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:56.044688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:56.044688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:56.046447 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 525/1036] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:56.052242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08add58f-800c-4ed1-b060-67c1ffb9af86 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:56.070722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:56.173426 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08add58f-800c-4ed1-b060-67c1ffb9af86 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:56.217138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed99d03-1a45-409e-bb0c-050aea532b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:56.217807 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed99d03-1a45-409e-bb0c-050aea532b67 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:56.218084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed99d03-1a45-409e-bb0c-050aea532b67 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:56.218352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed99d03-1a45-409e-bb0c-050aea532b67 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:56.219081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed99d03-1a45-409e-bb0c-050aea532b67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:56.219378 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed99d03-1a45-409e-bb0c-050aea532b67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:56.220923 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed99d03-1a45-409e-bb0c-050aea532b67 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:56.237327 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 512/1037] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:56.238653 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c48cf-8fda-409f-b236-3c9c4e367f95 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:56.254676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:56.351162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c48cf-8fda-409f-b236-3c9c4e367f95 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:56.384973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ad3ea-e63f-4f06-b15d-d4d8475b56a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:56.385770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ad3ea-e63f-4f06-b15d-d4d8475b56a9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:56.386052 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ad3ea-e63f-4f06-b15d-d4d8475b56a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:56.386327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ad3ea-e63f-4f06-b15d-d4d8475b56a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:56.398181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ad3ea-e63f-4f06-b15d-d4d8475b56a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:56.399676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ad3ea-e63f-4f06-b15d-d4d8475b56a9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-ef2ad3ea-e63f-4f06-b15d-d4d8475b56a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:37:56.414231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:56.415257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:56.416230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:56.416230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:56.416230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:37:56.416230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:37:56.416230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:37:56.416230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:37:56.416230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:37:56.416230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:37:56.416230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:37:56.416230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:56.417645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 526/1038] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Jul 11 15:37:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:56.421616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed99d03-1a45-409e-bb0c-050aea532b67 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:56.547472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:56.575671 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed99d03-1a45-409e-bb0c-050aea532b67 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:56.610200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f87a81-0563-49f4-b636-e9906cad616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:56.610797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f87a81-0563-49f4-b636-e9906cad616d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:56.611076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f87a81-0563-49f4-b636-e9906cad616d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:56.611348 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f87a81-0563-49f4-b636-e9906cad616d None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:56.612205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f87a81-0563-49f4-b636-e9906cad616d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:56.612541 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f87a81-0563-49f4-b636-e9906cad616d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:56.613984 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f87a81-0563-49f4-b636-e9906cad616d None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:56.632146 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 513/1039] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Jul 11 15:37:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:56.637948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ad3ea-e63f-4f06-b15d-d4d8475b56a9 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:56.710995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:56.747705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ad3ea-e63f-4f06-b15d-d4d8475b56a9 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:56.784413 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318bb4c-4e50-4a07-9a62-bfda5327caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:56.785067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318bb4c-4e50-4a07-9a62-bfda5327caa7 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:56.785352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318bb4c-4e50-4a07-9a62-bfda5327caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:56.785630 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318bb4c-4e50-4a07-9a62-bfda5327caa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:56.856133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318bb4c-4e50-4a07-9a62-bfda5327caa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:56.857683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318bb4c-4e50-4a07-9a62-bfda5327caa7 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:56.924741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:56.962228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 527/1040] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:37:56.964411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f87a81-0563-49f4-b636-e9906cad616d None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:57.057404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dd8d1-de96-4a40-9d13-3a93adf1de3a None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:57.057806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dd8d1-de96-4a40-9d13-3a93adf1de3a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:57.058149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dd8d1-de96-4a40-9d13-3a93adf1de3a None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:57.060324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 528/1041] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:57.065566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae81cd4-2628-4090-ae53-7d8c1097a9d1 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:57.065854 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae81cd4-2628-4090-ae53-7d8c1097a9d1 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:57.066131 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae81cd4-2628-4090-ae53-7d8c1097a9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:57.082524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f87a81-0563-49f4-b636-e9906cad616d None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:57.085560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-1ae81cd4-2628-4090-ae53-7d8c1097a9d1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:57.087153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1ae81cd4-2628-4090-ae53-7d8c1097a9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:57.117095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:57.123865 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18740a3-d352-486e-b781-b4d4d584c54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:57.124712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18740a3-d352-486e-b781-b4d4d584c54c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:57.124996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18740a3-d352-486e-b781-b4d4d584c54c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:57.125268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18740a3-d352-486e-b781-b4d4d584c54c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:57.137089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18740a3-d352-486e-b781-b4d4d584c54c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:57.138608 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18740a3-d352-486e-b781-b4d4d584c54c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-d18740a3-d352-486e-b781-b4d4d584c54c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:37:57.156578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:57.157508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:57.158424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:37:57.158424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:37:57.158424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:37:57.158424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:57.158424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 514/1042] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:57.163296 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18740a3-d352-486e-b781-b4d4d584c54c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:57.163550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 529/1043] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:57.188645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae81cd4-2628-4090-ae53-7d8c1097a9d1 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:57.277407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18740a3-d352-486e-b781-b4d4d584c54c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:57.291865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae81cd4-2628-4090-ae53-7d8c1097a9d1 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:57.293419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:57.318202 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8a12d-7913-48b9-b32d-87a2f10b4a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:57.318872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8a12d-7913-48b9-b32d-87a2f10b4a23 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:57.319156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8a12d-7913-48b9-b32d-87a2f10b4a23 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:57.319435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8a12d-7913-48b9-b32d-87a2f10b4a23 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:57.320176 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8a12d-7913-48b9-b32d-87a2f10b4a23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:57.320513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8a12d-7913-48b9-b32d-87a2f10b4a23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:57.321907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8a12d-7913-48b9-b32d-87a2f10b4a23 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:57.330374 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9229ea8-aa11-4e64-a260-4570613fa5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:57.331368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9229ea8-aa11-4e64-a260-4570613fa5d4 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:57.331809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9229ea8-aa11-4e64-a260-4570613fa5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:57.332227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9229ea8-aa11-4e64-a260-4570613fa5d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:57.333077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 515/1044] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:57.338834 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8a12d-7913-48b9-b32d-87a2f10b4a23 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:57.350376 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9229ea8-aa11-4e64-a260-4570613fa5d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-f9229ea8-aa11-4e64-a260-4570613fa5d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:37:57.358608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:57.359533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:57.365283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:57.365283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:57.365283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:57.365283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:57.365283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:37:57.365283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:37:57.365283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:37:57.365283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:37:57.365283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:37:57.365283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:37:57.365283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:37:57.365283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:37:57.365283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 530/1045] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:37:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:57.365998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9229ea8-aa11-4e64-a260-4570613fa5d4 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:57.385471 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:57.443514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8a12d-7913-48b9-b32d-87a2f10b4a23 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:57.474319 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9229ea8-aa11-4e64-a260-4570613fa5d4 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:57.481070 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385d67c-37dc-4ea2-bb3c-b6cf3dd67cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:57.482568 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385d67c-37dc-4ea2-bb3c-b6cf3dd67cc6 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:57.483070 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385d67c-37dc-4ea2-bb3c-b6cf3dd67cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:57.483841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385d67c-37dc-4ea2-bb3c-b6cf3dd67cc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:57.492015 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385d67c-37dc-4ea2-bb3c-b6cf3dd67cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:57.493753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385d67c-37dc-4ea2-bb3c-b6cf3dd67cc6 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:57.508918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb88467-3df7-4334-a63e-d0ea3a6c4fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:57.509585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb88467-3df7-4334-a63e-d0ea3a6c4fc1 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:57.509951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb88467-3df7-4334-a63e-d0ea3a6c4fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:57.510227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb88467-3df7-4334-a63e-d0ea3a6c4fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-f385d67c-37dc-4ea2-bb3c-b6cf3dd67cc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:37:57.510663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:57.511531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:57.512445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:37:57.512445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:37:57.512445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:37:57.512445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:37:57.512445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:37:57.512445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:37:57.512445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:37:57.512445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:57.512918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb88467-3df7-4334-a63e-d0ea3a6c4fc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:57.512918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb88467-3df7-4334-a63e-d0ea3a6c4fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:57.512918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb88467-3df7-4334-a63e-d0ea3a6c4fc1 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:57.514845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 516/1046] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:37:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:37:57.520409 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385d67c-37dc-4ea2-bb3c-b6cf3dd67cc6 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:57.528964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 531/1047] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:37:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:57.534711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb88467-3df7-4334-a63e-d0ea3a6c4fc1 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:57.563782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:57.632871 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385d67c-37dc-4ea2-bb3c-b6cf3dd67cc6 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:57.636124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:57.652246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb88467-3df7-4334-a63e-d0ea3a6c4fc1 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:57.671489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d815452-c747-4604-b3f3-dd14e1e195d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:57.672159 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d815452-c747-4604-b3f3-dd14e1e195d9 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:57.672472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d815452-c747-4604-b3f3-dd14e1e195d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:57.672750 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d815452-c747-4604-b3f3-dd14e1e195d9 None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:57.673545 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d815452-c747-4604-b3f3-dd14e1e195d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:57.673853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d815452-c747-4604-b3f3-dd14e1e195d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:57.675285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d815452-c747-4604-b3f3-dd14e1e195d9 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:57.687540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 517/1048] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:37:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:57.688548 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78243482-c423-4679-a88c-3f09e8810bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:57.689430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78243482-c423-4679-a88c-3f09e8810bf5 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:57.689707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78243482-c423-4679-a88c-3f09e8810bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:57.690147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78243482-c423-4679-a88c-3f09e8810bf5 None admin] PATH_INFO: `/v3/users/5ab6ac59e3e4436c997ab7af626fa688` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:57.694370 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d815452-c747-4604-b3f3-dd14e1e195d9 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:57.704172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78243482-c423-4679-a88c-3f09e8810bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=5ab6ac59e3e4436c997ab7af626fa688)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:57.705692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78243482-c423-4679-a88c-3f09e8810bf5 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:57.712152 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 532/1049] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:37:57 2022] GET /identity/v3/users/5ab6ac59e3e4436c997ab7af626fa688 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:57.713766 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78243482-c423-4679-a88c-3f09e8810bf5 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:57.793723 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:57.806164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d815452-c747-4604-b3f3-dd14e1e195d9 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:57.815346 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78243482-c423-4679-a88c-3f09e8810bf5 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:57.843246 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad2160-2c88-42ea-813b-cb8cdfe4130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:57.843919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad2160-2c88-42ea-813b-cb8cdfe4130f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:57.844202 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad2160-2c88-42ea-813b-cb8cdfe4130f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:57.844507 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad2160-2c88-42ea-813b-cb8cdfe4130f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:57.845348 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad2160-2c88-42ea-813b-cb8cdfe4130f None admin] RBAC: Adding query filter params (role.id=c3aba0dfe1734a90bbf4770537e6c77c, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=fa038a2e30f544aaa609d32e0e1ceaa0) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:57.845665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad2160-2c88-42ea-813b-cb8cdfe4130f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:57.847108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad2160-2c88-42ea-813b-cb8cdfe4130f None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:57.851421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89304c2-5a7d-44c6-b6f7-98582fe61373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:57.852084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89304c2-5a7d-44c6-b6f7-98582fe61373 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:57.852394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89304c2-5a7d-44c6-b6f7-98582fe61373 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:57.852676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89304c2-5a7d-44c6-b6f7-98582fe61373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:57.854071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 518/1050] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:57 2022] GET /identity/v3/role_assignments?user.id=fa038a2e30f544aaa609d32e0e1ceaa0&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c3aba0dfe1734a90bbf4770537e6c77c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:57.946426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89304c2-5a7d-44c6-b6f7-98582fe61373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:57.947863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89304c2-5a7d-44c6-b6f7-98582fe61373 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:57.989366 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91d1d6-820b-4e09-bb8b-7eafe618a37f None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:57.989711 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91d1d6-820b-4e09-bb8b-7eafe618a37f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:57.989932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91d1d6-820b-4e09-bb8b-7eafe618a37f None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:57.991357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 519/1051] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:57.996962 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5354c-ba31-439a-8768-875e76680b42 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:57.997751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5354c-ba31-439a-8768-875e76680b42 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:57.998293 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5354c-ba31-439a-8768-875e76680b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:58.016170 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-c5b5354c-ba31-439a-8768-875e76680b42 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:58.018214 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-c5b5354c-ba31-439a-8768-875e76680b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:58.039164 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:58.047034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:58.060136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 533/1052] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:37:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 15:37:58.066602 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89304c2-5a7d-44c6-b6f7-98582fe61373 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:58.098514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 520/1053] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:37:58.121153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5354c-ba31-439a-8768-875e76680b42 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:58.171219 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89304c2-5a7d-44c6-b6f7-98582fe61373 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:58.210614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d1443-7e09-4078-92ce-62d82fa9f7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:58.211734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d1443-7e09-4078-92ce-62d82fa9f7d2 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:58.212017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d1443-7e09-4078-92ce-62d82fa9f7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:58.212301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d1443-7e09-4078-92ce-62d82fa9f7d2 None admin] PATH_INFO: `/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:58.213504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d1443-7e09-4078-92ce-62d82fa9f7d2 None admin] RBAC: Authorizing `identity:get_project(project_id=8cbe3d6edf8d42188dd5a3c1c2cadb2c)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:58.214951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d1443-7e09-4078-92ce-62d82fa9f7d2 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:58.217061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 534/1054] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:37:58 2022] GET /identity/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:58.223134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d1443-7e09-4078-92ce-62d82fa9f7d2 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:58.233843 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5354c-ba31-439a-8768-875e76680b42 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:58.269523 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da847f53-2bab-425d-b47a-713e0bd27d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:58.270318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da847f53-2bab-425d-b47a-713e0bd27d09 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:58.270596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da847f53-2bab-425d-b47a-713e0bd27d09 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:58.270867 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da847f53-2bab-425d-b47a-713e0bd27d09 None admin] PATH_INFO: `/v3/services/image` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:58.271526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da847f53-2bab-425d-b47a-713e0bd27d09 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:58.272943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da847f53-2bab-425d-b47a-713e0bd27d09 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:58.278214 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-da847f53-2bab-425d-b47a-713e0bd27d09 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:37:58.284837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:37:58.285881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:37:58.287391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 521/1055] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Jul 11 15:37:58 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:37:58.291939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da847f53-2bab-425d-b47a-713e0bd27d09 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:58.322187 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:58.335849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d1443-7e09-4078-92ce-62d82fa9f7d2 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:58.373269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fda33-8f43-453c-aec3-5ff4074186f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:58.373913 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fda33-8f43-453c-aec3-5ff4074186f0 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:58.374193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fda33-8f43-453c-aec3-5ff4074186f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:58.374469 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fda33-8f43-453c-aec3-5ff4074186f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:58.375312 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fda33-8f43-453c-aec3-5ff4074186f0 None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=8cbe3d6edf8d42188dd5a3c1c2cadb2c, user.id=5ab6ac59e3e4436c997ab7af626fa688) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:58.375626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fda33-8f43-453c-aec3-5ff4074186f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:58.377095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fda33-8f43-453c-aec3-5ff4074186f0 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:58.383184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 535/1056] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:37:58 2022] GET /identity/v3/role_assignments?user.id=5ab6ac59e3e4436c997ab7af626fa688&scope.project.id=8cbe3d6edf8d42188dd5a3c1c2cadb2c&role.id=32f5ce5800cf40d99d894960288d0155 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:37:58.418653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da847f53-2bab-425d-b47a-713e0bd27d09 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:58.457908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd024a-8b2a-4720-9501-a733a8bde9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:58.458599 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd024a-8b2a-4720-9501-a733a8bde9d8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:58.458881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd024a-8b2a-4720-9501-a733a8bde9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:58.459153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd024a-8b2a-4720-9501-a733a8bde9d8 None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:58.459882 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd024a-8b2a-4720-9501-a733a8bde9d8 None admin] RBAC: Adding query filter params (name=image) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:58.460189 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd024a-8b2a-4720-9501-a733a8bde9d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:58.462026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd024a-8b2a-4720-9501-a733a8bde9d8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:58.472690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 522/1057] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:58.473737 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fda33-8f43-453c-aec3-5ff4074186f0 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:58.581928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fda33-8f43-453c-aec3-5ff4074186f0 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:58.596652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:58.618784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabe3b5-7013-4f89-a9ad-370f87091987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:58.619450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabe3b5-7013-4f89-a9ad-370f87091987 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:58.619735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabe3b5-7013-4f89-a9ad-370f87091987 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:58.620010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabe3b5-7013-4f89-a9ad-370f87091987 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:58.620749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabe3b5-7013-4f89-a9ad-370f87091987 None admin] RBAC: Adding query filter params (type=image) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:37:58.621054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabe3b5-7013-4f89-a9ad-370f87091987 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:58.622467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabe3b5-7013-4f89-a9ad-370f87091987 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:58.627623 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 536/1058] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:37:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:37:58.633215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd024a-8b2a-4720-9501-a733a8bde9d8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:37:58.722755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:37:58.739201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd024a-8b2a-4720-9501-a733a8bde9d8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:37:58.773213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6f9ff-25a7-4349-af87-9facf6407444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:37:58.773878 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6f9ff-25a7-4349-af87-9facf6407444 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:58.774162 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6f9ff-25a7-4349-af87-9facf6407444 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:58.774437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6f9ff-25a7-4349-af87-9facf6407444 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:58.775195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6f9ff-25a7-4349-af87-9facf6407444 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:37:58.776608 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6f9ff-25a7-4349-af87-9facf6407444 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:37:58.804326 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 523/1059] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Jul 11 15:37:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:37:59.843388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf8f72-5d79-4226-b34f-305fb704151d None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:59.843973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf8f72-5d79-4226-b34f-305fb704151d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:59.843973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf8f72-5d79-4226-b34f-305fb704151d None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:59.845494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 537/1060] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:37:59.850633 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436736dc-3279-4831-95db-88bb248607ed None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:37:59.851060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436736dc-3279-4831-95db-88bb248607ed None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:37:59.851235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436736dc-3279-4831-95db-88bb248607ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:37:59.868153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-436736dc-3279-4831-95db-88bb248607ed None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:37:59.869335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-436736dc-3279-4831-95db-88bb248607ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:37:59.946300 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 524/1061] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:37:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:37:59.969137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf8f72-5d79-4226-b34f-305fb704151d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:00.073881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf8f72-5d79-4226-b34f-305fb704151d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:00.107790 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c26520-479e-4b51-8bfe-61fa5bd319fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:00.108556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c26520-479e-4b51-8bfe-61fa5bd319fb None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:00.108835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c26520-479e-4b51-8bfe-61fa5bd319fb None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:00.109101 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c26520-479e-4b51-8bfe-61fa5bd319fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:00.119322 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c26520-479e-4b51-8bfe-61fa5bd319fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-a1c26520-479e-4b51-8bfe-61fa5bd319fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:38:00.127383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:00.128587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:00.129473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:00.129473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:00.129473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:00.129473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:00.129473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:38:00.129473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:38:00.129473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:38:00.129473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:38:00.129473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:38:00.129473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:38:00.129473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:38:00.129473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:38:00.130565 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 538/1062] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Jul 11 15:37:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:38:00.134704 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436736dc-3279-4831-95db-88bb248607ed None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:00.209170 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:00.244634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436736dc-3279-4831-95db-88bb248607ed None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:00.279695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4deb712-6eb4-426f-997b-2c86828fef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:00.280397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deb712-6eb4-426f-997b-2c86828fef22 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:00.280674 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deb712-6eb4-426f-997b-2c86828fef22 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:00.280940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deb712-6eb4-426f-997b-2c86828fef22 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:00.281695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4deb712-6eb4-426f-997b-2c86828fef22 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:00.281994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4deb712-6eb4-426f-997b-2c86828fef22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:00.283364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4deb712-6eb4-426f-997b-2c86828fef22 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:00.291778 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 525/1063] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Jul 11 15:38:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:00.297541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c26520-479e-4b51-8bfe-61fa5bd319fb None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:00.338068 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:00.409519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c26520-479e-4b51-8bfe-61fa5bd319fb None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:00.444566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895dc09-3045-48c2-b44c-a1fc77ced74c None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:00.444759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b35fa6-66dd-4c83-9122-9c2848a3ad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:00.444858 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895dc09-3045-48c2-b44c-a1fc77ced74c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:00.445129 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895dc09-3045-48c2-b44c-a1fc77ced74c None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:00.445506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35fa6-66dd-4c83-9122-9c2848a3ad04 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:00.445789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35fa6-66dd-4c83-9122-9c2848a3ad04 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:00.446061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35fa6-66dd-4c83-9122-9c2848a3ad04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:00.446688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 526/1064] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:38:00.451577 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a5951-29fc-498f-985b-07f31b195d25 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:00.451861 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a5951-29fc-498f-985b-07f31b195d25 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:00.452151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a5951-29fc-498f-985b-07f31b195d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:00.458178 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b35fa6-66dd-4c83-9122-9c2848a3ad04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:00.459735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b35fa6-66dd-4c83-9122-9c2848a3ad04 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:00.469279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e31a5951-29fc-498f-985b-07f31b195d25 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:00.470578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e31a5951-29fc-498f-985b-07f31b195d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-68b35fa6-66dd-4c83-9122-9c2848a3ad04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:38:00.479086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:00.480134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:00.481067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:38:00.481067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:38:00.481067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:38:00.481067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:38:00.481487 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 539/1065] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:38:00.486727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b35fa6-66dd-4c83-9122-9c2848a3ad04 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:00.547070 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 527/1066] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:38:00.569843 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a5951-29fc-498f-985b-07f31b195d25 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:00.581567 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:00.593775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b35fa6-66dd-4c83-9122-9c2848a3ad04 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:00.632673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:00.633525 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fbea5-e967-42ab-b0c6-06764e188961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:00.634193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fbea5-e967-42ab-b0c6-06764e188961 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:00.634470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fbea5-e967-42ab-b0c6-06764e188961 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:00.634793 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fbea5-e967-42ab-b0c6-06764e188961 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:00.635605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fbea5-e967-42ab-b0c6-06764e188961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:00.635917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fbea5-e967-42ab-b0c6-06764e188961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:00.637393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fbea5-e967-42ab-b0c6-06764e188961 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:00.654880 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 540/1067] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:38:00.656128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fbea5-e967-42ab-b0c6-06764e188961 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:00.681352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a5951-29fc-498f-985b-07f31b195d25 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:00.716945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1ced5-cc07-43f1-ba17-36c5a3764330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:00.717751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1ced5-cc07-43f1-ba17-36c5a3764330 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:00.718031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1ced5-cc07-43f1-ba17-36c5a3764330 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:00.718306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1ced5-cc07-43f1-ba17-36c5a3764330 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:00.728825 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1ced5-cc07-43f1-ba17-36c5a3764330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-f7d1ced5-cc07-43f1-ba17-36c5a3764330 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:38:00.736580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:00.737530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:00.738554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:00.738554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:00.738554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:00.738554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:00.738554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:38:00.738554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:38:00.738554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:38:00.738554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:38:00.738554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:38:00.738554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:38:00.738554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:00.738554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:38:00.738554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 528/1068] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:38:00.743725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1ced5-cc07-43f1-ba17-36c5a3764330 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:00.763892 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fbea5-e967-42ab-b0c6-06764e188961 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:00.800788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38130b3-3a87-48db-80b8-476d836fbcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:00.801582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38130b3-3a87-48db-80b8-476d836fbcef None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:00.801865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38130b3-3a87-48db-80b8-476d836fbcef None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:00.802140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38130b3-3a87-48db-80b8-476d836fbcef None admin] PATH_INFO: `/v3/users/nova` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:00.809975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38130b3-3a87-48db-80b8-476d836fbcef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:00.811563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38130b3-3a87-48db-80b8-476d836fbcef None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-c38130b3-3a87-48db-80b8-476d836fbcef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:38:00.825628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:00.826628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:00.827581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:00.827581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:00.827581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:38:00.827581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:38:00.827581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:38:00.827581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:38:00.827581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:38:00.827581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:38:00.827581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:38:00.827581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:38:00.831782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 541/1069] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Jul 11 15:38:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:38:00.832469 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38130b3-3a87-48db-80b8-476d836fbcef None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:00.846500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:00.857311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1ced5-cc07-43f1-ba17-36c5a3764330 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:00.876522 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:00.890378 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4aa693-b1a6-4668-97f0-8e09f81f1170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:00.891044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aa693-b1a6-4668-97f0-8e09f81f1170 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:00.891320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aa693-b1a6-4668-97f0-8e09f81f1170 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:00.891592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aa693-b1a6-4668-97f0-8e09f81f1170 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:00.892381 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aa693-b1a6-4668-97f0-8e09f81f1170 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:00.892688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aa693-b1a6-4668-97f0-8e09f81f1170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:00.894064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aa693-b1a6-4668-97f0-8e09f81f1170 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:00.901960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 529/1070] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:38:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:00.903357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4b7e0-5548-4513-b17e-7aef551adfa7 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:00.903631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4b7e0-5548-4513-b17e-7aef551adfa7 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:00.903903 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4b7e0-5548-4513-b17e-7aef551adfa7 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:00.905194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 530/1071] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:00.907741 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4b7e0-5548-4513-b17e-7aef551adfa7 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:00.938931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38130b3-3a87-48db-80b8-476d836fbcef None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:00.972651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f8f17-79f2-4381-a9ce-6f09f7076dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:00.973328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f8f17-79f2-4381-a9ce-6f09f7076dd4 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:00.973610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f8f17-79f2-4381-a9ce-6f09f7076dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:00.973886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f8f17-79f2-4381-a9ce-6f09f7076dd4 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:00.974733 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f8f17-79f2-4381-a9ce-6f09f7076dd4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:00.975043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f8f17-79f2-4381-a9ce-6f09f7076dd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:00.976605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f8f17-79f2-4381-a9ce-6f09f7076dd4 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:00.993968 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 542/1072] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Jul 11 15:38:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:38:00.995174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c57dc-2f6c-4f18-a8af-bb268d9d160d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:00.995459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c57dc-2f6c-4f18-a8af-bb268d9d160d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:00.995715 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c57dc-2f6c-4f18-a8af-bb268d9d160d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:01.007358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4b7e0-5548-4513-b17e-7aef551adfa7 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:01.012115 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-e29c57dc-2f6c-4f18-a8af-bb268d9d160d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:01.013484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e29c57dc-2f6c-4f18-a8af-bb268d9d160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:01.039865 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb0160-3bcf-4ece-a8f3-1bcbf90c957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:01.040785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb0160-3bcf-4ece-a8f3-1bcbf90c957d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:01.041068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb0160-3bcf-4ece-a8f3-1bcbf90c957d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:01.041344 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb0160-3bcf-4ece-a8f3-1bcbf90c957d None admin] PATH_INFO: `/v3/users/5ab6ac59e3e4436c997ab7af626fa688` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:01.042548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb0160-3bcf-4ece-a8f3-1bcbf90c957d None admin] RBAC: Authorizing `identity:get_user(user_id=5ab6ac59e3e4436c997ab7af626fa688)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:01.044046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb0160-3bcf-4ece-a8f3-1bcbf90c957d None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:01.045736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 531/1073] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:38:00 2022] GET /identity/v3/users/5ab6ac59e3e4436c997ab7af626fa688 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:38:01.046524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb0160-3bcf-4ece-a8f3-1bcbf90c957d None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:01.075908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:01.088330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 543/1074] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:01.088330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c57dc-2f6c-4f18-a8af-bb268d9d160d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:01.102746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:01.152057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb0160-3bcf-4ece-a8f3-1bcbf90c957d None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:01.185099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c57dc-2f6c-4f18-a8af-bb268d9d160d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:01.187992 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb88ef-1da6-41cd-aaba-a3374fe70bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:01.188826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb88ef-1da6-41cd-aaba-a3374fe70bdd None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:01.188826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb88ef-1da6-41cd-aaba-a3374fe70bdd None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:01.189059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb88ef-1da6-41cd-aaba-a3374fe70bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:01.199726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb88ef-1da6-41cd-aaba-a3374fe70bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:01.201259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb88ef-1da6-41cd-aaba-a3374fe70bdd None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-13cb88ef-1da6-41cd-aaba-a3374fe70bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:38:01.218735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:01.219703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:01.220634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:38:01.220634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:38:01.220634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:38:01.220634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:38:01.220634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 532/1075] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:38:01.220915 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb88ef-1da6-41cd-aaba-a3374fe70bdd None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:01.223619 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce9333-37af-4c91-b264-298397768a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:01.225125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce9333-37af-4c91-b264-298397768a59 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:01.225125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce9333-37af-4c91-b264-298397768a59 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:01.225125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce9333-37af-4c91-b264-298397768a59 None admin] PATH_INFO: `/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:01.226243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce9333-37af-4c91-b264-298397768a59 None admin] RBAC: Authorizing `identity:get_project(project_id=8cbe3d6edf8d42188dd5a3c1c2cadb2c)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:01.227720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce9333-37af-4c91-b264-298397768a59 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:01.234610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 544/1076] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:38:01 2022] GET /identity/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:01.234610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce9333-37af-4c91-b264-298397768a59 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:01.296808 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:01.320616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb88ef-1da6-41cd-aaba-a3374fe70bdd None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:01.322164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:01.331336 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce9333-37af-4c91-b264-298397768a59 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:01.354604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b47b82-bffc-4a54-887c-aa1b839a0e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:01.355262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b47b82-bffc-4a54-887c-aa1b839a0e23 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:01.355584 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b47b82-bffc-4a54-887c-aa1b839a0e23 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:01.355860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b47b82-bffc-4a54-887c-aa1b839a0e23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:01.366190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893477-bd39-4329-a92b-f2a7219085f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:01.366847 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893477-bd39-4329-a92b-f2a7219085f4 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:01.367126 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893477-bd39-4329-a92b-f2a7219085f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:01.367400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893477-bd39-4329-a92b-f2a7219085f4 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:01.368129 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18893477-bd39-4329-a92b-f2a7219085f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:01.368464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18893477-bd39-4329-a92b-f2a7219085f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:01.369843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18893477-bd39-4329-a92b-f2a7219085f4 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:01.381938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 545/1077] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:01.382697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893477-bd39-4329-a92b-f2a7219085f4 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:01.430329 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b47b82-bffc-4a54-887c-aa1b839a0e23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:01.432606 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b47b82-bffc-4a54-887c-aa1b839a0e23 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:01.485397 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893477-bd39-4329-a92b-f2a7219085f4 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:01.509903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:01.519049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a51ec8-adb9-4ce3-aaa3-433631154f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:01.519942 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51ec8-adb9-4ce3-aaa3-433631154f57 None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:01.520223 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51ec8-adb9-4ce3-aaa3-433631154f57 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:01.520601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51ec8-adb9-4ce3-aaa3-433631154f57 None admin] PATH_INFO: `/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c/users/5ab6ac59e3e4436c997ab7af626fa688/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:01.522564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a51ec8-adb9-4ce3-aaa3-433631154f57 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cbe3d6edf8d42188dd5a3c1c2cadb2c, user_id=5ab6ac59e3e4436c997ab7af626fa688, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:01.524017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a51ec8-adb9-4ce3-aaa3-433631154f57 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:01.533747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 533/1078] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:38:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:38:01.534576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b47b82-bffc-4a54-887c-aa1b839a0e23 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:01.537185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:01.542190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 546/1079] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:38:01 2022] PUT /identity/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c/users/5ab6ac59e3e4436c997ab7af626fa688/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:38:01.543184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a51ec8-adb9-4ce3-aaa3-433631154f57 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:01.664574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b47b82-bffc-4a54-887c-aa1b839a0e23 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:01.675897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a51ec8-adb9-4ce3-aaa3-433631154f57 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:01.708113 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f199c9d-db47-4e0a-9da4-822ed7417f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:01.708965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f199c9d-db47-4e0a-9da4-822ed7417f2c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:01.709243 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f199c9d-db47-4e0a-9da4-822ed7417f2c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:01.709513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f199c9d-db47-4e0a-9da4-822ed7417f2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:01.717338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f199c9d-db47-4e0a-9da4-822ed7417f2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:01.717497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80ec92-06b0-4dd1-a5a3-29dc24c90446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:01.718293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80ec92-06b0-4dd1-a5a3-29dc24c90446 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:01.718572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80ec92-06b0-4dd1-a5a3-29dc24c90446 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:01.718953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80ec92-06b0-4dd1-a5a3-29dc24c90446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:01.719059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f199c9d-db47-4e0a-9da4-822ed7417f2c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:01.730340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80ec92-06b0-4dd1-a5a3-29dc24c90446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:01.731896 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80ec92-06b0-4dd1-a5a3-29dc24c90446 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-7f199c9d-db47-4e0a-9da4-822ed7417f2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:38:01.733205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:01.734065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:01.736038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:38:01.736038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:38:01.736038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:38:01.736038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:38:01.736038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:38:01.736038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:38:01.736038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:38:01.736038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:38:01.736038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 534/1080] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:38:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:38:01.740142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f199c9d-db47-4e0a-9da4-822ed7417f2c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-5f80ec92-06b0-4dd1-a5a3-29dc24c90446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:38:01.752363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:01.753450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:01.754788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:38:01.754788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:38:01.754788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:38:01.754788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:38:01.754788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 547/1081] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:38:01.759723 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80ec92-06b0-4dd1-a5a3-29dc24c90446 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:01.806022 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:01.808011 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:01.848446 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f199c9d-db47-4e0a-9da4-822ed7417f2c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:01.876015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80ec92-06b0-4dd1-a5a3-29dc24c90446 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:01.883658 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76795bd-314f-4d04-b7dd-ad0f8c9677d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:01.884430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76795bd-314f-4d04-b7dd-ad0f8c9677d5 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:01.884708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76795bd-314f-4d04-b7dd-ad0f8c9677d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:01.884978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76795bd-314f-4d04-b7dd-ad0f8c9677d5 None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:01.885771 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76795bd-314f-4d04-b7dd-ad0f8c9677d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:01.886078 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76795bd-314f-4d04-b7dd-ad0f8c9677d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:01.887516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76795bd-314f-4d04-b7dd-ad0f8c9677d5 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:01.904990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 535/1082] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:38:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:38:01.906378 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76795bd-314f-4d04-b7dd-ad0f8c9677d5 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:01.914660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fe74e-d65e-4eea-a00f-6db14954a41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:01.915328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fe74e-d65e-4eea-a00f-6db14954a41e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:01.915605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fe74e-d65e-4eea-a00f-6db14954a41e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:01.915873 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fe74e-d65e-4eea-a00f-6db14954a41e None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:01.916685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fe74e-d65e-4eea-a00f-6db14954a41e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:01.916983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fe74e-d65e-4eea-a00f-6db14954a41e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:01.918372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fe74e-d65e-4eea-a00f-6db14954a41e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:01.929954 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 548/1083] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:02.028723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76795bd-314f-4d04-b7dd-ad0f8c9677d5 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:02.054812 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:02.068912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e56a30-f312-4243-8f0b-a75d35ec81a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:02.070137 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e56a30-f312-4243-8f0b-a75d35ec81a2 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:02.070591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e56a30-f312-4243-8f0b-a75d35ec81a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:02.071050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e56a30-f312-4243-8f0b-a75d35ec81a2 None admin] PATH_INFO: `/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/fa038a2e30f544aaa609d32e0e1ceaa0/roles/c3aba0dfe1734a90bbf4770537e6c77c` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:02.073495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e56a30-f312-4243-8f0b-a75d35ec81a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fe17aeb94ad42dc990c9d963dac9af6, user_id=fa038a2e30f544aaa609d32e0e1ceaa0, role_id=c3aba0dfe1734a90bbf4770537e6c77c)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:02.075127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e56a30-f312-4243-8f0b-a75d35ec81a2 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:02.093977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 536/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:38:01 2022] PUT /identity/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/fa038a2e30f544aaa609d32e0e1ceaa0/roles/c3aba0dfe1734a90bbf4770537e6c77c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:38:03.544964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fc8e3-eda8-41a6-8725-e7d4dd21115d None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:03.545524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fc8e3-eda8-41a6-8725-e7d4dd21115d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:03.545613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fc8e3-eda8-41a6-8725-e7d4dd21115d None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:03.547028 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 549/1085] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:03.552683 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4dd5f-95b8-423c-a232-7693de0cd90a None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:03.553079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4dd5f-95b8-423c-a232-7693de0cd90a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:03.553267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4dd5f-95b8-423c-a232-7693de0cd90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:03.570384 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-fda4dd5f-95b8-423c-a232-7693de0cd90a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:03.571588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fda4dd5f-95b8-423c-a232-7693de0cd90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:03.641609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 537/1086] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:03.665766 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fc8e3-eda8-41a6-8725-e7d4dd21115d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:03.767587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:03.773100 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fc8e3-eda8-41a6-8725-e7d4dd21115d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:03.808077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57b519-1e39-4bcf-9ff5-0608cd64af6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:03.808821 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57b519-1e39-4bcf-9ff5-0608cd64af6f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:03.809100 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57b519-1e39-4bcf-9ff5-0608cd64af6f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:03.809370 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57b519-1e39-4bcf-9ff5-0608cd64af6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:03.819709 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57b519-1e39-4bcf-9ff5-0608cd64af6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-9a57b519-1e39-4bcf-9ff5-0608cd64af6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:38:03.827324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:03.828260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:03.829149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:03.829149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:03.829149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:03.829149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:03.829149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:38:03.829149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:38:03.829149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:38:03.829149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:38:03.829149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:38:03.829149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:38:03.829149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:03.829149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:38:03.829149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 550/1087] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:38:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:38:03.834920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4dd5f-95b8-423c-a232-7693de0cd90a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:03.938856 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4dd5f-95b8-423c-a232-7693de0cd90a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:03.953227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:03.975149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb99d2-d047-41ae-aa71-4311a5960201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:03.975812 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb99d2-d047-41ae-aa71-4311a5960201 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:03.976096 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb99d2-d047-41ae-aa71-4311a5960201 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:03.976397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb99d2-d047-41ae-aa71-4311a5960201 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:03.977156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb99d2-d047-41ae-aa71-4311a5960201 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:03.977463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb99d2-d047-41ae-aa71-4311a5960201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:03.978842 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb99d2-d047-41ae-aa71-4311a5960201 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:03.987081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 538/1088] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:38:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:03.992916 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57b519-1e39-4bcf-9ff5-0608cd64af6f None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:04.074711 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd16ea5-1a32-4c3e-9557-76236105557c None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:04.074920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd16ea5-1a32-4c3e-9557-76236105557c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:04.075443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd16ea5-1a32-4c3e-9557-76236105557c None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:04.076957 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 539/1089] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:38:04.081844 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf52c68-092f-4bb6-85e1-b55827d3445a None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:04.082136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf52c68-092f-4bb6-85e1-b55827d3445a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:04.082413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf52c68-092f-4bb6-85e1-b55827d3445a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:04.095944 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57b519-1e39-4bcf-9ff5-0608cd64af6f None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:04.100175 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-3bf52c68-092f-4bb6-85e1-b55827d3445a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:04.101402 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3bf52c68-092f-4bb6-85e1-b55827d3445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:04.130029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd22ed4-fd3d-4769-9f9d-f3be4967b4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:04.130893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd22ed4-fd3d-4769-9f9d-f3be4967b4b3 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:04.131172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd22ed4-fd3d-4769-9f9d-f3be4967b4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:04.131444 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd22ed4-fd3d-4769-9f9d-f3be4967b4b3 None admin] PATH_INFO: `/v3/users/5ab6ac59e3e4436c997ab7af626fa688` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:04.132657 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd22ed4-fd3d-4769-9f9d-f3be4967b4b3 None admin] RBAC: Authorizing `identity:get_user(user_id=5ab6ac59e3e4436c997ab7af626fa688)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:04.134107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd22ed4-fd3d-4769-9f9d-f3be4967b4b3 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:04.135956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 551/1090] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:38:03 2022] GET /identity/v3/users/5ab6ac59e3e4436c997ab7af626fa688 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:04.141503 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd22ed4-fd3d-4769-9f9d-f3be4967b4b3 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:04.167993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:04.169815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 540/1091] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:38:04.193400 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf52c68-092f-4bb6-85e1-b55827d3445a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:04.243962 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd22ed4-fd3d-4769-9f9d-f3be4967b4b3 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:04.278542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e703879-c467-45e5-b9f1-c9b40902a1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:04.279354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e703879-c467-45e5-b9f1-c9b40902a1cf None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:04.279638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e703879-c467-45e5-b9f1-c9b40902a1cf None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:04.279912 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e703879-c467-45e5-b9f1-c9b40902a1cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:04.291485 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf52c68-092f-4bb6-85e1-b55827d3445a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:04.293784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:04.326350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605103c-6b8c-489a-a0be-3c344eff800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:04.327095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605103c-6b8c-489a-a0be-3c344eff800b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:04.327379 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605103c-6b8c-489a-a0be-3c344eff800b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:04.327653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605103c-6b8c-489a-a0be-3c344eff800b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:04.338083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605103c-6b8c-489a-a0be-3c344eff800b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-a605103c-6b8c-489a-a0be-3c344eff800b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:38:04.346630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:04.347662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:04.348517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:04.348517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:04.348517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:04.348517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:04.348517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:38:04.348517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:38:04.348517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:38:04.348517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:38:04.348517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:38:04.348517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:38:04.348517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 15:38:04.348517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:38:04.348517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 541/1092] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Jul 11 15:38:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:38:04.349201 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e703879-c467-45e5-b9f1-c9b40902a1cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:04.349582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e703879-c467-45e5-b9f1-c9b40902a1cf None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:04.353859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605103c-6b8c-489a-a0be-3c344eff800b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:04.376019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:04.448934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 552/1093] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:38:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 15:38:04.454897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e703879-c467-45e5-b9f1-c9b40902a1cf None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:04.455815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605103c-6b8c-489a-a0be-3c344eff800b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:04.490187 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e803b9-9eb9-4b27-a9a8-b7ab14994ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:04.490852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e803b9-9eb9-4b27-a9a8-b7ab14994ff9 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:04.491127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e803b9-9eb9-4b27-a9a8-b7ab14994ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:04.491392 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e803b9-9eb9-4b27-a9a8-b7ab14994ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:04.492137 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e803b9-9eb9-4b27-a9a8-b7ab14994ff9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:04.492475 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e803b9-9eb9-4b27-a9a8-b7ab14994ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:04.493847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e803b9-9eb9-4b27-a9a8-b7ab14994ff9 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:04.502148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 542/1094] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Jul 11 15:38:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:38:04.507854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e803b9-9eb9-4b27-a9a8-b7ab14994ff9 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:04.535353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:04.554768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e703879-c467-45e5-b9f1-c9b40902a1cf None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:04.580089 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:04.589143 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f556b-54ae-4b54-b756-0ebd2ce3a54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:04.590008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f556b-54ae-4b54-b756-0ebd2ce3a54a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:04.590281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f556b-54ae-4b54-b756-0ebd2ce3a54a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:04.590550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f556b-54ae-4b54-b756-0ebd2ce3a54a None admin] PATH_INFO: `/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:04.591912 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f556b-54ae-4b54-b756-0ebd2ce3a54a None admin] RBAC: Authorizing `identity:get_project(project_id=8cbe3d6edf8d42188dd5a3c1c2cadb2c)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:04.593404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f556b-54ae-4b54-b756-0ebd2ce3a54a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:04.595115 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 553/1095] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:38:04 2022] GET /identity/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:04.601145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f556b-54ae-4b54-b756-0ebd2ce3a54a None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:04.608434 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e803b9-9eb9-4b27-a9a8-b7ab14994ff9 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:04.642493 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa4503-d90b-430a-b157-b35ee34a9dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:04.643294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa4503-d90b-430a-b157-b35ee34a9dd4 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:04.643574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa4503-d90b-430a-b157-b35ee34a9dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:04.643847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa4503-d90b-430a-b157-b35ee34a9dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:04.655039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa4503-d90b-430a-b157-b35ee34a9dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:04.656534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa4503-d90b-430a-b157-b35ee34a9dd4 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-0ffa4503-d90b-430a-b157-b35ee34a9dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:38:04.673565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:04.674661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:04.676027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:38:04.676027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:38:04.676027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:38:04.676027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:38:04.676027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 543/1096] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:38:04.680504 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa4503-d90b-430a-b157-b35ee34a9dd4 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:04.701458 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f556b-54ae-4b54-b756-0ebd2ce3a54a None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:04.735871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c866a-ed27-4378-a249-6e6e8a174168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:04.736562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c866a-ed27-4378-a249-6e6e8a174168 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:04.736846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c866a-ed27-4378-a249-6e6e8a174168 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:04.737121 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c866a-ed27-4378-a249-6e6e8a174168 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:04.738018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c866a-ed27-4378-a249-6e6e8a174168 None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=8cbe3d6edf8d42188dd5a3c1c2cadb2c, user.id=5ab6ac59e3e4436c997ab7af626fa688) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:04.738360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c866a-ed27-4378-a249-6e6e8a174168 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:04.739844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c866a-ed27-4378-a249-6e6e8a174168 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:04.745557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 554/1097] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:38:04 2022] GET /identity/v3/role_assignments?user.id=5ab6ac59e3e4436c997ab7af626fa688&scope.project.id=8cbe3d6edf8d42188dd5a3c1c2cadb2c&role.id=32f5ce5800cf40d99d894960288d0155 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:38:04.764600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:04.790503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa4503-d90b-430a-b157-b35ee34a9dd4 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:04.830577 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e7c1d-9473-4637-805e-a96a93624ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:04.831166 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7c1d-9473-4637-805e-a96a93624ba8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:04.831444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7c1d-9473-4637-805e-a96a93624ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:04.831722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7c1d-9473-4637-805e-a96a93624ba8 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:04.832504 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e7c1d-9473-4637-805e-a96a93624ba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:04.832808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e7c1d-9473-4637-805e-a96a93624ba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:04.834198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e7c1d-9473-4637-805e-a96a93624ba8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:04.848518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 544/1098] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:38:04.854378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c866a-ed27-4378-a249-6e6e8a174168 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:04.919693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:04.966388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c866a-ed27-4378-a249-6e6e8a174168 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:05.000325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfe49e-8b4e-4198-915c-0ad34f8a392e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:05.001139 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfe49e-8b4e-4198-915c-0ad34f8a392e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:05.001420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfe49e-8b4e-4198-915c-0ad34f8a392e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:05.001691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfe49e-8b4e-4198-915c-0ad34f8a392e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:05.009451 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfe49e-8b4e-4198-915c-0ad34f8a392e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:05.010919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfe49e-8b4e-4198-915c-0ad34f8a392e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-e0dfe49e-8b4e-4198-915c-0ad34f8a392e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:38:05.024945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:05.025927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:05.027320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:05.027320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:05.027320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:38:05.027320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:38:05.027320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:38:05.027320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:38:05.027320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:38:05.027320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:38:05.027320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 15:38:05.027320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:38:05.027320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 555/1099] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Jul 11 15:38:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:38:05.032038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e7c1d-9473-4637-805e-a96a93624ba8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:05.134772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e7c1d-9473-4637-805e-a96a93624ba8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:05.171228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69160f12-d2dd-4971-a365-752952793c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:05.171906 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69160f12-d2dd-4971-a365-752952793c9c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:05.172188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69160f12-d2dd-4971-a365-752952793c9c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:05.172497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69160f12-d2dd-4971-a365-752952793c9c None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:05.173346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69160f12-d2dd-4971-a365-752952793c9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:05.173657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69160f12-d2dd-4971-a365-752952793c9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:05.175097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69160f12-d2dd-4971-a365-752952793c9c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:05.183108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:05.199568 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 545/1100] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Jul 11 15:38:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:05.205436 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfe49e-8b4e-4198-915c-0ad34f8a392e None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:05.308715 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfe49e-8b4e-4198-915c-0ad34f8a392e None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:05.326302 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:05.343852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88e498-497b-4ae8-89e9-d23ca1d7d7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:05.344539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88e498-497b-4ae8-89e9-d23ca1d7d7ac None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:05.344828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88e498-497b-4ae8-89e9-d23ca1d7d7ac None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:05.345105 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88e498-497b-4ae8-89e9-d23ca1d7d7ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:05.411486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88e498-497b-4ae8-89e9-d23ca1d7d7ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:05.412908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88e498-497b-4ae8-89e9-d23ca1d7d7ac None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:05.529006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 556/1101] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:38:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 15:38:05.534920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69160f12-d2dd-4971-a365-752952793c9c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:05.637934 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69160f12-d2dd-4971-a365-752952793c9c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:05.675052 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7a925-eb0f-4b97-b0f7-d06ad9ab0899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:05.675774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7a925-eb0f-4b97-b0f7-d06ad9ab0899 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:05.676056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7a925-eb0f-4b97-b0f7-d06ad9ab0899 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:05.676347 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7a925-eb0f-4b97-b0f7-d06ad9ab0899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:05.686700 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7a925-eb0f-4b97-b0f7-d06ad9ab0899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:05.688173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7a925-eb0f-4b97-b0f7-d06ad9ab0899 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-2ea7a925-eb0f-4b97-b0f7-d06ad9ab0899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:38:05.705258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:05.706171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:05.707219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:38:05.707219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:38:05.707219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:38:05.707219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:38:05.707219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 546/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:38:05.713722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88e498-497b-4ae8-89e9-d23ca1d7d7ac None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:05.734251 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:05.817556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88e498-497b-4ae8-89e9-d23ca1d7d7ac None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:05.853207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf2f53-9924-42af-9eab-ab6ec119dee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:05.853914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf2f53-9924-42af-9eab-ab6ec119dee6 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:05.854198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf2f53-9924-42af-9eab-ab6ec119dee6 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:05.854475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf2f53-9924-42af-9eab-ab6ec119dee6 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:05.855365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf2f53-9924-42af-9eab-ab6ec119dee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:05.855682 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf2f53-9924-42af-9eab-ab6ec119dee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:05.857256 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf2f53-9924-42af-9eab-ab6ec119dee6 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:05.868522 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 557/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:05.874417 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7a925-eb0f-4b97-b0f7-d06ad9ab0899 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:05.929450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:05.982265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7a925-eb0f-4b97-b0f7-d06ad9ab0899 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:06.017158 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab0d70-cbe5-4961-9372-550f67149926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:06.017951 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab0d70-cbe5-4961-9372-550f67149926 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:06.018231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab0d70-cbe5-4961-9372-550f67149926 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:06.018499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab0d70-cbe5-4961-9372-550f67149926 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:06.025270 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab0d70-cbe5-4961-9372-550f67149926 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:06.026722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab0d70-cbe5-4961-9372-550f67149926 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-e8ab0d70-cbe5-4961-9372-550f67149926 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:38:06.040863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:06.041767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:06.042668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:38:06.042668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:38:06.042668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:38:06.042668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:38:06.042668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:38:06.042668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:38:06.042668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:38:06.042668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:38:06.042668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 547/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:38:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:38:06.048333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf2f53-9924-42af-9eab-ab6ec119dee6 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:06.132518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:06.155155 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf2f53-9924-42af-9eab-ab6ec119dee6 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:06.191937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef5d8c-6fd3-42b5-8ef4-dc3a1a4a1090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:06.192644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef5d8c-6fd3-42b5-8ef4-dc3a1a4a1090 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:06.192932 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef5d8c-6fd3-42b5-8ef4-dc3a1a4a1090 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:06.193182 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef5d8c-6fd3-42b5-8ef4-dc3a1a4a1090 None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:06.194008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef5d8c-6fd3-42b5-8ef4-dc3a1a4a1090 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:06.194311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef5d8c-6fd3-42b5-8ef4-dc3a1a4a1090 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:06.195749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef5d8c-6fd3-42b5-8ef4-dc3a1a4a1090 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:06.208774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 558/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:06.215286 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab0d70-cbe5-4961-9372-550f67149926 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:06.320846 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab0d70-cbe5-4961-9372-550f67149926 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:06.329977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:06.356907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9306b2-b0bf-440d-b803-bd6ccff0fc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:06.357571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9306b2-b0bf-440d-b803-bd6ccff0fc30 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:06.357854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9306b2-b0bf-440d-b803-bd6ccff0fc30 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:06.358130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9306b2-b0bf-440d-b803-bd6ccff0fc30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:06.358975 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9306b2-b0bf-440d-b803-bd6ccff0fc30 None admin] RBAC: Adding query filter params (role.id=c3aba0dfe1734a90bbf4770537e6c77c, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=fa038a2e30f544aaa609d32e0e1ceaa0) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:06.359290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9306b2-b0bf-440d-b803-bd6ccff0fc30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:06.360779 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9306b2-b0bf-440d-b803-bd6ccff0fc30 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:06.366743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 548/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:38:06 2022] GET /identity/v3/role_assignments?user.id=fa038a2e30f544aaa609d32e0e1ceaa0&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c3aba0dfe1734a90bbf4770537e6c77c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:06.798519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5a538-9ef5-4e3b-bbf9-ca4aa25bf334 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:06.799047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5a538-9ef5-4e3b-bbf9-ca4aa25bf334 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:06.799047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5a538-9ef5-4e3b-bbf9-ca4aa25bf334 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:06.800541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 559/1107] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:06.806020 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60110a-3f8e-42eb-ae27-af7e7519989a None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:06.806456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60110a-3f8e-42eb-ae27-af7e7519989a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:06.806547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60110a-3f8e-42eb-ae27-af7e7519989a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:06.824701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-5e60110a-3f8e-42eb-ae27-af7e7519989a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:06.826002 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5e60110a-3f8e-42eb-ae27-af7e7519989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:06.895666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 549/1108] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:06.920741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5a538-9ef5-4e3b-bbf9-ca4aa25bf334 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:07.026590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5a538-9ef5-4e3b-bbf9-ca4aa25bf334 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:07.060036 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419da926-5df2-4d42-92f1-c7d22e7f9046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:07.060759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419da926-5df2-4d42-92f1-c7d22e7f9046 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:07.061037 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419da926-5df2-4d42-92f1-c7d22e7f9046 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:07.061318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419da926-5df2-4d42-92f1-c7d22e7f9046 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:07.062507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419da926-5df2-4d42-92f1-c7d22e7f9046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:07.063954 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419da926-5df2-4d42-92f1-c7d22e7f9046 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:07.065625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 560/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:38:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:07.071586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60110a-3f8e-42eb-ae27-af7e7519989a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:07.176021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60110a-3f8e-42eb-ae27-af7e7519989a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:07.177613 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:07.213109 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e184d78-5149-4e69-9fe6-1cbfe55560f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:07.213789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184d78-5149-4e69-9fe6-1cbfe55560f4 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:07.214074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184d78-5149-4e69-9fe6-1cbfe55560f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:07.214350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184d78-5149-4e69-9fe6-1cbfe55560f4 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:07.215070 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e184d78-5149-4e69-9fe6-1cbfe55560f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:07.216596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e184d78-5149-4e69-9fe6-1cbfe55560f4 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:07.236468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 550/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:38:07 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:38:09.260883 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48b3b1-313a-4d7a-b9c3-fc459cf93519 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:09.261437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48b3b1-313a-4d7a-b9c3-fc459cf93519 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:09.261437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48b3b1-313a-4d7a-b9c3-fc459cf93519 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:09.263298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 561/1111] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:09.269673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2577e6-7491-4a01-a683-68698362c345 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:09.270077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2577e6-7491-4a01-a683-68698362c345 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:09.270271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2577e6-7491-4a01-a683-68698362c345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:09.297158 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-9d2577e6-7491-4a01-a683-68698362c345 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:09.298361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9d2577e6-7491-4a01-a683-68698362c345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:09.371529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 551/1112] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:09.401636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48b3b1-313a-4d7a-b9c3-fc459cf93519 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:09.412265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:09.514146 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48b3b1-313a-4d7a-b9c3-fc459cf93519 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:09.549564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc442f2-0472-4e8b-9e7e-34f1c10e6347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:09.550417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc442f2-0472-4e8b-9e7e-34f1c10e6347 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:09.550700 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc442f2-0472-4e8b-9e7e-34f1c10e6347 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:09.550974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc442f2-0472-4e8b-9e7e-34f1c10e6347 None admin] PATH_INFO: `/v3/roles/49eaa4df59ae423fa6913302fe982e4e` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:09.552631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc442f2-0472-4e8b-9e7e-34f1c10e6347 None admin] RBAC: Authorizing `identity:get_role(role_id=49eaa4df59ae423fa6913302fe982e4e)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:09.554023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc442f2-0472-4e8b-9e7e-34f1c10e6347 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:09.555411 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 562/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:38:09 2022] GET /identity/v3/roles/49eaa4df59ae423fa6913302fe982e4e => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:09.561699 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2577e6-7491-4a01-a683-68698362c345 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:09.650919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:09.665751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2577e6-7491-4a01-a683-68698362c345 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:09.703515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7c88-4e0e-47ed-9113-4a6fc76db7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:09.704423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7c88-4e0e-47ed-9113-4a6fc76db7c5 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:09.704709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7c88-4e0e-47ed-9113-4a6fc76db7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:09.704989 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7c88-4e0e-47ed-9113-4a6fc76db7c5 None admin] PATH_INFO: `/v3/users/c46ac61b728b4947b9e73a90a6058787` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:09.719134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d7c88-4e0e-47ed-9113-4a6fc76db7c5 None admin] RBAC: Authorizing `identity:get_user(user_id=c46ac61b728b4947b9e73a90a6058787)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:09.720626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d7c88-4e0e-47ed-9113-4a6fc76db7c5 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:09.722299 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 552/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:38:09 2022] GET /identity/v3/users/c46ac61b728b4947b9e73a90a6058787 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:09.731596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc442f2-0472-4e8b-9e7e-34f1c10e6347 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:09.813267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:09.842754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc442f2-0472-4e8b-9e7e-34f1c10e6347 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:09.880597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68016b4a-a1f1-48dd-8437-0beff551637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:09.881229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68016b4a-a1f1-48dd-8437-0beff551637e None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:09.881509 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68016b4a-a1f1-48dd-8437-0beff551637e None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:09.881783 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68016b4a-a1f1-48dd-8437-0beff551637e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:09.953262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68016b4a-a1f1-48dd-8437-0beff551637e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:09.955090 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68016b4a-a1f1-48dd-8437-0beff551637e None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:10.034871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:10.060750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 563/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:38:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:38:10.067089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7c88-4e0e-47ed-9113-4a6fc76db7c5 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:10.169969 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7c88-4e0e-47ed-9113-4a6fc76db7c5 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:10.214731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf028ec5-2233-4405-a563-9d89e773f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:10.215719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf028ec5-2233-4405-a563-9d89e773f43c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:10.216045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf028ec5-2233-4405-a563-9d89e773f43c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:10.216238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf028ec5-2233-4405-a563-9d89e773f43c None admin] PATH_INFO: `/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:10.217530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf028ec5-2233-4405-a563-9d89e773f43c None admin] RBAC: Authorizing `identity:get_project(project_id=8cbe3d6edf8d42188dd5a3c1c2cadb2c)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:10.219033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf028ec5-2233-4405-a563-9d89e773f43c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:10.220806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 553/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:38:10 2022] GET /identity/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:10.229153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68016b4a-a1f1-48dd-8437-0beff551637e None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:10.336942 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68016b4a-a1f1-48dd-8437-0beff551637e None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:10.379470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a740d46-6ebe-46a6-83d1-811cb7bc05d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:10.380118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a740d46-6ebe-46a6-83d1-811cb7bc05d2 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:10.380434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a740d46-6ebe-46a6-83d1-811cb7bc05d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:10.380706 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a740d46-6ebe-46a6-83d1-811cb7bc05d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:10.381540 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a740d46-6ebe-46a6-83d1-811cb7bc05d2 None admin] RBAC: Adding query filter params (role.id=49eaa4df59ae423fa6913302fe982e4e, scope.project.id=8cbe3d6edf8d42188dd5a3c1c2cadb2c, user.id=c46ac61b728b4947b9e73a90a6058787) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:10.381853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a740d46-6ebe-46a6-83d1-811cb7bc05d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:10.383306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a740d46-6ebe-46a6-83d1-811cb7bc05d2 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:10.389012 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 564/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:38:10 2022] GET /identity/v3/role_assignments?user.id=c46ac61b728b4947b9e73a90a6058787&scope.project.id=8cbe3d6edf8d42188dd5a3c1c2cadb2c&role.id=49eaa4df59ae423fa6913302fe982e4e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:12.419813 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c157d-6857-46cf-a22d-63d833fab843 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:12.420789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c157d-6857-46cf-a22d-63d833fab843 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:12.420789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c157d-6857-46cf-a22d-63d833fab843 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:12.422945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 554/1118] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:12.429300 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3168a-4d3f-4496-b26b-d70b56f4eaea None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:12.430091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3168a-4d3f-4496-b26b-d70b56f4eaea None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:12.430275 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3168a-4d3f-4496-b26b-d70b56f4eaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:12.451602 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-14c3168a-4d3f-4496-b26b-d70b56f4eaea None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:12.452777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-14c3168a-4d3f-4496-b26b-d70b56f4eaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:12.486852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:12.534933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 565/1119] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:12.557170 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c157d-6857-46cf-a22d-63d833fab843 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:12.575271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:12.667521 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c157d-6857-46cf-a22d-63d833fab843 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:12.705979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118ddb2-44ee-467a-8963-4ee9633884a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:12.706764 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118ddb2-44ee-467a-8963-4ee9633884a0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:12.707046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118ddb2-44ee-467a-8963-4ee9633884a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:12.707319 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118ddb2-44ee-467a-8963-4ee9633884a0 None admin] PATH_INFO: `/v3/roles/49eaa4df59ae423fa6913302fe982e4e` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:12.708872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118ddb2-44ee-467a-8963-4ee9633884a0 None admin] RBAC: Authorizing `identity:get_role(role_id=49eaa4df59ae423fa6913302fe982e4e)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:12.710250 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118ddb2-44ee-467a-8963-4ee9633884a0 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:12.711950 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 555/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:38:12 2022] GET /identity/v3/roles/49eaa4df59ae423fa6913302fe982e4e => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:12.719047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3168a-4d3f-4496-b26b-d70b56f4eaea None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:12.829696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3168a-4d3f-4496-b26b-d70b56f4eaea None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:12.866964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a8e9e-0e0e-4581-bd5e-a9f4a09bd049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:12.867828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a8e9e-0e0e-4581-bd5e-a9f4a09bd049 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:12.868105 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a8e9e-0e0e-4581-bd5e-a9f4a09bd049 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:12.868404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a8e9e-0e0e-4581-bd5e-a9f4a09bd049 None admin] PATH_INFO: `/v3/users/c46ac61b728b4947b9e73a90a6058787` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:12.869744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a8e9e-0e0e-4581-bd5e-a9f4a09bd049 None admin] RBAC: Authorizing `identity:get_user(user_id=c46ac61b728b4947b9e73a90a6058787)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:12.871191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a8e9e-0e0e-4581-bd5e-a9f4a09bd049 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:12.873128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 566/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:38:12 2022] GET /identity/v3/users/c46ac61b728b4947b9e73a90a6058787 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:12.882866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118ddb2-44ee-467a-8963-4ee9633884a0 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:12.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:13.004565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118ddb2-44ee-467a-8963-4ee9633884a0 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:13.039376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eb402-3668-4e58-aa7f-03971f58beff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:13.040233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eb402-3668-4e58-aa7f-03971f58beff None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:13.040537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eb402-3668-4e58-aa7f-03971f58beff None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:13.040805 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eb402-3668-4e58-aa7f-03971f58beff None admin] PATH_INFO: `/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:13.042027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1eb402-3668-4e58-aa7f-03971f58beff None admin] RBAC: Authorizing `identity:get_project(project_id=8cbe3d6edf8d42188dd5a3c1c2cadb2c)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:13.043472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1eb402-3668-4e58-aa7f-03971f58beff None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:13.045261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 556/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:38:12 2022] GET /identity/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:13.052144 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a8e9e-0e0e-4581-bd5e-a9f4a09bd049 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:13.100147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:13.167317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a8e9e-0e0e-4581-bd5e-a9f4a09bd049 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:13.205499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f010a7-47ce-45c6-b587-3a9979f4a2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:13.206402 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f010a7-47ce-45c6-b587-3a9979f4a2c4 None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:13.206685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f010a7-47ce-45c6-b587-3a9979f4a2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:13.206955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f010a7-47ce-45c6-b587-3a9979f4a2c4 None admin] PATH_INFO: `/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c/users/c46ac61b728b4947b9e73a90a6058787/roles/49eaa4df59ae423fa6913302fe982e4e` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:13.209365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f010a7-47ce-45c6-b587-3a9979f4a2c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cbe3d6edf8d42188dd5a3c1c2cadb2c, user_id=c46ac61b728b4947b9e73a90a6058787, role_id=49eaa4df59ae423fa6913302fe982e4e)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:13.210822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f010a7-47ce-45c6-b587-3a9979f4a2c4 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:13.226297 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 567/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:38:13 2022] PUT /identity/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c/users/c46ac61b728b4947b9e73a90a6058787/roles/49eaa4df59ae423fa6913302fe982e4e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:38:15.210548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c30b4-d219-4f20-9eea-05fcbca9e1a4 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:15.211091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c30b4-d219-4f20-9eea-05fcbca9e1a4 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:15.211091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c30b4-d219-4f20-9eea-05fcbca9e1a4 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:15.212906 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 557/1124] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:15.218855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf4e1c-8502-4003-92e3-482e5d359e78 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:15.219323 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf4e1c-8502-4003-92e3-482e5d359e78 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:15.219420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf4e1c-8502-4003-92e3-482e5d359e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:15.240068 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-11cf4e1c-8502-4003-92e3-482e5d359e78 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:15.241296 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-11cf4e1c-8502-4003-92e3-482e5d359e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:15.313550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 568/1125] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:15.342101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c30b4-d219-4f20-9eea-05fcbca9e1a4 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:15.451101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c30b4-d219-4f20-9eea-05fcbca9e1a4 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:15.486306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7da48-0a50-4ea2-a621-c88f00af9329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:15.487152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7da48-0a50-4ea2-a621-c88f00af9329 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:15.487431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7da48-0a50-4ea2-a621-c88f00af9329 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:15.487703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7da48-0a50-4ea2-a621-c88f00af9329 None admin] PATH_INFO: `/v3/roles/49eaa4df59ae423fa6913302fe982e4e` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:15.489337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7da48-0a50-4ea2-a621-c88f00af9329 None admin] RBAC: Authorizing `identity:get_role(role_id=49eaa4df59ae423fa6913302fe982e4e)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:15.490716 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7da48-0a50-4ea2-a621-c88f00af9329 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:15.492095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 558/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:38:15 2022] GET /identity/v3/roles/49eaa4df59ae423fa6913302fe982e4e => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:15.498282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf4e1c-8502-4003-92e3-482e5d359e78 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:15.529414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:15.605664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf4e1c-8502-4003-92e3-482e5d359e78 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:15.649181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a10bb-8a27-47ad-8284-7abeff5cfbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:15.650565 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a10bb-8a27-47ad-8284-7abeff5cfbd2 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:15.650987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a10bb-8a27-47ad-8284-7abeff5cfbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:15.651414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a10bb-8a27-47ad-8284-7abeff5cfbd2 None admin] PATH_INFO: `/v3/users/c46ac61b728b4947b9e73a90a6058787` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:15.653452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a10bb-8a27-47ad-8284-7abeff5cfbd2 None admin] RBAC: Authorizing `identity:get_user(user_id=c46ac61b728b4947b9e73a90a6058787)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:15.655017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a10bb-8a27-47ad-8284-7abeff5cfbd2 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:15.656681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 569/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:38:15 2022] GET /identity/v3/users/c46ac61b728b4947b9e73a90a6058787 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:15.662924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7da48-0a50-4ea2-a621-c88f00af9329 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:15.686414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:15.779754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7da48-0a50-4ea2-a621-c88f00af9329 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:15.815594 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd2127-0fab-4bfc-812d-42c8d2012b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:15.816230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd2127-0fab-4bfc-812d-42c8d2012b0f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:15.816543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd2127-0fab-4bfc-812d-42c8d2012b0f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:15.816815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd2127-0fab-4bfc-812d-42c8d2012b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:15.896776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd2127-0fab-4bfc-812d-42c8d2012b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:15.898237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd2127-0fab-4bfc-812d-42c8d2012b0f None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:15.915742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:16.012262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 559/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:38:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:38:16.021193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a10bb-8a27-47ad-8284-7abeff5cfbd2 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:16.117760 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:16.125256 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a10bb-8a27-47ad-8284-7abeff5cfbd2 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:16.162033 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dad74-27b0-4afc-857a-95c932afbd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:16.162881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dad74-27b0-4afc-857a-95c932afbd7f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:16.163162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dad74-27b0-4afc-857a-95c932afbd7f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:16.163430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dad74-27b0-4afc-857a-95c932afbd7f None admin] PATH_INFO: `/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:16.164748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dad74-27b0-4afc-857a-95c932afbd7f None admin] RBAC: Authorizing `identity:get_project(project_id=8cbe3d6edf8d42188dd5a3c1c2cadb2c)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:16.166209 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dad74-27b0-4afc-857a-95c932afbd7f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:16.167898 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 570/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:38:16 2022] GET /identity/v3/projects/8cbe3d6edf8d42188dd5a3c1c2cadb2c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:16.177300 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd2127-0fab-4bfc-812d-42c8d2012b0f None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:16.282856 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd2127-0fab-4bfc-812d-42c8d2012b0f None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:16.310953 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:16.337612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01638e40-a9c7-494d-b05a-2d9aeaa66b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:16.338582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01638e40-a9c7-494d-b05a-2d9aeaa66b9f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:16.338822 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01638e40-a9c7-494d-b05a-2d9aeaa66b9f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:16.339243 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01638e40-a9c7-494d-b05a-2d9aeaa66b9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:16.340679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01638e40-a9c7-494d-b05a-2d9aeaa66b9f None admin] RBAC: Adding query filter params (role.id=49eaa4df59ae423fa6913302fe982e4e, scope.project.id=8cbe3d6edf8d42188dd5a3c1c2cadb2c, user.id=c46ac61b728b4947b9e73a90a6058787) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:16.341032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01638e40-a9c7-494d-b05a-2d9aeaa66b9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:16.342511 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01638e40-a9c7-494d-b05a-2d9aeaa66b9f None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:16.348796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 560/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:38:16 2022] GET /identity/v3/role_assignments?user.id=c46ac61b728b4947b9e73a90a6058787&scope.project.id=8cbe3d6edf8d42188dd5a3c1c2cadb2c&role.id=49eaa4df59ae423fa6913302fe982e4e => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:18.369168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c12fc0-e2f0-4ce0-b1ab-0c23d8437d56 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:18.370049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c12fc0-e2f0-4ce0-b1ab-0c23d8437d56 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:18.370049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c12fc0-e2f0-4ce0-b1ab-0c23d8437d56 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:18.372635 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 571/1131] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:18.378843 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec754b72-0c5e-42e9-b5fd-e7ef34969e97 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:18.379511 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec754b72-0c5e-42e9-b5fd-e7ef34969e97 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:18.379700 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec754b72-0c5e-42e9-b5fd-e7ef34969e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:18.401389 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-ec754b72-0c5e-42e9-b5fd-e7ef34969e97 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:18.402564 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ec754b72-0c5e-42e9-b5fd-e7ef34969e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:18.472432 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 561/1132] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:18.506585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c12fc0-e2f0-4ce0-b1ab-0c23d8437d56 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:18.623107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c12fc0-e2f0-4ce0-b1ab-0c23d8437d56 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:18.657997 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab8f4d-22b5-4b2f-b7d6-aaa151049dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:18.658799 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab8f4d-22b5-4b2f-b7d6-aaa151049dfc None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:18.659078 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab8f4d-22b5-4b2f-b7d6-aaa151049dfc None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:18.659353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab8f4d-22b5-4b2f-b7d6-aaa151049dfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:18.660619 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab8f4d-22b5-4b2f-b7d6-aaa151049dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:18.662054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab8f4d-22b5-4b2f-b7d6-aaa151049dfc None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:18.663694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 572/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:38:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:18.673755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec754b72-0c5e-42e9-b5fd-e7ef34969e97 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:18.784093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec754b72-0c5e-42e9-b5fd-e7ef34969e97 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:18.797711 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:18.831916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b46c49-5063-498e-b8fa-51f1b41af3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:18.832612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b46c49-5063-498e-b8fa-51f1b41af3f3 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:18.832893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b46c49-5063-498e-b8fa-51f1b41af3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:18.833167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b46c49-5063-498e-b8fa-51f1b41af3f3 None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:18.833875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b46c49-5063-498e-b8fa-51f1b41af3f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:18.835315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b46c49-5063-498e-b8fa-51f1b41af3f3 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:18.864186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 562/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Jul 11 15:38:18 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:38:20.895209 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f75c2d-17f0-46fa-9827-7a6b700c2a6c None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:20.895773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f75c2d-17f0-46fa-9827-7a6b700c2a6c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:20.895773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f75c2d-17f0-46fa-9827-7a6b700c2a6c None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:20.897194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 573/1135] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:20.903478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ca46e-0f78-4df3-9507-8d4b58cef8c8 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:20.903993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ca46e-0f78-4df3-9507-8d4b58cef8c8 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:20.904171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ca46e-0f78-4df3-9507-8d4b58cef8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:20.921875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-210ca46e-0f78-4df3-9507-8d4b58cef8c8 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:20.923074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-210ca46e-0f78-4df3-9507-8d4b58cef8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:20.999015 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 563/1136] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:21.029151 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f75c2d-17f0-46fa-9827-7a6b700c2a6c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:21.062291 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:21.136480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f75c2d-17f0-46fa-9827-7a6b700c2a6c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:21.171687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed6df8-e765-4787-8f59-ea4bbe2d7e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:21.172432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed6df8-e765-4787-8f59-ea4bbe2d7e61 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:21.172718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed6df8-e765-4787-8f59-ea4bbe2d7e61 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:21.172988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed6df8-e765-4787-8f59-ea4bbe2d7e61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:21.174225 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed6df8-e765-4787-8f59-ea4bbe2d7e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:21.175666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed6df8-e765-4787-8f59-ea4bbe2d7e61 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:21.177309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 574/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:38:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:21.183206 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ca46e-0f78-4df3-9507-8d4b58cef8c8 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:21.289595 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:21.297400 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ca46e-0f78-4df3-9507-8d4b58cef8c8 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:21.333026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee6b4c-6e2d-4162-9ac2-86f8dfcf0435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:21.333688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6b4c-6e2d-4162-9ac2-86f8dfcf0435 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:21.333971 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6b4c-6e2d-4162-9ac2-86f8dfcf0435 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:21.334240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee6b4c-6e2d-4162-9ac2-86f8dfcf0435 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:21.334956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee6b4c-6e2d-4162-9ac2-86f8dfcf0435 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:21.336754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee6b4c-6e2d-4162-9ac2-86f8dfcf0435 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:21.360474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 564/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:38:21 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:38:23.392558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4693c-3e71-4139-a641-76e69a4301b5 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:23.393135 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4693c-3e71-4139-a641-76e69a4301b5 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:23.393135 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4693c-3e71-4139-a641-76e69a4301b5 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:23.394504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 575/1139] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:23.400795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cefbf-e7c1-4bbf-9657-2879c6f75191 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:23.401511 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cefbf-e7c1-4bbf-9657-2879c6f75191 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:23.401661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cefbf-e7c1-4bbf-9657-2879c6f75191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:23.426342 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-ac3cefbf-e7c1-4bbf-9657-2879c6f75191 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:23.427542 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ac3cefbf-e7c1-4bbf-9657-2879c6f75191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:23.499269 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 565/1140] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:23.528662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4693c-3e71-4139-a641-76e69a4301b5 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:23.632231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:23.637982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4693c-3e71-4139-a641-76e69a4301b5 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:23.677255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38fb38-94ec-4f76-9c99-2c4052143612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:23.678056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38fb38-94ec-4f76-9c99-2c4052143612 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:23.678341 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38fb38-94ec-4f76-9c99-2c4052143612 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:23.678619 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38fb38-94ec-4f76-9c99-2c4052143612 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:23.690414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38fb38-94ec-4f76-9c99-2c4052143612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-de38fb38-94ec-4f76-9c99-2c4052143612 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:38:23.697939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:23.699062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:23.700003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:23.700003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:23.700003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:23.700003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:23.700003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:38:23.700003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:38:23.700003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:38:23.700003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:38:23.700003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:38:23.700003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:38:23.700003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:23.700003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:38:23.700003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 576/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:38:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:38:23.705355 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cefbf-e7c1-4bbf-9657-2879c6f75191 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:23.795645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:23.816413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cefbf-e7c1-4bbf-9657-2879c6f75191 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:23.855232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185fe44-e674-4066-8d45-e4ba3f97418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:23.855905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185fe44-e674-4066-8d45-e4ba3f97418a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:23.856185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185fe44-e674-4066-8d45-e4ba3f97418a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:23.856496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185fe44-e674-4066-8d45-e4ba3f97418a None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:23.857246 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185fe44-e674-4066-8d45-e4ba3f97418a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:23.857551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185fe44-e674-4066-8d45-e4ba3f97418a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:23.858918 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185fe44-e674-4066-8d45-e4ba3f97418a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:23.867333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 566/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:38:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:23.873525 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38fb38-94ec-4f76-9c99-2c4052143612 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:23.986465 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38fb38-94ec-4f76-9c99-2c4052143612 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:24.024166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e591e-6023-45f9-8d4e-b9e6f70b0395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:24.025057 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e591e-6023-45f9-8d4e-b9e6f70b0395 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:24.025345 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e591e-6023-45f9-8d4e-b9e6f70b0395 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:24.025644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e591e-6023-45f9-8d4e-b9e6f70b0395 None admin] PATH_INFO: `/v3/users/efa6da577f1944c998579b9a23fd636a` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:24.039373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e591e-6023-45f9-8d4e-b9e6f70b0395 None admin] RBAC: Authorizing `identity:get_user(user_id=efa6da577f1944c998579b9a23fd636a)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:24.040886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e591e-6023-45f9-8d4e-b9e6f70b0395 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:24.042553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 577/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:38:23 2022] GET /identity/v3/users/efa6da577f1944c998579b9a23fd636a => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:38:24.048907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185fe44-e674-4066-8d45-e4ba3f97418a None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:24.150756 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185fe44-e674-4066-8d45-e4ba3f97418a None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:24.184059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2655324-101e-437c-b787-c4fd03c68361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:24.184755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2655324-101e-437c-b787-c4fd03c68361 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:24.185067 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2655324-101e-437c-b787-c4fd03c68361 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:24.185352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2655324-101e-437c-b787-c4fd03c68361 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:24.198170 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:24.253594 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2655324-101e-437c-b787-c4fd03c68361 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:24.255062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2655324-101e-437c-b787-c4fd03c68361 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:24.360031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 567/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:38:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:38:24.366245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e591e-6023-45f9-8d4e-b9e6f70b0395 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:24.386616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:24.478828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e591e-6023-45f9-8d4e-b9e6f70b0395 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:24.515117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dacccc-373b-4d1c-b950-07ded992f5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:24.515970 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dacccc-373b-4d1c-b950-07ded992f5fd None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:24.516247 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dacccc-373b-4d1c-b950-07ded992f5fd None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:24.516559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dacccc-373b-4d1c-b950-07ded992f5fd None admin] PATH_INFO: `/v3/projects/2b0c6513461a4702abd978e7b313b80f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:24.517802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dacccc-373b-4d1c-b950-07ded992f5fd None admin] RBAC: Authorizing `identity:get_project(project_id=2b0c6513461a4702abd978e7b313b80f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:24.519234 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dacccc-373b-4d1c-b950-07ded992f5fd None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:24.520973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 578/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:38:24 2022] GET /identity/v3/projects/2b0c6513461a4702abd978e7b313b80f => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:24.527453 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2655324-101e-437c-b787-c4fd03c68361 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:24.576263 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:24.636076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2655324-101e-437c-b787-c4fd03c68361 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:24.674120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d169ce-2485-4f60-bef3-5ebb7706843a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:24.674768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d169ce-2485-4f60-bef3-5ebb7706843a None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:24.675049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d169ce-2485-4f60-bef3-5ebb7706843a None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:24.675317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d169ce-2485-4f60-bef3-5ebb7706843a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:24.676139 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d169ce-2485-4f60-bef3-5ebb7706843a None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=2b0c6513461a4702abd978e7b313b80f, user.id=efa6da577f1944c998579b9a23fd636a) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:24.676479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d169ce-2485-4f60-bef3-5ebb7706843a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:24.677917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d169ce-2485-4f60-bef3-5ebb7706843a None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:24.683386 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 568/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:38:24 2022] GET /identity/v3/role_assignments?user.id=efa6da577f1944c998579b9a23fd636a&scope.project.id=2b0c6513461a4702abd978e7b313b80f&role.id=32f5ce5800cf40d99d894960288d0155 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:26.674410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bb6cb-3d24-4a30-8d61-112a32c64b37 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:26.674963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bb6cb-3d24-4a30-8d61-112a32c64b37 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:26.674963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bb6cb-3d24-4a30-8d61-112a32c64b37 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:26.677138 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 579/1147] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:26.685159 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d059d-87e0-4896-b1bd-1f81ad9d4de7 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:26.685624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d059d-87e0-4896-b1bd-1f81ad9d4de7 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:26.685727 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d059d-87e0-4896-b1bd-1f81ad9d4de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:26.702888 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-3e6d059d-87e0-4896-b1bd-1f81ad9d4de7 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:26.704070 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3e6d059d-87e0-4896-b1bd-1f81ad9d4de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:26.783806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 569/1148] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 15:38:26.816249 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bb6cb-3d24-4a30-8d61-112a32c64b37 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:26.911762 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:26.931437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bb6cb-3d24-4a30-8d61-112a32c64b37 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:26.971741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acf37c-b215-4e77-9f71-2377fb125554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:26.972562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acf37c-b215-4e77-9f71-2377fb125554 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:26.972843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acf37c-b215-4e77-9f71-2377fb125554 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:26.973115 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acf37c-b215-4e77-9f71-2377fb125554 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:26.983290 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acf37c-b215-4e77-9f71-2377fb125554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-c0acf37c-b215-4e77-9f71-2377fb125554 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:38:26.990777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:26.991813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:26.992757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:26.992757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:26.992757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:26.992757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:26.992757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:38:26.992757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:38:26.992757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:38:26.992757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:38:26.992757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:38:26.992757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:38:26.992757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:26.992757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:38:26.992757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 580/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:38:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:38:26.998418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d059d-87e0-4896-b1bd-1f81ad9d4de7 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:27.034611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:27.102940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d059d-87e0-4896-b1bd-1f81ad9d4de7 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:27.139045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11b2c5-163d-4161-891f-146142548a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:27.139704 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11b2c5-163d-4161-891f-146142548a26 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:27.139985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11b2c5-163d-4161-891f-146142548a26 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:27.140255 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11b2c5-163d-4161-891f-146142548a26 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:27.141038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11b2c5-163d-4161-891f-146142548a26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:27.141346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11b2c5-163d-4161-891f-146142548a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:27.142688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11b2c5-163d-4161-891f-146142548a26 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:27.150847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 570/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:38:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:27.157702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acf37c-b215-4e77-9f71-2377fb125554 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:27.270114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acf37c-b215-4e77-9f71-2377fb125554 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:27.306599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c194d6-3c09-4f43-a8d3-1f4fdea2eda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:27.307463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c194d6-3c09-4f43-a8d3-1f4fdea2eda3 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:27.307749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c194d6-3c09-4f43-a8d3-1f4fdea2eda3 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:27.308021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c194d6-3c09-4f43-a8d3-1f4fdea2eda3 None admin] PATH_INFO: `/v3/users/efa6da577f1944c998579b9a23fd636a` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:27.309375 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c194d6-3c09-4f43-a8d3-1f4fdea2eda3 None admin] RBAC: Authorizing `identity:get_user(user_id=efa6da577f1944c998579b9a23fd636a)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:27.311032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c194d6-3c09-4f43-a8d3-1f4fdea2eda3 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:27.312791 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 581/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:38:27 2022] GET /identity/v3/users/efa6da577f1944c998579b9a23fd636a => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:27.322431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11b2c5-163d-4161-891f-146142548a26 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:27.423463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:27.427407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11b2c5-163d-4161-891f-146142548a26 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:27.462930 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0a785-fe6f-4632-964c-1e6b739cfc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:27.463715 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0a785-fe6f-4632-964c-1e6b739cfc6e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:27.464007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0a785-fe6f-4632-964c-1e6b739cfc6e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:27.464275 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0a785-fe6f-4632-964c-1e6b739cfc6e None admin] PATH_INFO: `/v3/projects/2b0c6513461a4702abd978e7b313b80f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:27.465614 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0a785-fe6f-4632-964c-1e6b739cfc6e None admin] RBAC: Authorizing `identity:get_project(project_id=2b0c6513461a4702abd978e7b313b80f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:27.467107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0a785-fe6f-4632-964c-1e6b739cfc6e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:27.468836 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 571/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:38:27 2022] GET /identity/v3/projects/2b0c6513461a4702abd978e7b313b80f => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:27.474901 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c194d6-3c09-4f43-a8d3-1f4fdea2eda3 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:27.491450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:27.578502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c194d6-3c09-4f43-a8d3-1f4fdea2eda3 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:27.614008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c17d7-1929-491e-acfd-0dcff47db5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:27.614886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c17d7-1929-491e-acfd-0dcff47db5f9 None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:27.615168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c17d7-1929-491e-acfd-0dcff47db5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:27.615445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c17d7-1929-491e-acfd-0dcff47db5f9 None admin] PATH_INFO: `/v3/projects/2b0c6513461a4702abd978e7b313b80f/users/efa6da577f1944c998579b9a23fd636a/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:27.617533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c17d7-1929-491e-acfd-0dcff47db5f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b0c6513461a4702abd978e7b313b80f, user_id=efa6da577f1944c998579b9a23fd636a, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:27.618980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c17d7-1929-491e-acfd-0dcff47db5f9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:27.636077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 582/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:38:27 2022] PUT /identity/v3/projects/2b0c6513461a4702abd978e7b313b80f/users/efa6da577f1944c998579b9a23fd636a/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:38:29.620454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42524d78-8ef8-433c-82cd-f6b9501bc693 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:29.621032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42524d78-8ef8-433c-82cd-f6b9501bc693 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:29.621032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42524d78-8ef8-433c-82cd-f6b9501bc693 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:29.622413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 572/1154] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:29.628887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6fb0e-8191-498e-b039-f3c5050254db None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:29.629607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6fb0e-8191-498e-b039-f3c5050254db None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:29.629752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6fb0e-8191-498e-b039-f3c5050254db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:29.652931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-49a6fb0e-8191-498e-b039-f3c5050254db None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:29.654173 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-49a6fb0e-8191-498e-b039-f3c5050254db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:29.724479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 583/1155] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:29.749364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42524d78-8ef8-433c-82cd-f6b9501bc693 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:29.863678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42524d78-8ef8-433c-82cd-f6b9501bc693 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:29.898827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea161f5-5ccf-4a00-ad38-f1743c2e23c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:29.899537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea161f5-5ccf-4a00-ad38-f1743c2e23c5 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:29.899818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea161f5-5ccf-4a00-ad38-f1743c2e23c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:29.900068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea161f5-5ccf-4a00-ad38-f1743c2e23c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:29.913434 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea161f5-5ccf-4a00-ad38-f1743c2e23c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-2ea161f5-5ccf-4a00-ad38-f1743c2e23c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:38:29.921019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:29.922110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:29.923726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:29.923726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:29.923726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:29.923726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:29.923726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:38:29.923726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:38:29.923726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:38:29.923726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:38:29.923726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:38:29.923726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:38:29.923726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:29.923726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:38:29.923726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 573/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:38:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:38:29.932343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6fb0e-8191-498e-b039-f3c5050254db None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:29.935686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:30.075972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6fb0e-8191-498e-b039-f3c5050254db None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:30.115319 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c70c55-b42a-4995-b135-037d16191f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:30.115974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c70c55-b42a-4995-b135-037d16191f0b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:30.116260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c70c55-b42a-4995-b135-037d16191f0b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:30.116562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c70c55-b42a-4995-b135-037d16191f0b None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:30.117317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c70c55-b42a-4995-b135-037d16191f0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:30.117621 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c70c55-b42a-4995-b135-037d16191f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:30.119001 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c70c55-b42a-4995-b135-037d16191f0b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:30.127169 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 584/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:38:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:30.133769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea161f5-5ccf-4a00-ad38-f1743c2e23c5 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:30.172842 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:30.251373 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea161f5-5ccf-4a00-ad38-f1743c2e23c5 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:30.286102 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887175bc-f794-4d68-b563-15ce3b01fb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:30.286954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887175bc-f794-4d68-b563-15ce3b01fb8c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:30.287237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887175bc-f794-4d68-b563-15ce3b01fb8c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:30.287515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887175bc-f794-4d68-b563-15ce3b01fb8c None admin] PATH_INFO: `/v3/users/efa6da577f1944c998579b9a23fd636a` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:30.288848 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887175bc-f794-4d68-b563-15ce3b01fb8c None admin] RBAC: Authorizing `identity:get_user(user_id=efa6da577f1944c998579b9a23fd636a)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:30.290281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887175bc-f794-4d68-b563-15ce3b01fb8c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:30.291916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 574/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:38:30 2022] GET /identity/v3/users/efa6da577f1944c998579b9a23fd636a => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:30.298243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c70c55-b42a-4995-b135-037d16191f0b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:30.373243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:30.413948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c70c55-b42a-4995-b135-037d16191f0b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:30.448754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291648c-c059-40a2-b627-ff69e747994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:30.449335 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291648c-c059-40a2-b627-ff69e747994c None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:30.449612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291648c-c059-40a2-b627-ff69e747994c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:30.449865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291648c-c059-40a2-b627-ff69e747994c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:30.520915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291648c-c059-40a2-b627-ff69e747994c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:30.522382 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291648c-c059-40a2-b627-ff69e747994c None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:30.582798 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:30.623994 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 585/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:38:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:38:30.633030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887175bc-f794-4d68-b563-15ce3b01fb8c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:30.740240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:30.748813 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887175bc-f794-4d68-b563-15ce3b01fb8c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:30.785295 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc1b63-da0e-4c2e-bb12-5838cc450e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:30.786149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc1b63-da0e-4c2e-bb12-5838cc450e30 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:30.786426 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc1b63-da0e-4c2e-bb12-5838cc450e30 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:30.786667 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc1b63-da0e-4c2e-bb12-5838cc450e30 None admin] PATH_INFO: `/v3/projects/2b0c6513461a4702abd978e7b313b80f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:30.787993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc1b63-da0e-4c2e-bb12-5838cc450e30 None admin] RBAC: Authorizing `identity:get_project(project_id=2b0c6513461a4702abd978e7b313b80f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:30.789473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc1b63-da0e-4c2e-bb12-5838cc450e30 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:30.791193 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 575/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:38:30 2022] GET /identity/v3/projects/2b0c6513461a4702abd978e7b313b80f => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:30.798775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291648c-c059-40a2-b627-ff69e747994c None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:30.918640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291648c-c059-40a2-b627-ff69e747994c None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:30.955152 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65186e-b39b-47b4-854d-99656573433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:30.955796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65186e-b39b-47b4-854d-99656573433a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:30.956072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65186e-b39b-47b4-854d-99656573433a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:30.956350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65186e-b39b-47b4-854d-99656573433a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:30.957207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65186e-b39b-47b4-854d-99656573433a None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=2b0c6513461a4702abd978e7b313b80f, user.id=efa6da577f1944c998579b9a23fd636a) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:30.957516 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65186e-b39b-47b4-854d-99656573433a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:30.958992 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65186e-b39b-47b4-854d-99656573433a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:30.965513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 586/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:38:30 2022] GET /identity/v3/role_assignments?user.id=efa6da577f1944c998579b9a23fd636a&scope.project.id=2b0c6513461a4702abd978e7b313b80f&role.id=32f5ce5800cf40d99d894960288d0155 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:33.030638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcce34-fdb0-4770-845a-03a10eb292d5 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:33.031211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcce34-fdb0-4770-845a-03a10eb292d5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:33.031211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcce34-fdb0-4770-845a-03a10eb292d5 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:33.033372 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 576/1162] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:33.041983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8a378-bfeb-4c4d-87dd-d1e1b44c233d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:33.042405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8a378-bfeb-4c4d-87dd-d1e1b44c233d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:33.042606 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8a378-bfeb-4c4d-87dd-d1e1b44c233d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:33.062521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-bad8a378-bfeb-4c4d-87dd-d1e1b44c233d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:33.063707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-bad8a378-bfeb-4c4d-87dd-d1e1b44c233d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:33.090905 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:33.145085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 587/1163] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:33.167678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcce34-fdb0-4770-845a-03a10eb292d5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:33.277266 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcce34-fdb0-4770-845a-03a10eb292d5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:33.312587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2459ab-a493-4d9f-b774-f25ab00d24c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:33.313225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2459ab-a493-4d9f-b774-f25ab00d24c6 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:33.313508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2459ab-a493-4d9f-b774-f25ab00d24c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:33.313777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2459ab-a493-4d9f-b774-f25ab00d24c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:33.344371 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:33.384517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2459ab-a493-4d9f-b774-f25ab00d24c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:33.385977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2459ab-a493-4d9f-b774-f25ab00d24c6 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:33.493697 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 577/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:38:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:38:33.500092 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8a378-bfeb-4c4d-87dd-d1e1b44c233d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:33.629993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8a378-bfeb-4c4d-87dd-d1e1b44c233d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:33.666085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034f699-baa6-49b2-89d9-4aff7a967883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:33.666877 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034f699-baa6-49b2-89d9-4aff7a967883 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:33.667154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034f699-baa6-49b2-89d9-4aff7a967883 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:33.667418 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034f699-baa6-49b2-89d9-4aff7a967883 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:33.674957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034f699-baa6-49b2-89d9-4aff7a967883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:33.676457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034f699-baa6-49b2-89d9-4aff7a967883 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-7034f699-baa6-49b2-89d9-4aff7a967883 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:33.692455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:33.693592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:33.694691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:33.694691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:33.694691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:33.694691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:33.694691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:33.694691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:33.694691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:33.694691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:33.694691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:33.694691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:33.694691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 15:38:33.694691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:38:33.694691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 15:38:33.694691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:38:33.696455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 588/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Jul 11 15:38:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:38:33.699489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2459ab-a493-4d9f-b774-f25ab00d24c6 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:33.758808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:33.797181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2459ab-a493-4d9f-b774-f25ab00d24c6 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:33.832652 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a524a-96bf-4c9b-8f3a-9fa3761ac001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:33.833296 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a524a-96bf-4c9b-8f3a-9fa3761ac001 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:33.833573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a524a-96bf-4c9b-8f3a-9fa3761ac001 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:33.833846 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a524a-96bf-4c9b-8f3a-9fa3761ac001 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:33.834575 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a524a-96bf-4c9b-8f3a-9fa3761ac001 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:33.834884 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a524a-96bf-4c9b-8f3a-9fa3761ac001 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:33.836584 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a524a-96bf-4c9b-8f3a-9fa3761ac001 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:33.843747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 578/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Jul 11 15:38:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:35.826924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d953b7-8c97-42ea-98cd-3f438451a139 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:35.827769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d953b7-8c97-42ea-98cd-3f438451a139 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:35.827769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d953b7-8c97-42ea-98cd-3f438451a139 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:35.830051 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 589/1167] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:35.838925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f2c12-3c82-49b6-ab3d-5473c7e440ff None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:35.839353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f2c12-3c82-49b6-ab3d-5473c7e440ff None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:35.839540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f2c12-3c82-49b6-ab3d-5473c7e440ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:35.859808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-6d3f2c12-3c82-49b6-ab3d-5473c7e440ff None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:35.861051 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6d3f2c12-3c82-49b6-ab3d-5473c7e440ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:35.935554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 579/1168] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:35.958329 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d953b7-8c97-42ea-98cd-3f438451a139 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:35.981138 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:36.082199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d953b7-8c97-42ea-98cd-3f438451a139 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:36.117505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9e261-7d55-4925-a110-669f9327c483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:36.118158 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9e261-7d55-4925-a110-669f9327c483 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:36.118442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9e261-7d55-4925-a110-669f9327c483 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:36.118712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9e261-7d55-4925-a110-669f9327c483 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:36.119455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9e261-7d55-4925-a110-669f9327c483 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:36.120889 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9e261-7d55-4925-a110-669f9327c483 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:36.141046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 590/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Mon Jul 11 15:38:35 2022] POST /identity/v3/domains => generated 267 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:38:38.162430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08685ef-9a10-4440-822b-9641d2aaaeda None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:38.162982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08685ef-9a10-4440-822b-9641d2aaaeda None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:38.162982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08685ef-9a10-4440-822b-9641d2aaaeda None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:38.165165 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 580/1170] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:38.174147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d35fdd-0739-4212-a8d6-d2efc451c8b2 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:38.174551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d35fdd-0739-4212-a8d6-d2efc451c8b2 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:38.174784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d35fdd-0739-4212-a8d6-d2efc451c8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:38.197581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-95d35fdd-0739-4212-a8d6-d2efc451c8b2 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:38.198789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-95d35fdd-0739-4212-a8d6-d2efc451c8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:38.286782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 591/1171] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:38.313164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08685ef-9a10-4440-822b-9641d2aaaeda None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:38.377599 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:38.423708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08685ef-9a10-4440-822b-9641d2aaaeda None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:38.458473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e4e47-0fbb-4bfd-88d6-d31dc3021d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:38.459318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4e47-0fbb-4bfd-88d6-d31dc3021d1c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:38.459595 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4e47-0fbb-4bfd-88d6-d31dc3021d1c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:38.459862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4e47-0fbb-4bfd-88d6-d31dc3021d1c None admin] PATH_INFO: `/v3/domains/1b7529aca4f84f3ab1850fe3270e4ec9` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:38.471837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e4e47-0fbb-4bfd-88d6-d31dc3021d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=1b7529aca4f84f3ab1850fe3270e4ec9)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:38.473323 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e4e47-0fbb-4bfd-88d6-d31dc3021d1c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:38.474974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 581/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Mon Jul 11 15:38:38 2022] GET /identity/v3/domains/1b7529aca4f84f3ab1850fe3270e4ec9 => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:38.481187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d35fdd-0739-4212-a8d6-d2efc451c8b2 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:38.493206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:38.598919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d35fdd-0739-4212-a8d6-d2efc451c8b2 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:38.634221 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e37f4-0d74-4dde-b410-3bccfaa05fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:38.634888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e37f4-0d74-4dde-b410-3bccfaa05fed None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:38.635169 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e37f4-0d74-4dde-b410-3bccfaa05fed None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:38.635441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e37f4-0d74-4dde-b410-3bccfaa05fed None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:38.636156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e37f4-0d74-4dde-b410-3bccfaa05fed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:38.637709 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e37f4-0d74-4dde-b410-3bccfaa05fed None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:38.669587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 592/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Jul 11 15:38:38 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:38:40.702842 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42170-1c73-4fc2-ba6c-d64409d83ce0 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:40.703735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42170-1c73-4fc2-ba6c-d64409d83ce0 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:40.703735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42170-1c73-4fc2-ba6c-d64409d83ce0 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:40.706026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 582/1174] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:40.712712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1034260-83d7-4b3d-a40b-adc2e0f71a76 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:40.713160 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1034260-83d7-4b3d-a40b-adc2e0f71a76 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:40.713262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1034260-83d7-4b3d-a40b-adc2e0f71a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:40.736776 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-e1034260-83d7-4b3d-a40b-adc2e0f71a76 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:40.737961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e1034260-83d7-4b3d-a40b-adc2e0f71a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:40.795678 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:40.809595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 593/1175] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:40.839670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a42170-1c73-4fc2-ba6c-d64409d83ce0 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:40.942947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a42170-1c73-4fc2-ba6c-d64409d83ce0 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:40.959084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:40.987344 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527114c3-d8ae-4151-9601-36d7d0dea40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:40.988654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527114c3-d8ae-4151-9601-36d7d0dea40e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:40.988995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527114c3-d8ae-4151-9601-36d7d0dea40e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:40.989338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527114c3-d8ae-4151-9601-36d7d0dea40e None admin] PATH_INFO: `/v3/domains/1b7529aca4f84f3ab1850fe3270e4ec9` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:40.991298 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527114c3-d8ae-4151-9601-36d7d0dea40e None admin] RBAC: Authorizing `identity:get_domain(domain_id=1b7529aca4f84f3ab1850fe3270e4ec9)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:40.993579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527114c3-d8ae-4151-9601-36d7d0dea40e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:40.996012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 583/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Mon Jul 11 15:38:40 2022] GET /identity/v3/domains/1b7529aca4f84f3ab1850fe3270e4ec9 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:41.002269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1034260-83d7-4b3d-a40b-adc2e0f71a76 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:41.109085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1034260-83d7-4b3d-a40b-adc2e0f71a76 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:41.145272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb53b84-2ac4-4e7b-ac1b-e6488e1dcf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:41.146298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb53b84-2ac4-4e7b-ac1b-e6488e1dcf15 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:41.146745 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb53b84-2ac4-4e7b-ac1b-e6488e1dcf15 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:41.147176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb53b84-2ac4-4e7b-ac1b-e6488e1dcf15 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:41.148350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb53b84-2ac4-4e7b-ac1b-e6488e1dcf15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:41.150645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb53b84-2ac4-4e7b-ac1b-e6488e1dcf15 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:41.177403 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 594/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:38:41 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:38:43.209764 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59248-fccb-4708-98c0-bcb6ea997efa None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:43.210605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59248-fccb-4708-98c0-bcb6ea997efa None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:43.210605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59248-fccb-4708-98c0-bcb6ea997efa None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:43.213863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 584/1178] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:43.220065 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84cc6a-7095-4e82-bbd7-486ca238fb46 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:43.220598 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84cc6a-7095-4e82-bbd7-486ca238fb46 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:43.220699 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84cc6a-7095-4e82-bbd7-486ca238fb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:43.238974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-2a84cc6a-7095-4e82-bbd7-486ca238fb46 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:43.240168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2a84cc6a-7095-4e82-bbd7-486ca238fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:43.284618 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:43.311788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 595/1179] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:43.335893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d59248-fccb-4708-98c0-bcb6ea997efa None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:43.447611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d59248-fccb-4708-98c0-bcb6ea997efa None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:43.484122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911586bf-a09e-48cf-a257-38e96a7d0208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:43.484931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911586bf-a09e-48cf-a257-38e96a7d0208 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:43.485210 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911586bf-a09e-48cf-a257-38e96a7d0208 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:43.485484 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911586bf-a09e-48cf-a257-38e96a7d0208 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:43.496936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911586bf-a09e-48cf-a257-38e96a7d0208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-911586bf-a09e-48cf-a257-38e96a7d0208 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:38:43.504880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:43.506017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:43.507267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:43.507267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:43.507267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:43.507267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:43.507267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:38:43.507267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:38:43.507267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:38:43.507267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:38:43.507267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:38:43.507267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:38:43.507267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:43.507267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:38:43.507267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 585/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:38:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:38:43.512375 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84cc6a-7095-4e82-bbd7-486ca238fb46 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:43.624658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84cc6a-7095-4e82-bbd7-486ca238fb46 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:43.660184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df936d-0088-4945-b702-c3444f66419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:43.660911 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df936d-0088-4945-b702-c3444f66419b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:43.661193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df936d-0088-4945-b702-c3444f66419b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:43.661472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df936d-0088-4945-b702-c3444f66419b None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:43.662228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df936d-0088-4945-b702-c3444f66419b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:43.662533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df936d-0088-4945-b702-c3444f66419b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:43.663926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df936d-0088-4945-b702-c3444f66419b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:43.672313 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 596/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:38:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:43.678759 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911586bf-a09e-48cf-a257-38e96a7d0208 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:43.735373 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:43.802024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911586bf-a09e-48cf-a257-38e96a7d0208 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:43.837393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfe850-76bb-4aed-bf60-f495bd778798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:43.838249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfe850-76bb-4aed-bf60-f495bd778798 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:43.838531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfe850-76bb-4aed-bf60-f495bd778798 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:43.838804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfe850-76bb-4aed-bf60-f495bd778798 None admin] PATH_INFO: `/v3/users/606e3df270cb45ac985c76b3de5b3e64` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:43.852558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfe850-76bb-4aed-bf60-f495bd778798 None admin] RBAC: Authorizing `identity:get_user(user_id=606e3df270cb45ac985c76b3de5b3e64)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:43.854023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfe850-76bb-4aed-bf60-f495bd778798 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:43.855676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 586/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:38:43 2022] GET /identity/v3/users/606e3df270cb45ac985c76b3de5b3e64 => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:43.861873 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df936d-0088-4945-b702-c3444f66419b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:43.903965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:43.967025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df936d-0088-4945-b702-c3444f66419b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:44.002741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30976e84-a9a3-4f1a-a471-27756c15f665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:44.003316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30976e84-a9a3-4f1a-a471-27756c15f665 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:44.003600 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30976e84-a9a3-4f1a-a471-27756c15f665 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:44.003874 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30976e84-a9a3-4f1a-a471-27756c15f665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:44.074008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30976e84-a9a3-4f1a-a471-27756c15f665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:44.075581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30976e84-a9a3-4f1a-a471-27756c15f665 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:44.116879 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:44.181131 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 597/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:38:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:38:44.187358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfe850-76bb-4aed-bf60-f495bd778798 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:44.295816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfe850-76bb-4aed-bf60-f495bd778798 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:44.297444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:44.334506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652d050-c00a-41f0-b794-4acadf5410c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:44.335356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652d050-c00a-41f0-b794-4acadf5410c2 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:44.335638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652d050-c00a-41f0-b794-4acadf5410c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:44.335908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652d050-c00a-41f0-b794-4acadf5410c2 None admin] PATH_INFO: `/v3/projects/3b3eb2c517424732a19e40e734551f10` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:44.337497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652d050-c00a-41f0-b794-4acadf5410c2 None admin] RBAC: Authorizing `identity:get_project(project_id=3b3eb2c517424732a19e40e734551f10)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:44.338947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652d050-c00a-41f0-b794-4acadf5410c2 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:44.340693 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 587/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:38:44 2022] GET /identity/v3/projects/3b3eb2c517424732a19e40e734551f10 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:44.347311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30976e84-a9a3-4f1a-a471-27756c15f665 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:44.473470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30976e84-a9a3-4f1a-a471-27756c15f665 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:44.514608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145a624-b870-4678-b1b0-410a685e8e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:44.515262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a624-b870-4678-b1b0-410a685e8e7f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:44.515548 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a624-b870-4678-b1b0-410a685e8e7f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:44.515816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a624-b870-4678-b1b0-410a685e8e7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:44.516689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145a624-b870-4678-b1b0-410a685e8e7f None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=3b3eb2c517424732a19e40e734551f10, user.id=606e3df270cb45ac985c76b3de5b3e64) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:44.517004 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145a624-b870-4678-b1b0-410a685e8e7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:44.518452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145a624-b870-4678-b1b0-410a685e8e7f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:44.524074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 598/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:38:44 2022] GET /identity/v3/role_assignments?user.id=606e3df270cb45ac985c76b3de5b3e64&scope.project.id=3b3eb2c517424732a19e40e734551f10&role.id=32f5ce5800cf40d99d894960288d0155 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:46.501722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54620a-36e9-489e-b4cf-af27a805dd31 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:46.502248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54620a-36e9-489e-b4cf-af27a805dd31 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:46.502248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54620a-36e9-489e-b4cf-af27a805dd31 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:46.504064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 588/1186] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:46.509518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aafb1-d76a-44cd-a7f2-ae85601a0b79 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:46.510241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aafb1-d76a-44cd-a7f2-ae85601a0b79 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:46.510410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aafb1-d76a-44cd-a7f2-ae85601a0b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:46.516869 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:46.530493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3c1aafb1-d76a-44cd-a7f2-ae85601a0b79 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:46.531688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3c1aafb1-d76a-44cd-a7f2-ae85601a0b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:46.614505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 599/1187] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:46.638101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54620a-36e9-489e-b4cf-af27a805dd31 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:46.757737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54620a-36e9-489e-b4cf-af27a805dd31 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:46.795852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f16568-86d7-4c4a-a033-51a3a9b42972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:46.796678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f16568-86d7-4c4a-a033-51a3a9b42972 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:46.796958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f16568-86d7-4c4a-a033-51a3a9b42972 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:46.797228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f16568-86d7-4c4a-a033-51a3a9b42972 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:46.809150 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f16568-86d7-4c4a-a033-51a3a9b42972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-d7f16568-86d7-4c4a-a033-51a3a9b42972 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:38:46.816781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:46.817817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:46.819333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:46.819333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:46.819333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:46.819333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:46.819333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:38:46.819333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:38:46.819333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:38:46.819333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:38:46.819333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:38:46.819333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:38:46.819333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:46.819333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:38:46.819333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 589/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:38:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:38:46.827913 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1aafb1-d76a-44cd-a7f2-ae85601a0b79 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:46.947230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1aafb1-d76a-44cd-a7f2-ae85601a0b79 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:46.978758 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:46.984365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201d327-6600-4d8b-89c8-232abb39715a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:46.985031 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201d327-6600-4d8b-89c8-232abb39715a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:46.985308 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201d327-6600-4d8b-89c8-232abb39715a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:46.985577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201d327-6600-4d8b-89c8-232abb39715a None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:46.986324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201d327-6600-4d8b-89c8-232abb39715a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:46.986623 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201d327-6600-4d8b-89c8-232abb39715a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:46.988009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201d327-6600-4d8b-89c8-232abb39715a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:46.995932 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 600/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:38:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:47.002279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f16568-86d7-4c4a-a033-51a3a9b42972 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:47.036612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:47.105134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f16568-86d7-4c4a-a033-51a3a9b42972 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:47.141661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569b3df-b459-41fe-9cfb-9ab07c4167aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:47.142523 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569b3df-b459-41fe-9cfb-9ab07c4167aa None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:47.142794 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569b3df-b459-41fe-9cfb-9ab07c4167aa None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:47.143058 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569b3df-b459-41fe-9cfb-9ab07c4167aa None admin] PATH_INFO: `/v3/users/606e3df270cb45ac985c76b3de5b3e64` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:47.144356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569b3df-b459-41fe-9cfb-9ab07c4167aa None admin] RBAC: Authorizing `identity:get_user(user_id=606e3df270cb45ac985c76b3de5b3e64)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:47.145816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569b3df-b459-41fe-9cfb-9ab07c4167aa None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:47.147464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 590/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:38:47 2022] GET /identity/v3/users/606e3df270cb45ac985c76b3de5b3e64 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:47.153649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201d327-6600-4d8b-89c8-232abb39715a None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:47.260423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201d327-6600-4d8b-89c8-232abb39715a None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:47.295471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba2fc8-8d7b-4cf4-8641-0d3e0d2b4b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:47.296325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba2fc8-8d7b-4cf4-8641-0d3e0d2b4b96 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:47.296630 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba2fc8-8d7b-4cf4-8641-0d3e0d2b4b96 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:47.296901 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba2fc8-8d7b-4cf4-8641-0d3e0d2b4b96 None admin] PATH_INFO: `/v3/projects/3b3eb2c517424732a19e40e734551f10` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:47.298204 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba2fc8-8d7b-4cf4-8641-0d3e0d2b4b96 None admin] RBAC: Authorizing `identity:get_project(project_id=3b3eb2c517424732a19e40e734551f10)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:47.299644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba2fc8-8d7b-4cf4-8641-0d3e0d2b4b96 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:47.301393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 601/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:38:47 2022] GET /identity/v3/projects/3b3eb2c517424732a19e40e734551f10 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:47.307704 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569b3df-b459-41fe-9cfb-9ab07c4167aa None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:47.410133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:47.414002 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569b3df-b459-41fe-9cfb-9ab07c4167aa None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:47.447954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe4c55-76f0-4378-9a37-a85115b891b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:47.448870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe4c55-76f0-4378-9a37-a85115b891b1 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:47.449147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe4c55-76f0-4378-9a37-a85115b891b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:47.449423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe4c55-76f0-4378-9a37-a85115b891b1 None admin] PATH_INFO: `/v3/projects/3b3eb2c517424732a19e40e734551f10/users/606e3df270cb45ac985c76b3de5b3e64/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:47.451730 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe4c55-76f0-4378-9a37-a85115b891b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b3eb2c517424732a19e40e734551f10, user_id=606e3df270cb45ac985c76b3de5b3e64, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:47.453232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe4c55-76f0-4378-9a37-a85115b891b1 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:47.472035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 591/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:38:47 2022] PUT /identity/v3/projects/3b3eb2c517424732a19e40e734551f10/users/606e3df270cb45ac985c76b3de5b3e64/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:38:49.466614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3680ac4-0e68-4c4b-af22-c020c4c893a4 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:49.467125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3680ac4-0e68-4c4b-af22-c020c4c893a4 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:49.467125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3680ac4-0e68-4c4b-af22-c020c4c893a4 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:49.469244 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 602/1193] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:38:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:38:49.477832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce6106-c927-41d2-9369-d1f2bda18d24 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:49.478244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce6106-c927-41d2-9369-d1f2bda18d24 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:49.478397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce6106-c927-41d2-9369-d1f2bda18d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:49.502743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e6ce6106-c927-41d2-9369-d1f2bda18d24 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:38:49.503928 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e6ce6106-c927-41d2-9369-d1f2bda18d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:38:49.576224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 592/1194] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:38:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:38:49.599851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3680ac4-0e68-4c4b-af22-c020c4c893a4 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:49.664776 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:49.707645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3680ac4-0e68-4c4b-af22-c020c4c893a4 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:49.742188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067ca67-dfd2-4234-84d1-6fac932c7388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:49.742905 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067ca67-dfd2-4234-84d1-6fac932c7388 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:49.743184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067ca67-dfd2-4234-84d1-6fac932c7388 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:49.743449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067ca67-dfd2-4234-84d1-6fac932c7388 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:49.753982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067ca67-dfd2-4234-84d1-6fac932c7388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-2067ca67-dfd2-4234-84d1-6fac932c7388 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:38:49.761464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:38:49.762842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:38:49.763881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:38:49.763881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:38:49.763881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:38:49.763881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:38:49.763881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:38:49.763881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:38:49.763881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:38:49.763881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:38:49.763881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:38:49.763881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:38:49.763881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:38:49.763881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:38:49.767721 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 603/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:38:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:38:49.769125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce6106-c927-41d2-9369-d1f2bda18d24 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:49.863957 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:49.878746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce6106-c927-41d2-9369-d1f2bda18d24 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:49.913349 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02083e-b3cb-4c02-a492-c84a996e0c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:49.914013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02083e-b3cb-4c02-a492-c84a996e0c21 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:49.914291 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02083e-b3cb-4c02-a492-c84a996e0c21 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:49.914561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02083e-b3cb-4c02-a492-c84a996e0c21 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:49.915312 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02083e-b3cb-4c02-a492-c84a996e0c21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:49.915612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02083e-b3cb-4c02-a492-c84a996e0c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:49.917026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02083e-b3cb-4c02-a492-c84a996e0c21 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:49.925249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 593/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:38:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:38:49.931153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067ca67-dfd2-4234-84d1-6fac932c7388 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:50.038595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067ca67-dfd2-4234-84d1-6fac932c7388 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:50.061100 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:50.080605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f9f4e-a156-4738-ac5b-0072e67dfe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:50.081937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f9f4e-a156-4738-ac5b-0072e67dfe06 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:50.082356 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f9f4e-a156-4738-ac5b-0072e67dfe06 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:50.082778 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f9f4e-a156-4738-ac5b-0072e67dfe06 None admin] PATH_INFO: `/v3/users/606e3df270cb45ac985c76b3de5b3e64` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:50.084809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f9f4e-a156-4738-ac5b-0072e67dfe06 None admin] RBAC: Authorizing `identity:get_user(user_id=606e3df270cb45ac985c76b3de5b3e64)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:50.087464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f9f4e-a156-4738-ac5b-0072e67dfe06 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:50.090087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 604/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Jul 11 15:38:49 2022] GET /identity/v3/users/606e3df270cb45ac985c76b3de5b3e64 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:50.096260 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02083e-b3cb-4c02-a492-c84a996e0c21 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:50.226728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02083e-b3cb-4c02-a492-c84a996e0c21 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:50.264277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dfa60-6a99-4393-978f-d7a7c920cf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:50.264962 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dfa60-6a99-4393-978f-d7a7c920cf33 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:50.265244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dfa60-6a99-4393-978f-d7a7c920cf33 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:50.265513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dfa60-6a99-4393-978f-d7a7c920cf33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:50.289033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:50.341429 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dfa60-6a99-4393-978f-d7a7c920cf33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:50.342899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dfa60-6a99-4393-978f-d7a7c920cf33 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:50.443609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 594/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:38:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:38:50.449987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f9f4e-a156-4738-ac5b-0072e67dfe06 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:50.556696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f9f4e-a156-4738-ac5b-0072e67dfe06 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:50.591565 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d2d6c-468e-412d-9927-eecbe098a7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:50.592432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d2d6c-468e-412d-9927-eecbe098a7f9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:50.592711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d2d6c-468e-412d-9927-eecbe098a7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:50.592983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d2d6c-468e-412d-9927-eecbe098a7f9 None admin] PATH_INFO: `/v3/projects/3b3eb2c517424732a19e40e734551f10` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:50.594264 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d2d6c-468e-412d-9927-eecbe098a7f9 None admin] RBAC: Authorizing `identity:get_project(project_id=3b3eb2c517424732a19e40e734551f10)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:50.595703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d2d6c-468e-412d-9927-eecbe098a7f9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:50.597447 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 605/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Jul 11 15:38:50 2022] GET /identity/v3/projects/3b3eb2c517424732a19e40e734551f10 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:38:50.604241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dfa60-6a99-4393-978f-d7a7c920cf33 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:38:50.653835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:38:50.706455 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dfa60-6a99-4393-978f-d7a7c920cf33 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:38:50.742638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac26b83-3f14-4239-b3f2-fe2c24ce4d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:38:50.743278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac26b83-3f14-4239-b3f2-fe2c24ce4d7b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:38:50.743564 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac26b83-3f14-4239-b3f2-fe2c24ce4d7b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:38:50.743837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac26b83-3f14-4239-b3f2-fe2c24ce4d7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:38:50.744702 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac26b83-3f14-4239-b3f2-fe2c24ce4d7b None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=3b3eb2c517424732a19e40e734551f10, user.id=606e3df270cb45ac985c76b3de5b3e64) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:38:50.745010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac26b83-3f14-4239-b3f2-fe2c24ce4d7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:38:50.746440 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac26b83-3f14-4239-b3f2-fe2c24ce4d7b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:38:50.753069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 595/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:38:50 2022] GET /identity/v3/role_assignments?user.id=606e3df270cb45ac985c76b3de5b3e64&scope.project.id=3b3eb2c517424732a19e40e734551f10&role.id=32f5ce5800cf40d99d894960288d0155 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:00.586490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=71 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:00.749912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=43 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:46.289378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc0de-65ad-45c9-9373-710cf257c281 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:46.289987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc0de-65ad-45c9-9373-710cf257c281 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:46.289987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dc0de-65ad-45c9-9373-710cf257c281 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:46.291341 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 606/1201] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:39:46.297267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093408c-6ad2-4135-964b-0b847896167a None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:46.297748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093408c-6ad2-4135-964b-0b847896167a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:46.297846 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093408c-6ad2-4135-964b-0b847896167a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:46.315625 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-9093408c-6ad2-4135-964b-0b847896167a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:39:46.320376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9093408c-6ad2-4135-964b-0b847896167a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:39:46.399612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 596/1202] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:39:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:39:46.427483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dc0de-65ad-45c9-9373-710cf257c281 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:46.553044 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dc0de-65ad-45c9-9373-710cf257c281 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:46.591389 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c7693-22aa-4228-a95c-44b8b7faf4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:46.592308 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7693-22aa-4228-a95c-44b8b7faf4ea None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:46.592598 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7693-22aa-4228-a95c-44b8b7faf4ea None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:46.592868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7693-22aa-4228-a95c-44b8b7faf4ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:46.603811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c7693-22aa-4228-a95c-44b8b7faf4ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:46.605420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c7693-22aa-4228-a95c-44b8b7faf4ea None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-e79c7693-22aa-4228-a95c-44b8b7faf4ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:39:46.625675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:46.626945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:46.628141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:39:46.628141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:39:46.628141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:39:46.628141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:39:46.633069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093408c-6ad2-4135-964b-0b847896167a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:46.635164 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 607/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:39:46.753334 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093408c-6ad2-4135-964b-0b847896167a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:46.786104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:46.794928 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746707f3-1771-451f-8374-cf25398b9829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:46.795785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746707f3-1771-451f-8374-cf25398b9829 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:46.796567 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746707f3-1771-451f-8374-cf25398b9829 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:46.796854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746707f3-1771-451f-8374-cf25398b9829 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:46.797595 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746707f3-1771-451f-8374-cf25398b9829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:46.797949 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746707f3-1771-451f-8374-cf25398b9829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:46.799597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746707f3-1771-451f-8374-cf25398b9829 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:46.813026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 597/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:46.818802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c7693-22aa-4228-a95c-44b8b7faf4ea None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:46.882050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:46.942166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c7693-22aa-4228-a95c-44b8b7faf4ea None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:46.989864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805a74b-1d09-4577-99fc-3a9eb32def96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:46.990958 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805a74b-1d09-4577-99fc-3a9eb32def96 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:46.991424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805a74b-1d09-4577-99fc-3a9eb32def96 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:46.991736 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805a74b-1d09-4577-99fc-3a9eb32def96 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:46.992520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805a74b-1d09-4577-99fc-3a9eb32def96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:46.994073 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805a74b-1d09-4577-99fc-3a9eb32def96 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:47.017381 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 608/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Jul 11 15:39:46 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:39:49.283742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb74fc-26b5-47cd-9b1b-5a704deb65b9 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:49.283742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb74fc-26b5-47cd-9b1b-5a704deb65b9 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:49.283742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb74fc-26b5-47cd-9b1b-5a704deb65b9 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:49.283742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 598/1206] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:39:49.289341 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10be000-09cf-47fc-b807-947ad2354d68 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:49.289793 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10be000-09cf-47fc-b807-947ad2354d68 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:49.290040 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10be000-09cf-47fc-b807-947ad2354d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:49.308999 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-e10be000-09cf-47fc-b807-947ad2354d68 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:39:49.310284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e10be000-09cf-47fc-b807-947ad2354d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:39:49.390993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 609/1207] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:39:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:39:49.414845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb74fc-26b5-47cd-9b1b-5a704deb65b9 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:49.540919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb74fc-26b5-47cd-9b1b-5a704deb65b9 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:49.583245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e9f19-1bb3-4cb0-a894-8c57d3bce5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:49.584107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e9f19-1bb3-4cb0-a894-8c57d3bce5e4 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:49.584422 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e9f19-1bb3-4cb0-a894-8c57d3bce5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:49.584698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e9f19-1bb3-4cb0-a894-8c57d3bce5e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:49.597454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e9f19-1bb3-4cb0-a894-8c57d3bce5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-c32e9f19-1bb3-4cb0-a894-8c57d3bce5e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:39:49.606636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:49.607634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:49.608513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:49.608513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:49.608513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:49.608513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:49.608513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:39:49.608513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:39:49.608513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:39:49.608513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:39:49.608513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:39:49.608513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:39:49.608513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:39:49.608513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:39:49.608513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 599/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:39:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:39:49.614027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10be000-09cf-47fc-b807-947ad2354d68 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:49.665786 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:49.740988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10be000-09cf-47fc-b807-947ad2354d68 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:49.782673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aac11a-faf3-4e17-a1c8-bcaf36f2efb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:49.783352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aac11a-faf3-4e17-a1c8-bcaf36f2efb9 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:49.783634 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aac11a-faf3-4e17-a1c8-bcaf36f2efb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:49.783905 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aac11a-faf3-4e17-a1c8-bcaf36f2efb9 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:49.784707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aac11a-faf3-4e17-a1c8-bcaf36f2efb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:49.785046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aac11a-faf3-4e17-a1c8-bcaf36f2efb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:49.786433 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aac11a-faf3-4e17-a1c8-bcaf36f2efb9 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:49.795960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 610/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:39:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:49.801382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e9f19-1bb3-4cb0-a894-8c57d3bce5e4 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:49.857878 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:49.910547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e9f19-1bb3-4cb0-a894-8c57d3bce5e4 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:49.949377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d354d06-b42f-46d0-a586-cc426a4668e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:49.950446 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d354d06-b42f-46d0-a586-cc426a4668e9 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:49.950811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d354d06-b42f-46d0-a586-cc426a4668e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:49.951110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d354d06-b42f-46d0-a586-cc426a4668e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:49.963223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d354d06-b42f-46d0-a586-cc426a4668e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:49.965032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d354d06-b42f-46d0-a586-cc426a4668e9 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-7d354d06-b42f-46d0-a586-cc426a4668e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:39:49.984811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:49.986211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:49.987539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:39:49.987539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:39:49.987539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:39:49.987539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:39:49.987539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 600/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:39:49.991910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aac11a-faf3-4e17-a1c8-bcaf36f2efb9 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:50.105736 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:50.109485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aac11a-faf3-4e17-a1c8-bcaf36f2efb9 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:50.146210 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e9e39-db8b-4299-abb2-339fd0f739e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:50.146837 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e9e39-db8b-4299-abb2-339fd0f739e8 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:50.147122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e9e39-db8b-4299-abb2-339fd0f739e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:50.147445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e9e39-db8b-4299-abb2-339fd0f739e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:50.148173 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e9e39-db8b-4299-abb2-339fd0f739e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:50.148490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e9e39-db8b-4299-abb2-339fd0f739e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:50.149877 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e9e39-db8b-4299-abb2-339fd0f739e8 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:50.165394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 611/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:50.171198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d354d06-b42f-46d0-a586-cc426a4668e9 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:50.288674 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d354d06-b42f-46d0-a586-cc426a4668e9 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:50.291420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:50.333336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58adad8-3de0-4b29-acb1-ea94915b57b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:50.334728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58adad8-3de0-4b29-acb1-ea94915b57b5 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:50.335260 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58adad8-3de0-4b29-acb1-ea94915b57b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:50.336073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58adad8-3de0-4b29-acb1-ea94915b57b5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:50.351743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58adad8-3de0-4b29-acb1-ea94915b57b5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:50.354501 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58adad8-3de0-4b29-acb1-ea94915b57b5 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-b58adad8-3de0-4b29-acb1-ea94915b57b5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:39:50.384505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:50.385651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:50.386743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:50.386743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:50.386743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:39:50.386743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:39:50.386743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:39:50.386743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:39:50.386743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:39:50.386743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:39:50.386743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:39:50.386743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:39:50.387302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 601/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:39:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:39:50.392810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e9e39-db8b-4299-abb2-339fd0f739e8 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:50.512561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e9e39-db8b-4299-abb2-339fd0f739e8 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:50.558667 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec98f3-cd3c-49c4-a72f-5a24b19837a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:50.559445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec98f3-cd3c-49c4-a72f-5a24b19837a3 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:50.559771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec98f3-cd3c-49c4-a72f-5a24b19837a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:50.560082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec98f3-cd3c-49c4-a72f-5a24b19837a3 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:50.560984 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec98f3-cd3c-49c4-a72f-5a24b19837a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:50.561265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec98f3-cd3c-49c4-a72f-5a24b19837a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:50.563103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec98f3-cd3c-49c4-a72f-5a24b19837a3 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:50.583458 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 612/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Jul 11 15:39:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:50.590914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58adad8-3de0-4b29-acb1-ea94915b57b5 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:50.709057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58adad8-3de0-4b29-acb1-ea94915b57b5 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:50.748693 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d96b9-56b7-4995-9ce3-1565e70f82ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:50.749352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d96b9-56b7-4995-9ce3-1565e70f82ef None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:50.749631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d96b9-56b7-4995-9ce3-1565e70f82ef None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:50.749912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d96b9-56b7-4995-9ce3-1565e70f82ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:50.782256 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:50.824192 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d96b9-56b7-4995-9ce3-1565e70f82ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:50.825802 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d96b9-56b7-4995-9ce3-1565e70f82ef None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:50.953333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 602/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:39:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:39:50.961207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec98f3-cd3c-49c4-a72f-5a24b19837a3 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:50.989556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:51.088149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec98f3-cd3c-49c4-a72f-5a24b19837a3 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:51.127928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383a3cb-0f11-4c66-bb30-54b14f947913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:51.128841 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383a3cb-0f11-4c66-bb30-54b14f947913 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:51.129141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383a3cb-0f11-4c66-bb30-54b14f947913 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:51.129486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383a3cb-0f11-4c66-bb30-54b14f947913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:51.142388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383a3cb-0f11-4c66-bb30-54b14f947913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:51.144029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383a3cb-0f11-4c66-bb30-54b14f947913 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-1383a3cb-0f11-4c66-bb30-54b14f947913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:39:51.165027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:51.166000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:51.166919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:39:51.166919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:39:51.166919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:39:51.166919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:39:51.168485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 613/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:39:51.172891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d96b9-56b7-4995-9ce3-1565e70f82ef None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:51.253726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:51.300118 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d96b9-56b7-4995-9ce3-1565e70f82ef None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:51.338383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb088c-0d60-4cc4-a1d8-f68f1ee8930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:51.339306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb088c-0d60-4cc4-a1d8-f68f1ee8930c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:51.340016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb088c-0d60-4cc4-a1d8-f68f1ee8930c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:51.340318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb088c-0d60-4cc4-a1d8-f68f1ee8930c None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:51.341181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb088c-0d60-4cc4-a1d8-f68f1ee8930c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:51.341494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb088c-0d60-4cc4-a1d8-f68f1ee8930c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:51.343035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb088c-0d60-4cc4-a1d8-f68f1ee8930c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:51.355500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 603/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:39:51.361679 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383a3cb-0f11-4c66-bb30-54b14f947913 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:51.443408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:51.476163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383a3cb-0f11-4c66-bb30-54b14f947913 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:51.513833 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8363ba-9e91-4819-b346-8e2c155e66b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:51.513833 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8363ba-9e91-4819-b346-8e2c155e66b5 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:51.514130 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8363ba-9e91-4819-b346-8e2c155e66b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:51.514344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8363ba-9e91-4819-b346-8e2c155e66b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:51.529512 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8363ba-9e91-4819-b346-8e2c155e66b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:51.530972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8363ba-9e91-4819-b346-8e2c155e66b5 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-bb8363ba-9e91-4819-b346-8e2c155e66b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:39:51.545787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:51.546797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:51.547722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:39:51.547722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:39:51.547722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:39:51.547722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:39:51.547722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:39:51.547722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:39:51.547722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:39:51.547722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:39:51.547722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 614/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:39:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:39:51.553092 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb088c-0d60-4cc4-a1d8-f68f1ee8930c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:51.671209 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb088c-0d60-4cc4-a1d8-f68f1ee8930c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:51.695459 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:51.708832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e049869-d413-4a42-baf8-4371fd656fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:51.709662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e049869-d413-4a42-baf8-4371fd656fd4 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:51.710071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e049869-d413-4a42-baf8-4371fd656fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:51.710430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e049869-d413-4a42-baf8-4371fd656fd4 None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:51.711694 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e049869-d413-4a42-baf8-4371fd656fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:51.712089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e049869-d413-4a42-baf8-4371fd656fd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:51.713698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e049869-d413-4a42-baf8-4371fd656fd4 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:51.727421 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 604/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:51.737494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8363ba-9e91-4819-b346-8e2c155e66b5 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:51.861320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8363ba-9e91-4819-b346-8e2c155e66b5 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:51.896190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:51.904701 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fcff7-8d29-49a1-8115-d4151697fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:51.905557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fcff7-8d29-49a1-8115-d4151697fd5d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:51.905948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fcff7-8d29-49a1-8115-d4151697fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:51.906322 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fcff7-8d29-49a1-8115-d4151697fd5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:51.907274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fcff7-8d29-49a1-8115-d4151697fd5d None admin] RBAC: Adding query filter params (role.id=c8fd28e5c32f4759a288774fddec4493, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=dbb5484ecb194023aa8415cb8b52ca5c) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:51.907682 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fcff7-8d29-49a1-8115-d4151697fd5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:51.909266 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fcff7-8d29-49a1-8115-d4151697fd5d None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:51.915408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 615/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:39:51 2022] GET /identity/v3/role_assignments?user.id=dbb5484ecb194023aa8415cb8b52ca5c&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c8fd28e5c32f4759a288774fddec4493 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:53.971694 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b9b8c-9cdd-43b0-ab4e-93e7ea62612f None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:53.972581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b9b8c-9cdd-43b0-ab4e-93e7ea62612f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:53.972581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b9b8c-9cdd-43b0-ab4e-93e7ea62612f None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:53.973798 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 605/1220] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:39:53.980058 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f994e-49c7-49bb-9eb2-c86102934214 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:53.980598 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f994e-49c7-49bb-9eb2-c86102934214 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:53.980762 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f994e-49c7-49bb-9eb2-c86102934214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:53.998932 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-c26f994e-49c7-49bb-9eb2-c86102934214 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:39:54.000161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c26f994e-49c7-49bb-9eb2-c86102934214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:39:54.079789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 616/1221] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:39:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:39:54.102890 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b9b8c-9cdd-43b0-ab4e-93e7ea62612f None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:54.215639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b9b8c-9cdd-43b0-ab4e-93e7ea62612f None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:54.252779 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751c987-c016-4697-92df-2d2c1f45a798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:54.253529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751c987-c016-4697-92df-2d2c1f45a798 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:54.253810 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751c987-c016-4697-92df-2d2c1f45a798 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:54.254083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751c987-c016-4697-92df-2d2c1f45a798 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:54.266768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751c987-c016-4697-92df-2d2c1f45a798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-9751c987-c016-4697-92df-2d2c1f45a798 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:39:54.274509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:54.275566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:54.276539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:54.276539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:54.276539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:54.276539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:54.276539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:39:54.276539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:39:54.276539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:39:54.276539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:39:54.276539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:39:54.276539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:39:54.276539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:39:54.276539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:39:54.276539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 606/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:39:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:39:54.282106 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f994e-49c7-49bb-9eb2-c86102934214 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:54.394086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f994e-49c7-49bb-9eb2-c86102934214 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:54.419330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:54.431740 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29872f-51f8-456d-97dd-b668fe5bf7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:54.432499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29872f-51f8-456d-97dd-b668fe5bf7e2 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:54.433391 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29872f-51f8-456d-97dd-b668fe5bf7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:54.433662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29872f-51f8-456d-97dd-b668fe5bf7e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:54.434550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29872f-51f8-456d-97dd-b668fe5bf7e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:54.434896 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29872f-51f8-456d-97dd-b668fe5bf7e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:54.436411 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29872f-51f8-456d-97dd-b668fe5bf7e2 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:54.450237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 617/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:39:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:54.451601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751c987-c016-4697-92df-2d2c1f45a798 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:54.500336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:54.562848 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751c987-c016-4697-92df-2d2c1f45a798 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:54.598813 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148d9dd-dc28-40b3-adfa-cb40127e0f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:54.599639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148d9dd-dc28-40b3-adfa-cb40127e0f3d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:54.599939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148d9dd-dc28-40b3-adfa-cb40127e0f3d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:54.600208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148d9dd-dc28-40b3-adfa-cb40127e0f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:54.613309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148d9dd-dc28-40b3-adfa-cb40127e0f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:54.614770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148d9dd-dc28-40b3-adfa-cb40127e0f3d None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-f148d9dd-dc28-40b3-adfa-cb40127e0f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:39:54.632101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:54.633350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:54.634261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:39:54.634261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:39:54.634261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:39:54.634261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:39:54.634261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 607/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:39:54.641964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29872f-51f8-456d-97dd-b668fe5bf7e2 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:54.756751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29872f-51f8-456d-97dd-b668fe5bf7e2 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:54.790782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1ec92-9933-4a17-8a17-42d52516431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:54.791451 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1ec92-9933-4a17-8a17-42d52516431d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:54.791792 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1ec92-9933-4a17-8a17-42d52516431d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:54.792242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1ec92-9933-4a17-8a17-42d52516431d None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:54.793502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1ec92-9933-4a17-8a17-42d52516431d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:54.793813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1ec92-9933-4a17-8a17-42d52516431d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:54.795207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1ec92-9933-4a17-8a17-42d52516431d None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:54.808410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 618/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:54.814551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148d9dd-dc28-40b3-adfa-cb40127e0f3d None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:54.922865 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:54.930319 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148d9dd-dc28-40b3-adfa-cb40127e0f3d None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:54.969125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9959b8a-0a59-4007-ae84-653a2128873d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:54.970025 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9959b8a-0a59-4007-ae84-653a2128873d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:54.970357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9959b8a-0a59-4007-ae84-653a2128873d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:54.970656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9959b8a-0a59-4007-ae84-653a2128873d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:54.980696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9959b8a-0a59-4007-ae84-653a2128873d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:54.982111 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9959b8a-0a59-4007-ae84-653a2128873d None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-c9959b8a-0a59-4007-ae84-653a2128873d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:39:55.003285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:55.004418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:55.005393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:55.005393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:55.005393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:39:55.005393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:39:55.005393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:39:55.005393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:39:55.005393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:39:55.005393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:39:55.005393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:39:55.005393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:39:55.005393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 608/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:39:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:39:55.013141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1ec92-9933-4a17-8a17-42d52516431d None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:55.064253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:55.124124 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1ec92-9933-4a17-8a17-42d52516431d None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:55.162187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de715bb-7792-4469-a4b8-ff4f2da7f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:55.162861 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de715bb-7792-4469-a4b8-ff4f2da7f027 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:55.163159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de715bb-7792-4469-a4b8-ff4f2da7f027 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:55.163417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de715bb-7792-4469-a4b8-ff4f2da7f027 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:55.164269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de715bb-7792-4469-a4b8-ff4f2da7f027 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:55.164599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de715bb-7792-4469-a4b8-ff4f2da7f027 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:55.166051 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de715bb-7792-4469-a4b8-ff4f2da7f027 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:55.184518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 619/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Jul 11 15:39:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:55.190021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9959b8a-0a59-4007-ae84-653a2128873d None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:55.292562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9959b8a-0a59-4007-ae84-653a2128873d None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:55.329797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3f788-8990-4ad7-9d56-e84938fe7d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:55.330592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3f788-8990-4ad7-9d56-e84938fe7d9f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:55.330868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3f788-8990-4ad7-9d56-e84938fe7d9f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:55.331135 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3f788-8990-4ad7-9d56-e84938fe7d9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:55.342309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3f788-8990-4ad7-9d56-e84938fe7d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:55.343769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3f788-8990-4ad7-9d56-e84938fe7d9f None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-a4c3f788-8990-4ad7-9d56-e84938fe7d9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:39:55.360753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:55.361690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:55.362591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:39:55.362591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:39:55.362591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:39:55.362591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:39:55.362591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 609/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:39:55.367750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de715bb-7792-4469-a4b8-ff4f2da7f027 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:55.472046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de715bb-7792-4469-a4b8-ff4f2da7f027 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:55.474292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:55.510092 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb355e02-d4fb-44b4-864c-e51aa33cf668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:55.510894 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb355e02-d4fb-44b4-864c-e51aa33cf668 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:55.511184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb355e02-d4fb-44b4-864c-e51aa33cf668 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:55.511484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb355e02-d4fb-44b4-864c-e51aa33cf668 None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:55.512322 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb355e02-d4fb-44b4-864c-e51aa33cf668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:55.512660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb355e02-d4fb-44b4-864c-e51aa33cf668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:55.514192 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb355e02-d4fb-44b4-864c-e51aa33cf668 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:55.526481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 620/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:55.532372 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3f788-8990-4ad7-9d56-e84938fe7d9f None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:55.542124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:55.646357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3f788-8990-4ad7-9d56-e84938fe7d9f None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:55.680789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cda4e-e3f7-4666-b6b0-63151b796bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:55.681601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cda4e-e3f7-4666-b6b0-63151b796bbc None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:55.681881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cda4e-e3f7-4666-b6b0-63151b796bbc None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:55.682151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cda4e-e3f7-4666-b6b0-63151b796bbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:55.689037 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cda4e-e3f7-4666-b6b0-63151b796bbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:55.690613 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cda4e-e3f7-4666-b6b0-63151b796bbc None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-c46cda4e-e3f7-4666-b6b0-63151b796bbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:39:55.704783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:55.705956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:55.707024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:39:55.707024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:39:55.707024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:39:55.707024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:39:55.707024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:39:55.707024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:39:55.707024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:39:55.707024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:39:55.707459 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 610/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:39:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:39:55.713906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb355e02-d4fb-44b4-864c-e51aa33cf668 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:55.824830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb355e02-d4fb-44b4-864c-e51aa33cf668 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:55.861702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b88a53-f523-48da-a27a-41cae88da36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:55.862374 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b88a53-f523-48da-a27a-41cae88da36b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:55.862655 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b88a53-f523-48da-a27a-41cae88da36b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:55.862929 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b88a53-f523-48da-a27a-41cae88da36b None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:55.863734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b88a53-f523-48da-a27a-41cae88da36b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:55.864044 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b88a53-f523-48da-a27a-41cae88da36b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:55.865551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b88a53-f523-48da-a27a-41cae88da36b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:55.877737 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 621/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:39:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:55.884043 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cda4e-e3f7-4666-b6b0-63151b796bbc None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:55.958523 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:55.995942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cda4e-e3f7-4666-b6b0-63151b796bbc None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:56.032229 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339278f-7fd8-42ad-bafb-ccc739df8740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:56.033159 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339278f-7fd8-42ad-bafb-ccc739df8740 None admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:56.033439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339278f-7fd8-42ad-bafb-ccc739df8740 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:56.033721 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339278f-7fd8-42ad-bafb-ccc739df8740 None admin] PATH_INFO: `/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/dbb5484ecb194023aa8415cb8b52ca5c/roles/c8fd28e5c32f4759a288774fddec4493` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:56.048171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339278f-7fd8-42ad-bafb-ccc739df8740 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fe17aeb94ad42dc990c9d963dac9af6, user_id=dbb5484ecb194023aa8415cb8b52ca5c, role_id=c8fd28e5c32f4759a288774fddec4493)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:56.049659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339278f-7fd8-42ad-bafb-ccc739df8740 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:56.065247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 611/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:39:55 2022] PUT /identity/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/dbb5484ecb194023aa8415cb8b52ca5c/roles/c8fd28e5c32f4759a288774fddec4493 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:39:58.146495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04212-a33d-4072-8744-74105b2ca102 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:58.147093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04212-a33d-4072-8744-74105b2ca102 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:58.147330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04212-a33d-4072-8744-74105b2ca102 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:58.148711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 622/1233] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:39:58.154554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450e265-b3bc-45c0-8b1a-fb40eaf8e89b None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:58.154996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450e265-b3bc-45c0-8b1a-fb40eaf8e89b None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:58.155114 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450e265-b3bc-45c0-8b1a-fb40eaf8e89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:58.172238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-0450e265-b3bc-45c0-8b1a-fb40eaf8e89b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:39:58.173447 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-0450e265-b3bc-45c0-8b1a-fb40eaf8e89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:39:58.244565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 612/1234] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:39:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:39:58.268480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a04212-a33d-4072-8744-74105b2ca102 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:58.296275 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:58.395746 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a04212-a33d-4072-8744-74105b2ca102 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:58.430915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35a004-19ce-4c20-bdcf-4d24f95875b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:58.431632 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35a004-19ce-4c20-bdcf-4d24f95875b6 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:58.431914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35a004-19ce-4c20-bdcf-4d24f95875b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:58.432190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35a004-19ce-4c20-bdcf-4d24f95875b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:58.443205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35a004-19ce-4c20-bdcf-4d24f95875b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-ee35a004-19ce-4c20-bdcf-4d24f95875b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:39:58.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:58.452148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:58.453072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:58.453072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:58.453072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:58.453072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:58.453072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:39:58.453072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:39:58.453072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:39:58.453072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:39:58.453072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:39:58.453072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:39:58.453072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 15:39:58.453072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:39:58.453072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 623/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Jul 11 15:39:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:39:58.458787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450e265-b3bc-45c0-8b1a-fb40eaf8e89b None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:58.508211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:58.565893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450e265-b3bc-45c0-8b1a-fb40eaf8e89b None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:58.603694 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d48da-1234-4bab-b6ba-5e44d7ec8720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:58.604558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d48da-1234-4bab-b6ba-5e44d7ec8720 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:58.605184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d48da-1234-4bab-b6ba-5e44d7ec8720 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:58.605184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d48da-1234-4bab-b6ba-5e44d7ec8720 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:58.606138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d48da-1234-4bab-b6ba-5e44d7ec8720 None admin] RBAC: Adding query filter params (name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:58.606472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d48da-1234-4bab-b6ba-5e44d7ec8720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:58.608281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d48da-1234-4bab-b6ba-5e44d7ec8720 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:58.619097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 613/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Jul 11 15:39:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:58.626588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35a004-19ce-4c20-bdcf-4d24f95875b6 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:58.719169 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:58.736566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35a004-19ce-4c20-bdcf-4d24f95875b6 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:58.771299 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b850d-283f-40c8-bcb5-b362e06c7ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:58.772111 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b850d-283f-40c8-bcb5-b362e06c7ca3 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:58.772424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b850d-283f-40c8-bcb5-b362e06c7ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:58.772699 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b850d-283f-40c8-bcb5-b362e06c7ca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:58.783641 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b850d-283f-40c8-bcb5-b362e06c7ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:58.785162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b850d-283f-40c8-bcb5-b362e06c7ca3 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-6b3b850d-283f-40c8-bcb5-b362e06c7ca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:39:58.802338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:58.803448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:58.804515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:39:58.804515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:39:58.804515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:39:58.804515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:39:58.804515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 624/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:39:58.810579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d48da-1234-4bab-b6ba-5e44d7ec8720 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:58.919609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d48da-1234-4bab-b6ba-5e44d7ec8720 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:58.929360 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:58.955309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43df91d-0f0d-4881-8b61-134ee9e78ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:58.955950 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df91d-0f0d-4881-8b61-134ee9e78ca0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:58.956349 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df91d-0f0d-4881-8b61-134ee9e78ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:58.956743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df91d-0f0d-4881-8b61-134ee9e78ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:58.957442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43df91d-0f0d-4881-8b61-134ee9e78ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:58.957746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43df91d-0f0d-4881-8b61-134ee9e78ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:58.959224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43df91d-0f0d-4881-8b61-134ee9e78ca0 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:58.973554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 614/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:58.979796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b850d-283f-40c8-bcb5-b362e06c7ca3 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:59.088968 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b850d-283f-40c8-bcb5-b362e06c7ca3 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:59.123853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf86fc-130f-4b7d-b1bb-9a9d6d09ed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:59.124707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf86fc-130f-4b7d-b1bb-9a9d6d09ed30 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:59.124999 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf86fc-130f-4b7d-b1bb-9a9d6d09ed30 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:59.125579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf86fc-130f-4b7d-b1bb-9a9d6d09ed30 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:59.128046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:59.133592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf86fc-130f-4b7d-b1bb-9a9d6d09ed30 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:59.135198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf86fc-130f-4b7d-b1bb-9a9d6d09ed30 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-a4cf86fc-130f-4b7d-b1bb-9a9d6d09ed30 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:39:59.150533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:59.152595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:59.153834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:59.153834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:59.153834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:39:59.153834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:39:59.153834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:39:59.153834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:39:59.153834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:39:59.153834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:39:59.153834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:39:59.153834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:39:59.153834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 625/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:39:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:39:59.157815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43df91d-0f0d-4881-8b61-134ee9e78ca0 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:59.273873 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43df91d-0f0d-4881-8b61-134ee9e78ca0 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:59.307144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb2064-1b54-466f-96f9-90bdadb1105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:59.307946 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb2064-1b54-466f-96f9-90bdadb1105c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:59.308235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb2064-1b54-466f-96f9-90bdadb1105c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:59.308540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb2064-1b54-466f-96f9-90bdadb1105c None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:59.309393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb2064-1b54-466f-96f9-90bdadb1105c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:39:59.309706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb2064-1b54-466f-96f9-90bdadb1105c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:59.311148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb2064-1b54-466f-96f9-90bdadb1105c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:59.333492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 615/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Jul 11 15:39:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:39:59.334765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf86fc-130f-4b7d-b1bb-9a9d6d09ed30 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:59.440928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf86fc-130f-4b7d-b1bb-9a9d6d09ed30 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:59.476863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7b8d1-e45a-43e4-a77d-bf4db6d91925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:59.477523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7b8d1-e45a-43e4-a77d-bf4db6d91925 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:59.477802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7b8d1-e45a-43e4-a77d-bf4db6d91925 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:59.478083 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7b8d1-e45a-43e4-a77d-bf4db6d91925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:59.549404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:59.557396 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7b8d1-e45a-43e4-a77d-bf4db6d91925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:59.559026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7b8d1-e45a-43e4-a77d-bf4db6d91925 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:59.669441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 626/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:39:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:39:59.675353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb2064-1b54-466f-96f9-90bdadb1105c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:59.705646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:59.787474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb2064-1b54-466f-96f9-90bdadb1105c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:39:59.823248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770111b-5229-4982-8f5c-e3f9f5aff68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:39:59.823959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770111b-5229-4982-8f5c-e3f9f5aff68e None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:39:59.824241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770111b-5229-4982-8f5c-e3f9f5aff68e None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:39:59.824547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770111b-5229-4982-8f5c-e3f9f5aff68e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:39:59.835376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770111b-5229-4982-8f5c-e3f9f5aff68e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:39:59.837169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770111b-5229-4982-8f5c-e3f9f5aff68e None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-a770111b-5229-4982-8f5c-e3f9f5aff68e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:39:59.854539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:39:59.855791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:39:59.856857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:39:59.856857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:39:59.856857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:39:59.856857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:39:59.860642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 616/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:39:59.861498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7b8d1-e45a-43e4-a77d-bf4db6d91925 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:39:59.963655 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:39:59.971214 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7b8d1-e45a-43e4-a77d-bf4db6d91925 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:00.012511 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba6d50-4fe8-4312-811f-f40791c0320a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:00.013207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba6d50-4fe8-4312-811f-f40791c0320a None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:00.013538 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba6d50-4fe8-4312-811f-f40791c0320a None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:00.013816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba6d50-4fe8-4312-811f-f40791c0320a None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:00.014657 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba6d50-4fe8-4312-811f-f40791c0320a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:00.014966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba6d50-4fe8-4312-811f-f40791c0320a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:00.016563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba6d50-4fe8-4312-811f-f40791c0320a None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:00.031866 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 627/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:40:00.038006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770111b-5229-4982-8f5c-e3f9f5aff68e None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:00.126331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:00.151772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770111b-5229-4982-8f5c-e3f9f5aff68e None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:00.191744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0066b0a-d945-4275-ac0f-9362c9fe879f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:00.192576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0066b0a-d945-4275-ac0f-9362c9fe879f None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:00.192856 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0066b0a-d945-4275-ac0f-9362c9fe879f None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:00.193126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0066b0a-d945-4275-ac0f-9362c9fe879f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:00.200894 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0066b0a-d945-4275-ac0f-9362c9fe879f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:00.202533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0066b0a-d945-4275-ac0f-9362c9fe879f None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-d0066b0a-d945-4275-ac0f-9362c9fe879f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:40:00.216944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:00.218053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:00.219184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:40:00.219184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:40:00.219184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:40:00.219184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:40:00.219184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:40:00.219184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:40:00.219184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:40:00.219184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:00.219184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 617/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:00.224695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba6d50-4fe8-4312-811f-f40791c0320a None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:00.329145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba6d50-4fe8-4312-811f-f40791c0320a None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:00.370153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802df8e4-ea5b-4487-98de-7b0b2b0a630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:00.370953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df8e4-ea5b-4487-98de-7b0b2b0a630c None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:00.371238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df8e4-ea5b-4487-98de-7b0b2b0a630c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:00.371519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df8e4-ea5b-4487-98de-7b0b2b0a630c None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:00.372433 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802df8e4-ea5b-4487-98de-7b0b2b0a630c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:00.372763 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802df8e4-ea5b-4487-98de-7b0b2b0a630c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:00.374277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802df8e4-ea5b-4487-98de-7b0b2b0a630c None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:00.387549 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 628/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:40:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:40:00.393899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0066b0a-d945-4275-ac0f-9362c9fe879f None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:00.508968 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0066b0a-d945-4275-ac0f-9362c9fe879f None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:00.546096 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38214aa6-630d-4c70-87f2-f3cf15890de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:00.546893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38214aa6-630d-4c70-87f2-f3cf15890de8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:00.547183 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38214aa6-630d-4c70-87f2-f3cf15890de8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:00.547574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38214aa6-630d-4c70-87f2-f3cf15890de8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:00.548618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38214aa6-630d-4c70-87f2-f3cf15890de8 None admin] RBAC: Adding query filter params (role.id=c8fd28e5c32f4759a288774fddec4493, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=dbb5484ecb194023aa8415cb8b52ca5c) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:00.548975 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38214aa6-630d-4c70-87f2-f3cf15890de8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:00.550885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38214aa6-630d-4c70-87f2-f3cf15890de8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:00.558657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 618/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:40:00 2022] GET /identity/v3/role_assignments?user.id=dbb5484ecb194023aa8415cb8b52ca5c&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=c8fd28e5c32f4759a288774fddec4493 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:02.653695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b22b33-be75-4895-8e4b-1a0751c523ea None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:02.654301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b22b33-be75-4895-8e4b-1a0751c523ea None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:02.654301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b22b33-be75-4895-8e4b-1a0751c523ea None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:02.655629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 629/1247] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:40:02.661738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a461ee-0086-48a4-bf0f-7d870d9c4dbe None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:02.662241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a461ee-0086-48a4-bf0f-7d870d9c4dbe None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:02.662565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a461ee-0086-48a4-bf0f-7d870d9c4dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:02.669210 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:02.683751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-41a461ee-0086-48a4-bf0f-7d870d9c4dbe None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:40:02.685108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-41a461ee-0086-48a4-bf0f-7d870d9c4dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:02.759133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 619/1248] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:40:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:40:02.782808 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b22b33-be75-4895-8e4b-1a0751c523ea None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:02.801780 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:02.890888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b22b33-be75-4895-8e4b-1a0751c523ea None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:02.935211 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09336c11-d98a-4fe7-b28b-c73ab490151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:02.935952 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09336c11-d98a-4fe7-b28b-c73ab490151c None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:02.936237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09336c11-d98a-4fe7-b28b-c73ab490151c None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:02.936585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09336c11-d98a-4fe7-b28b-c73ab490151c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:02.947573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09336c11-d98a-4fe7-b28b-c73ab490151c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-09336c11-d98a-4fe7-b28b-c73ab490151c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:40:02.957039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:02.958284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:02.959353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:02.959353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:02.959353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:02.959353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:02.959353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:40:02.959353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:40:02.959353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:40:02.959353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:40:02.959353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:40:02.959353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:40:02.959353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:40:02.959353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:40:02.959353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 630/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:40:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:02.966392 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a461ee-0086-48a4-bf0f-7d870d9c4dbe None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:03.084403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a461ee-0086-48a4-bf0f-7d870d9c4dbe None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:03.115096 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:03.121342 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021cf69-c267-43df-86ac-c52da7938dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:03.122080 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021cf69-c267-43df-86ac-c52da7938dfb None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:03.122403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021cf69-c267-43df-86ac-c52da7938dfb None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:03.122769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021cf69-c267-43df-86ac-c52da7938dfb None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:03.123622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021cf69-c267-43df-86ac-c52da7938dfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:03.123930 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021cf69-c267-43df-86ac-c52da7938dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:03.125358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021cf69-c267-43df-86ac-c52da7938dfb None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:03.134805 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 620/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:40:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:03.141945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09336c11-d98a-4fe7-b28b-c73ab490151c None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:03.227613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:03.252045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09336c11-d98a-4fe7-b28b-c73ab490151c None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:03.289284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972096d-fa7a-47d0-9ffe-dc552a19e136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:03.290088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972096d-fa7a-47d0-9ffe-dc552a19e136 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:03.290412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972096d-fa7a-47d0-9ffe-dc552a19e136 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:03.290684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972096d-fa7a-47d0-9ffe-dc552a19e136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:03.303452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972096d-fa7a-47d0-9ffe-dc552a19e136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:03.304964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972096d-fa7a-47d0-9ffe-dc552a19e136 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-7972096d-fa7a-47d0-9ffe-dc552a19e136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:40:03.322816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:03.324005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:03.324991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:40:03.324991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:40:03.324991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:40:03.324991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:40:03.324991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 631/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:03.330239 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021cf69-c267-43df-86ac-c52da7938dfb None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:03.445544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021cf69-c267-43df-86ac-c52da7938dfb None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:03.484580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18ee5f-6bdc-434e-b127-1aa8a0a8f9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:03.485398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18ee5f-6bdc-434e-b127-1aa8a0a8f9fc None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:03.485712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18ee5f-6bdc-434e-b127-1aa8a0a8f9fc None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:03.486047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18ee5f-6bdc-434e-b127-1aa8a0a8f9fc None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:03.486955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18ee5f-6bdc-434e-b127-1aa8a0a8f9fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:03.487299 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18ee5f-6bdc-434e-b127-1aa8a0a8f9fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:03.488916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18ee5f-6bdc-434e-b127-1aa8a0a8f9fc None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:03.504009 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 621/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:03.510584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972096d-fa7a-47d0-9ffe-dc552a19e136 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:03.620318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972096d-fa7a-47d0-9ffe-dc552a19e136 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:03.650377 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:03.659040 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a260e9-82b5-416e-a949-c448dff20342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:03.659856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a260e9-82b5-416e-a949-c448dff20342 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:03.660182 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a260e9-82b5-416e-a949-c448dff20342 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:03.660488 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a260e9-82b5-416e-a949-c448dff20342 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:03.670357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a260e9-82b5-416e-a949-c448dff20342 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:03.671947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a260e9-82b5-416e-a949-c448dff20342 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-59a260e9-82b5-416e-a949-c448dff20342 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:40:03.688739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:03.689897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:03.690983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:03.690983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:03.690983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:40:03.690983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:40:03.690983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:40:03.690983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:40:03.690983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:40:03.690983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:40:03.690983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:40:03.690983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:40:03.690983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 632/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:40:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:03.696390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18ee5f-6bdc-434e-b127-1aa8a0a8f9fc None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:03.759649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:03.813177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18ee5f-6bdc-434e-b127-1aa8a0a8f9fc None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:03.851169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95de75-b42e-417c-9408-46d0317ac3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:03.851985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95de75-b42e-417c-9408-46d0317ac3e0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:03.852243 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95de75-b42e-417c-9408-46d0317ac3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:03.852543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95de75-b42e-417c-9408-46d0317ac3e0 None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:03.853472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95de75-b42e-417c-9408-46d0317ac3e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:03.853777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95de75-b42e-417c-9408-46d0317ac3e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:03.855380 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95de75-b42e-417c-9408-46d0317ac3e0 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:03.874482 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 622/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Jul 11 15:40:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:03.880459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a260e9-82b5-416e-a949-c448dff20342 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:04.000517 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a260e9-82b5-416e-a949-c448dff20342 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:04.038158 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abad524-d7b0-4e8b-811a-d948e4cbaff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:04.038852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abad524-d7b0-4e8b-811a-d948e4cbaff2 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:04.039132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abad524-d7b0-4e8b-811a-d948e4cbaff2 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:04.039403 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abad524-d7b0-4e8b-811a-d948e4cbaff2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:04.106610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:04.120935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abad524-d7b0-4e8b-811a-d948e4cbaff2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:04.123020 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abad524-d7b0-4e8b-811a-d948e4cbaff2 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:04.238016 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 633/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:40:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:40:04.243777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95de75-b42e-417c-9408-46d0317ac3e0 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:04.351286 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95de75-b42e-417c-9408-46d0317ac3e0 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:04.365066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:04.389011 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810753c-8329-4f69-8cfa-ae926eebe5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:04.389826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810753c-8329-4f69-8cfa-ae926eebe5a1 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:04.390107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810753c-8329-4f69-8cfa-ae926eebe5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:04.390385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810753c-8329-4f69-8cfa-ae926eebe5a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:04.401273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810753c-8329-4f69-8cfa-ae926eebe5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:04.403356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810753c-8329-4f69-8cfa-ae926eebe5a1 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-d810753c-8329-4f69-8cfa-ae926eebe5a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:40:04.423639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:04.424931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:04.426099 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:40:04.426099 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:40:04.426099 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:40:04.426099 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:04.426099 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 623/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:04.431337 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abad524-d7b0-4e8b-811a-d948e4cbaff2 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:04.536370 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:04.549399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abad524-d7b0-4e8b-811a-d948e4cbaff2 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:04.584652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8529e5-e818-425b-b138-f276aa91a46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:04.585326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8529e5-e818-425b-b138-f276aa91a46d None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:04.585609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8529e5-e818-425b-b138-f276aa91a46d None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:04.586201 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8529e5-e818-425b-b138-f276aa91a46d None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:04.586934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8529e5-e818-425b-b138-f276aa91a46d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:04.587251 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8529e5-e818-425b-b138-f276aa91a46d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:04.588768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8529e5-e818-425b-b138-f276aa91a46d None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:04.600558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 634/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:04.607288 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810753c-8329-4f69-8cfa-ae926eebe5a1 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:04.712781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810753c-8329-4f69-8cfa-ae926eebe5a1 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:04.750898 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c99bfe-e5c9-46a7-af67-32ac2b469528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:04.751763 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c99bfe-e5c9-46a7-af67-32ac2b469528 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:04.752085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c99bfe-e5c9-46a7-af67-32ac2b469528 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:04.752433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c99bfe-e5c9-46a7-af67-32ac2b469528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:04.760032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c99bfe-e5c9-46a7-af67-32ac2b469528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:04.762095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c99bfe-e5c9-46a7-af67-32ac2b469528 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-95c99bfe-e5c9-46a7-af67-32ac2b469528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:40:04.776757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:04.777688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:04.778626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:40:04.778626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:40:04.778626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:40:04.778626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:40:04.778626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:40:04.778626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:40:04.778626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:40:04.778626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:04.778626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 624/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:04.784034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8529e5-e818-425b-b138-f276aa91a46d None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:04.892809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8529e5-e818-425b-b138-f276aa91a46d None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:04.932745 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d0f80-a1b9-4568-850e-33738f1e00f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:04.933640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d0f80-a1b9-4568-850e-33738f1e00f4 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:04.933939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d0f80-a1b9-4568-850e-33738f1e00f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:04.934230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d0f80-a1b9-4568-850e-33738f1e00f4 None admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:04.935116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d0f80-a1b9-4568-850e-33738f1e00f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:04.935479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d0f80-a1b9-4568-850e-33738f1e00f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:04.936982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d0f80-a1b9-4568-850e-33738f1e00f4 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:04.950427 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 635/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:04.956706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c99bfe-e5c9-46a7-af67-32ac2b469528 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:04.990862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:05.076944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c99bfe-e5c9-46a7-af67-32ac2b469528 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:05.120539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f98a5-1372-4563-a976-3b75f454f1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:05.121202 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f98a5-1372-4563-a976-3b75f454f1ec None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:05.121485 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f98a5-1372-4563-a976-3b75f454f1ec None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:05.121750 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f98a5-1372-4563-a976-3b75f454f1ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:05.122581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f98a5-1372-4563-a976-3b75f454f1ec None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=dbb5484ecb194023aa8415cb8b52ca5c) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:05.122925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f98a5-1372-4563-a976-3b75f454f1ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:05.124435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f98a5-1372-4563-a976-3b75f454f1ec None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:05.130671 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 625/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:40:04 2022] GET /identity/v3/role_assignments?user.id=dbb5484ecb194023aa8415cb8b52ca5c&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=32f5ce5800cf40d99d894960288d0155 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:07.140872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef611305-27ba-4d84-8425-34a0e7d7c9f2 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:07.141732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef611305-27ba-4d84-8425-34a0e7d7c9f2 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:07.141732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef611305-27ba-4d84-8425-34a0e7d7c9f2 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:07.143911 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 636/1261] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:40:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:40:07.150282 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58157897-db04-45cf-a192-a3c11afd0204 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:07.151029 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58157897-db04-45cf-a192-a3c11afd0204 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:07.151344 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58157897-db04-45cf-a192-a3c11afd0204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:07.170853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-58157897-db04-45cf-a192-a3c11afd0204 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:40:07.172044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-58157897-db04-45cf-a192-a3c11afd0204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:07.243618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 626/1262] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:40:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:40:07.268077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef611305-27ba-4d84-8425-34a0e7d7c9f2 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:07.280995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:07.381984 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef611305-27ba-4d84-8425-34a0e7d7c9f2 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:07.418174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395ee78-9f24-4f5d-94e1-fd3dfa39c1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:07.418884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395ee78-9f24-4f5d-94e1-fd3dfa39c1e8 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:07.419168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395ee78-9f24-4f5d-94e1-fd3dfa39c1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:07.419447 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395ee78-9f24-4f5d-94e1-fd3dfa39c1e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:07.430215 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395ee78-9f24-4f5d-94e1-fd3dfa39c1e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-6395ee78-9f24-4f5d-94e1-fd3dfa39c1e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:40:07.437748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:07.438822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:07.440474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:07.440474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:07.440474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:07.440474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:07.440474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:40:07.440474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:40:07.440474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:40:07.440474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:40:07.440474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:40:07.440474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:40:07.440474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:40:07.440474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:40:07.440474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 637/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:40:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:07.449824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58157897-db04-45cf-a192-a3c11afd0204 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:07.473841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:07.562031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58157897-db04-45cf-a192-a3c11afd0204 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:07.598132 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbae0e6-2c4e-4f1f-9451-c03f8285f7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:07.598791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbae0e6-2c4e-4f1f-9451-c03f8285f7f8 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:07.599074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbae0e6-2c4e-4f1f-9451-c03f8285f7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:07.599349 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbae0e6-2c4e-4f1f-9451-c03f8285f7f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:07.600125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbae0e6-2c4e-4f1f-9451-c03f8285f7f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:07.600464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbae0e6-2c4e-4f1f-9451-c03f8285f7f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:07.601859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbae0e6-2c4e-4f1f-9451-c03f8285f7f8 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:07.610330 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 627/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:40:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:07.618872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395ee78-9f24-4f5d-94e1-fd3dfa39c1e8 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:07.691551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:07.730744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395ee78-9f24-4f5d-94e1-fd3dfa39c1e8 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:07.769473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca0459-6d56-41e6-baff-e55fdff00c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:07.770268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca0459-6d56-41e6-baff-e55fdff00c85 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:07.770552 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca0459-6d56-41e6-baff-e55fdff00c85 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:07.770824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca0459-6d56-41e6-baff-e55fdff00c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:07.783168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca0459-6d56-41e6-baff-e55fdff00c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:07.784687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca0459-6d56-41e6-baff-e55fdff00c85 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-54ca0459-6d56-41e6-baff-e55fdff00c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:40:07.802820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:07.803815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:07.804740 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:40:07.804740 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:40:07.804740 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:40:07.804740 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:40:07.804740 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 638/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:07.811115 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbae0e6-2c4e-4f1f-9451-c03f8285f7f8 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:07.900112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:07.922806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbae0e6-2c4e-4f1f-9451-c03f8285f7f8 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:07.959588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be27bb-ec93-4416-8d8c-5cc69069aebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:07.960182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be27bb-ec93-4416-8d8c-5cc69069aebd None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:07.960582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be27bb-ec93-4416-8d8c-5cc69069aebd None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:07.961238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be27bb-ec93-4416-8d8c-5cc69069aebd None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:07.962151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be27bb-ec93-4416-8d8c-5cc69069aebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:07.962447 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be27bb-ec93-4416-8d8c-5cc69069aebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:07.964550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be27bb-ec93-4416-8d8c-5cc69069aebd None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:07.978663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 628/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:07.985298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca0459-6d56-41e6-baff-e55fdff00c85 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:08.094752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca0459-6d56-41e6-baff-e55fdff00c85 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:08.114439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:08.129008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a868a-f12a-4d78-b6b2-c54d22dfc994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:08.129798 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a868a-f12a-4d78-b6b2-c54d22dfc994 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:08.130079 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a868a-f12a-4d78-b6b2-c54d22dfc994 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:08.130346 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a868a-f12a-4d78-b6b2-c54d22dfc994 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:08.137773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a868a-f12a-4d78-b6b2-c54d22dfc994 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:08.139210 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a868a-f12a-4d78-b6b2-c54d22dfc994 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-474a868a-f12a-4d78-b6b2-c54d22dfc994 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:40:08.153220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:08.154739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:08.155670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:08.155670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:08.155670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:40:08.155670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:40:08.155670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:40:08.155670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:40:08.155670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:40:08.155670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:40:08.155670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:40:08.155670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:40:08.155670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 639/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:40:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:08.160457 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be27bb-ec93-4416-8d8c-5cc69069aebd None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:08.273065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be27bb-ec93-4416-8d8c-5cc69069aebd None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:08.308126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0f541-5b36-4b22-8542-7ab51b4070da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:08.308815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0f541-5b36-4b22-8542-7ab51b4070da None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:08.309100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0f541-5b36-4b22-8542-7ab51b4070da None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:08.309371 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0f541-5b36-4b22-8542-7ab51b4070da None admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:08.310220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0f541-5b36-4b22-8542-7ab51b4070da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:08.310536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0f541-5b36-4b22-8542-7ab51b4070da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:08.312330 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0f541-5b36-4b22-8542-7ab51b4070da None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:08.321469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:08.331326 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 629/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Jul 11 15:40:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:08.341414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a868a-f12a-4d78-b6b2-c54d22dfc994 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:08.455583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a868a-f12a-4d78-b6b2-c54d22dfc994 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:08.490207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435b321-e3a6-4e05-afc3-4ffc9cb7e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:08.490989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435b321-e3a6-4e05-afc3-4ffc9cb7e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:08.491265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435b321-e3a6-4e05-afc3-4ffc9cb7e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:08.491532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435b321-e3a6-4e05-afc3-4ffc9cb7e5b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:08.502464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435b321-e3a6-4e05-afc3-4ffc9cb7e5b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:08.503916 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435b321-e3a6-4e05-afc3-4ffc9cb7e5b0 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-5435b321-e3a6-4e05-afc3-4ffc9cb7e5b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:40:08.521267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:08.522359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:08.523301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:40:08.523301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:40:08.523301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:40:08.523301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:40:08.523301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 640/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:08.528954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0f541-5b36-4b22-8542-7ab51b4070da None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:08.638908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0f541-5b36-4b22-8542-7ab51b4070da None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:08.683816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2d186-6cf3-431d-9901-faa500e75bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:08.684498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2d186-6cf3-431d-9901-faa500e75bea None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:08.684774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2d186-6cf3-431d-9901-faa500e75bea None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:08.685042 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2d186-6cf3-431d-9901-faa500e75bea None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:08.685765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2d186-6cf3-431d-9901-faa500e75bea None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:08.686073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2d186-6cf3-431d-9901-faa500e75bea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:08.687440 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2d186-6cf3-431d-9901-faa500e75bea None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:08.698901 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 630/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:08.705549 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435b321-e3a6-4e05-afc3-4ffc9cb7e5b0 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:08.740855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:08.814391 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435b321-e3a6-4e05-afc3-4ffc9cb7e5b0 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:08.849449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c9a98-690c-4df4-bd40-8a62a6a0a99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:08.850218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c9a98-690c-4df4-bd40-8a62a6a0a99b None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:08.850494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c9a98-690c-4df4-bd40-8a62a6a0a99b None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:08.850774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c9a98-690c-4df4-bd40-8a62a6a0a99b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:08.857773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c9a98-690c-4df4-bd40-8a62a6a0a99b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:08.859226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c9a98-690c-4df4-bd40-8a62a6a0a99b None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-930c9a98-690c-4df4-bd40-8a62a6a0a99b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:40:08.874174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:08.875157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:08.876220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:40:08.876220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:40:08.876220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:40:08.876220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:40:08.876220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:40:08.876220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:40:08.876220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:40:08.876220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:40:08.876220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 641/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:08.883758 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2d186-6cf3-431d-9901-faa500e75bea None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:08.952661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:08.998803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2d186-6cf3-431d-9901-faa500e75bea None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:09.033695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965d66d-a393-4c3d-bf2e-6cf2461da3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:09.034354 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965d66d-a393-4c3d-bf2e-6cf2461da3b0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:09.034632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965d66d-a393-4c3d-bf2e-6cf2461da3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:09.034902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965d66d-a393-4c3d-bf2e-6cf2461da3b0 None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:09.035700 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965d66d-a393-4c3d-bf2e-6cf2461da3b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:09.036014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965d66d-a393-4c3d-bf2e-6cf2461da3b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:09.037507 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965d66d-a393-4c3d-bf2e-6cf2461da3b0 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:09.049082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 631/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:40:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:09.057991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c9a98-690c-4df4-bd40-8a62a6a0a99b None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:09.159557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:09.171265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c9a98-690c-4df4-bd40-8a62a6a0a99b None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:09.208947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b13464-7f7f-4afb-87b7-b95a4a0823b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:09.209868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13464-7f7f-4afb-87b7-b95a4a0823b3 None admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:09.210147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13464-7f7f-4afb-87b7-b95a4a0823b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:09.210420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13464-7f7f-4afb-87b7-b95a4a0823b3 None admin] PATH_INFO: `/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/dbb5484ecb194023aa8415cb8b52ca5c/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:09.212960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b13464-7f7f-4afb-87b7-b95a4a0823b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fe17aeb94ad42dc990c9d963dac9af6, user_id=dbb5484ecb194023aa8415cb8b52ca5c, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:09.214622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b13464-7f7f-4afb-87b7-b95a4a0823b3 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:09.229823 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 642/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Jul 11 15:40:09 2022] PUT /identity/v3/projects/0fe17aeb94ad42dc990c9d963dac9af6/users/dbb5484ecb194023aa8415cb8b52ca5c/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:40:11.221122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bafb1-1c2f-4f32-bd93-7a2d0061c343 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:11.221654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bafb1-1c2f-4f32-bd93-7a2d0061c343 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:11.221654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bafb1-1c2f-4f32-bd93-7a2d0061c343 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:11.223047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 632/1274] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:40:11.229193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3967e53-c8ca-4b6d-bfc4-84012b4a71d4 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:11.229844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3967e53-c8ca-4b6d-bfc4-84012b4a71d4 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:11.229844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3967e53-c8ca-4b6d-bfc4-84012b4a71d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:11.253388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-d3967e53-c8ca-4b6d-bfc4-84012b4a71d4 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:40:11.254589 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d3967e53-c8ca-4b6d-bfc4-84012b4a71d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:11.324009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 643/1275] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:40:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:40:11.360200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bafb1-1c2f-4f32-bd93-7a2d0061c343 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:11.469722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bafb1-1c2f-4f32-bd93-7a2d0061c343 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:11.489144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:11.516583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd37eb-6249-43e4-8efc-1148ef44488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:11.517372 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd37eb-6249-43e4-8efc-1148ef44488c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:11.517655 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd37eb-6249-43e4-8efc-1148ef44488c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:11.517930 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd37eb-6249-43e4-8efc-1148ef44488c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:11.528922 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd37eb-6249-43e4-8efc-1148ef44488c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-c8cd37eb-6249-43e4-8efc-1148ef44488c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 15:40:11.536576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:11.537638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:11.538626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:11.538626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:11.538626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:11.538626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:11.538626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 15:40:11.538626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 15:40:11.538626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 15:40:11.538626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 15:40:11.538626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 15:40:11.538626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 15:40:11.538626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 15:40:11.538626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:11.538626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 633/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Jul 11 15:40:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:11.544049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3967e53-c8ca-4b6d-bfc4-84012b4a71d4 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:11.627001 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:11.655528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3967e53-c8ca-4b6d-bfc4-84012b4a71d4 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:11.688643 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770910cf-0d2a-4779-93dd-7394c03c09e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:11.689336 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770910cf-0d2a-4779-93dd-7394c03c09e3 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:11.689626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770910cf-0d2a-4779-93dd-7394c03c09e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:11.689889 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770910cf-0d2a-4779-93dd-7394c03c09e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:11.690646 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770910cf-0d2a-4779-93dd-7394c03c09e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:11.690947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770910cf-0d2a-4779-93dd-7394c03c09e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:11.692332 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770910cf-0d2a-4779-93dd-7394c03c09e3 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:11.700629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 644/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Jul 11 15:40:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:11.707300 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd37eb-6249-43e4-8efc-1148ef44488c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:11.816488 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd37eb-6249-43e4-8efc-1148ef44488c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:11.852001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf684c6-eb88-41f4-a617-b834139c70f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:11.852817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf684c6-eb88-41f4-a617-b834139c70f9 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:11.853094 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf684c6-eb88-41f4-a617-b834139c70f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:11.853366 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf684c6-eb88-41f4-a617-b834139c70f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:11.869850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf684c6-eb88-41f4-a617-b834139c70f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:11.871477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf684c6-eb88-41f4-a617-b834139c70f9 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-bdf684c6-eb88-41f4-a617-b834139c70f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:40:11.889435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:11.890547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:11.891506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:40:11.891506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:40:11.891506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:40:11.891506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:11.891506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 634/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:11.896781 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770910cf-0d2a-4779-93dd-7394c03c09e3 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:12.016742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770910cf-0d2a-4779-93dd-7394c03c09e3 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:12.053501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978d7ec-3116-46a0-a915-1bdeb2332bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:12.054157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d7ec-3116-46a0-a915-1bdeb2332bad None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:12.054440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d7ec-3116-46a0-a915-1bdeb2332bad None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:12.054679 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d7ec-3116-46a0-a915-1bdeb2332bad None admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:12.055435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978d7ec-3116-46a0-a915-1bdeb2332bad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:12.055735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978d7ec-3116-46a0-a915-1bdeb2332bad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:12.057139 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978d7ec-3116-46a0-a915-1bdeb2332bad None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:12.070098 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 645/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:12.076201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf684c6-eb88-41f4-a617-b834139c70f9 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:12.107988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:12.183414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf684c6-eb88-41f4-a617-b834139c70f9 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:12.222686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0da777-9e51-4ccc-b74f-49bb000078f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:12.223481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0da777-9e51-4ccc-b74f-49bb000078f1 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:12.223757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0da777-9e51-4ccc-b74f-49bb000078f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:12.224024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0da777-9e51-4ccc-b74f-49bb000078f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:12.231636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0da777-9e51-4ccc-b74f-49bb000078f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:12.233104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0da777-9e51-4ccc-b74f-49bb000078f1 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-6c0da777-9e51-4ccc-b74f-49bb000078f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 15:40:12.247479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:12.248772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:12.250598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:12.250598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:12.250598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 15:40:12.250598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 15:40:12.250598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 15:40:12.250598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 15:40:12.250598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 15:40:12.250598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 15:40:12.250598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 15:40:12.250598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:12.250598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 635/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:40:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 15:40:12.257294 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978d7ec-3116-46a0-a915-1bdeb2332bad None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:12.261649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:12.359291 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978d7ec-3116-46a0-a915-1bdeb2332bad None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:12.393962 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e346b6-3ad2-4f99-b8c0-5e6c2a0b8737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:12.394622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e346b6-3ad2-4f99-b8c0-5e6c2a0b8737 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:12.394906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e346b6-3ad2-4f99-b8c0-5e6c2a0b8737 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:12.395182 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e346b6-3ad2-4f99-b8c0-5e6c2a0b8737 None admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:12.396030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e346b6-3ad2-4f99-b8c0-5e6c2a0b8737 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:12.396337 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e346b6-3ad2-4f99-b8c0-5e6c2a0b8737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:12.397799 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e346b6-3ad2-4f99-b8c0-5e6c2a0b8737 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:12.415570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 646/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Jul 11 15:40:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:12.421749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0da777-9e51-4ccc-b74f-49bb000078f1 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:12.523010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:12.533452 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0da777-9e51-4ccc-b74f-49bb000078f1 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:12.568121 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b212a-3797-4109-8eda-e6c5d97209a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:12.568808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b212a-3797-4109-8eda-e6c5d97209a0 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:12.569083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b212a-3797-4109-8eda-e6c5d97209a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:12.569357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b212a-3797-4109-8eda-e6c5d97209a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:12.641595 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b212a-3797-4109-8eda-e6c5d97209a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:12.642984 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b212a-3797-4109-8eda-e6c5d97209a0 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:12.739195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:12.752159 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 636/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Jul 11 15:40:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 15:40:12.758972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e346b6-3ad2-4f99-b8c0-5e6c2a0b8737 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:12.824279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:12.863139 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e346b6-3ad2-4f99-b8c0-5e6c2a0b8737 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:12.899377 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef082a7-c2b0-4025-9f00-bdf250a54d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:12.900088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef082a7-c2b0-4025-9f00-bdf250a54d12 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:12.900365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef082a7-c2b0-4025-9f00-bdf250a54d12 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:12.900664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef082a7-c2b0-4025-9f00-bdf250a54d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:12.911221 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef082a7-c2b0-4025-9f00-bdf250a54d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:12.912691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef082a7-c2b0-4025-9f00-bdf250a54d12 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-bef082a7-c2b0-4025-9f00-bdf250a54d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 15:40:12.930061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:12.931062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:12.932007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 15:40:12.932007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 15:40:12.932007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 15:40:12.932007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:40:12.932007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 647/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:40:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:12.939692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b212a-3797-4109-8eda-e6c5d97209a0 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:13.054442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b212a-3797-4109-8eda-e6c5d97209a0 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:13.096377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18e0ec-b8ff-499b-96b0-447182e05fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:13.097040 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18e0ec-b8ff-499b-96b0-447182e05fd1 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:13.097345 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18e0ec-b8ff-499b-96b0-447182e05fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:13.097612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18e0ec-b8ff-499b-96b0-447182e05fd1 None admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:13.098339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18e0ec-b8ff-499b-96b0-447182e05fd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:13.098638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18e0ec-b8ff-499b-96b0-447182e05fd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:13.100022 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18e0ec-b8ff-499b-96b0-447182e05fd1 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:13.111912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 637/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Jul 11 15:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:13.118358 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef082a7-c2b0-4025-9f00-bdf250a54d12 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:13.235758 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef082a7-c2b0-4025-9f00-bdf250a54d12 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:13.251209 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:13.276068 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ccf3b-6f9e-4e42-8cb3-092d69f46c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:13.277090 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ccf3b-6f9e-4e42-8cb3-092d69f46c18 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:13.277372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ccf3b-6f9e-4e42-8cb3-092d69f46c18 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:13.277638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ccf3b-6f9e-4e42-8cb3-092d69f46c18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:13.284457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ccf3b-6f9e-4e42-8cb3-092d69f46c18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:13.285906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ccf3b-6f9e-4e42-8cb3-092d69f46c18 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application [None req-122ccf3b-6f9e-4e42-8cb3-092d69f46c18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 15:40:13.299585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:13.300644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:13.307485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 15:40:13.307485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 15:40:13.307485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 15:40:13.307485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 15:40:13.307485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 15:40:13.307485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 15:40:13.307485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 15:40:13.307485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: ERROR keystone.server.flask.application Jul 11 15:40:13.307485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 648/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Jul 11 15:40:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:13.308821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18e0ec-b8ff-499b-96b0-447182e05fd1 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:13.358600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:13.410840 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18e0ec-b8ff-499b-96b0-447182e05fd1 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:13.446712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4dde8-9b28-4e37-b099-208440e663a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:13.447624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4dde8-9b28-4e37-b099-208440e663a5 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:13.448050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4dde8-9b28-4e37-b099-208440e663a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:13.448481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4dde8-9b28-4e37-b099-208440e663a5 None admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:13.450219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4dde8-9b28-4e37-b099-208440e663a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:13.450580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4dde8-9b28-4e37-b099-208440e663a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:13.452949 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4dde8-9b28-4e37-b099-208440e663a5 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:13.470504 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 638/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Jul 11 15:40:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:13.476822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ccf3b-6f9e-4e42-8cb3-092d69f46c18 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:13.583260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ccf3b-6f9e-4e42-8cb3-092d69f46c18 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:13.629519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55736d-169e-4d33-884b-19861194af53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:13.630230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55736d-169e-4d33-884b-19861194af53 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:13.630511 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55736d-169e-4d33-884b-19861194af53 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:13.630782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55736d-169e-4d33-884b-19861194af53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:13.631626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55736d-169e-4d33-884b-19861194af53 None admin] RBAC: Adding query filter params (role.id=32f5ce5800cf40d99d894960288d0155, scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6, user.id=dbb5484ecb194023aa8415cb8b52ca5c) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:13.631938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55736d-169e-4d33-884b-19861194af53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:13.634108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55736d-169e-4d33-884b-19861194af53 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:13.641448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 649/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Jul 11 15:40:13 2022] GET /identity/v3/role_assignments?user.id=dbb5484ecb194023aa8415cb8b52ca5c&scope.project.id=0fe17aeb94ad42dc990c9d963dac9af6&role.id=32f5ce5800cf40d99d894960288d0155 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:15.670973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e3485-0302-4476-8756-7cd74ae58981 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:15.671900 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e3485-0302-4476-8756-7cd74ae58981 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:15.671900 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e3485-0302-4476-8756-7cd74ae58981 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:15.674086 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 639/1288] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:40:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:40:15.682648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2db31-7107-4913-b257-8cc69cc6af27 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:15.683171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2db31-7107-4913-b257-8cc69cc6af27 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:15.683278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2db31-7107-4913-b257-8cc69cc6af27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:15.700744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-9ad2db31-7107-4913-b257-8cc69cc6af27 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:40:15.701936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9ad2db31-7107-4913-b257-8cc69cc6af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:15.734882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:15.786207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 650/1289] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:40:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:40:15.808357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e3485-0302-4476-8756-7cd74ae58981 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:15.917572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e3485-0302-4476-8756-7cd74ae58981 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:15.928233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:15.953084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd72790-8669-4b09-bb45-84f4a01e6d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:15.954099 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd72790-8669-4b09-bb45-84f4a01e6d7b None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:15.954372 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd72790-8669-4b09-bb45-84f4a01e6d7b None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:15.954817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd72790-8669-4b09-bb45-84f4a01e6d7b None admin] PATH_INFO: `/v3/services/placement` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:15.955513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd72790-8669-4b09-bb45-84f4a01e6d7b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:15.957145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd72790-8669-4b09-bb45-84f4a01e6d7b None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-0dd72790-8669-4b09-bb45-84f4a01e6d7b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:15.972203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:15.973423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:15.974414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 640/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Jul 11 15:40:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:15.981024 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2db31-7107-4913-b257-8cc69cc6af27 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:16.094662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2db31-7107-4913-b257-8cc69cc6af27 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:16.129425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9692901-598a-418f-af32-6ae1ce260b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:16.130073 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9692901-598a-418f-af32-6ae1ce260b6f None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:16.130352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9692901-598a-418f-af32-6ae1ce260b6f None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:16.130621 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9692901-598a-418f-af32-6ae1ce260b6f None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:16.131324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9692901-598a-418f-af32-6ae1ce260b6f None admin] RBAC: Adding query filter params (name=placement) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:16.131626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9692901-598a-418f-af32-6ae1ce260b6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:16.133021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9692901-598a-418f-af32-6ae1ce260b6f None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:16.138087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 651/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Jul 11 15:40:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:16.144833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd72790-8669-4b09-bb45-84f4a01e6d7b None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:16.258454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd72790-8669-4b09-bb45-84f4a01e6d7b None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:16.294221 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11829489-354d-49d0-8175-98b36863346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:16.294874 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11829489-354d-49d0-8175-98b36863346d None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:16.295151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11829489-354d-49d0-8175-98b36863346d None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:16.295423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11829489-354d-49d0-8175-98b36863346d None admin] PATH_INFO: `/v3/services` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:16.296128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11829489-354d-49d0-8175-98b36863346d None admin] RBAC: Adding query filter params (type=placement) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:16.296463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11829489-354d-49d0-8175-98b36863346d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:16.297838 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11829489-354d-49d0-8175-98b36863346d None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:16.302478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 641/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Jul 11 15:40:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:18.284783 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7c5a9-7313-4288-97d3-1c061c04fed9 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:18.285356 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7c5a9-7313-4288-97d3-1c061c04fed9 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:18.285356 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7c5a9-7313-4288-97d3-1c061c04fed9 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:18.286705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 652/1293] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:40:18.293077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228c33f-e63d-4b8f-bb62-746d60b0a053 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:18.293790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228c33f-e63d-4b8f-bb62-746d60b0a053 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:18.293977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228c33f-e63d-4b8f-bb62-746d60b0a053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:18.322554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-7228c33f-e63d-4b8f-bb62-746d60b0a053 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:40:18.324242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7228c33f-e63d-4b8f-bb62-746d60b0a053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:18.356710 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:18.396055 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 642/1294] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:40:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:40:18.419016 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7c5a9-7313-4288-97d3-1c061c04fed9 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:18.451456 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:18.533533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7c5a9-7313-4288-97d3-1c061c04fed9 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:18.567682 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa1ee3-6dd7-461e-97bb-3f60d1381898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:18.568339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa1ee3-6dd7-461e-97bb-3f60d1381898 None admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:18.568642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa1ee3-6dd7-461e-97bb-3f60d1381898 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:18.568907 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa1ee3-6dd7-461e-97bb-3f60d1381898 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:18.569622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa1ee3-6dd7-461e-97bb-3f60d1381898 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:18.570995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa1ee3-6dd7-461e-97bb-3f60d1381898 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:18.587135 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 653/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Jul 11 15:40:18 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:40:20.580792 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecb9d3-6308-4d71-b05b-bb951726c056 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:20.581397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecb9d3-6308-4d71-b05b-bb951726c056 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:20.581397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecb9d3-6308-4d71-b05b-bb951726c056 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:20.582731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 643/1296] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:40:20.589471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164e7f9-acd4-41f7-b197-f22d91ec6e96 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:20.590216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164e7f9-acd4-41f7-b197-f22d91ec6e96 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:20.590546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164e7f9-acd4-41f7-b197-f22d91ec6e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:20.614155 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-8164e7f9-acd4-41f7-b197-f22d91ec6e96 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:40:20.615336 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8164e7f9-acd4-41f7-b197-f22d91ec6e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:20.695102 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 654/1297] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:40:20 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:40:20.726591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecb9d3-6308-4d71-b05b-bb951726c056 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:20.836883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecb9d3-6308-4d71-b05b-bb951726c056 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:20.872537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab7457-567c-4724-b98e-0ab575bf830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:20.873327 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab7457-567c-4724-b98e-0ab575bf830c None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:20.873608 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab7457-567c-4724-b98e-0ab575bf830c None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:20.873883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab7457-567c-4724-b98e-0ab575bf830c None admin] PATH_INFO: `/v3/services/placement` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:20.874535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab7457-567c-4724-b98e-0ab575bf830c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:20.875912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab7457-567c-4724-b98e-0ab575bf830c None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-2cab7457-567c-4724-b98e-0ab575bf830c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:20.888024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:20.889153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:20.889994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 644/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Jul 11 15:40:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:20.895347 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164e7f9-acd4-41f7-b197-f22d91ec6e96 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:20.917310 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:21.003156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164e7f9-acd4-41f7-b197-f22d91ec6e96 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:21.039293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb8ce7-da1a-4c0f-a319-c8cd06159552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:21.039963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb8ce7-da1a-4c0f-a319-c8cd06159552 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:21.040246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb8ce7-da1a-4c0f-a319-c8cd06159552 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:21.040553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb8ce7-da1a-4c0f-a319-c8cd06159552 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:21.041301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb8ce7-da1a-4c0f-a319-c8cd06159552 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:21.041606 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb8ce7-da1a-4c0f-a319-c8cd06159552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:21.043078 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb8ce7-da1a-4c0f-a319-c8cd06159552 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:21.048646 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 655/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Jul 11 15:40:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:21.054832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab7457-567c-4724-b98e-0ab575bf830c None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:21.089604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:21.163811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab7457-567c-4724-b98e-0ab575bf830c None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:21.199708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de65394-238d-4832-a13f-12f02e072079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:21.200407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de65394-238d-4832-a13f-12f02e072079 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:21.200694 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de65394-238d-4832-a13f-12f02e072079 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:21.200963 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de65394-238d-4832-a13f-12f02e072079 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:21.201755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de65394-238d-4832-a13f-12f02e072079 None admin] RBAC: Adding query filter params (interface=public, service_id=b86ed7f8aae34fb8ad81ccaaea1cc6e5, region_id=RegionOne) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:21.202063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de65394-238d-4832-a13f-12f02e072079 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:21.203434 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de65394-238d-4832-a13f-12f02e072079 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:21.208965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 645/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Jul 11 15:40:21 2022] GET /identity/v3/endpoints?service_id=b86ed7f8aae34fb8ad81ccaaea1cc6e5&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:21.216562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb8ce7-da1a-4c0f-a319-c8cd06159552 None admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:21.307288 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:21.328694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb8ce7-da1a-4c0f-a319-c8cd06159552 None admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:21.365883 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d57bf-ce44-4a7a-b63c-2545a5f2d840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:21.366466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d57bf-ce44-4a7a-b63c-2545a5f2d840 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:21.366746 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d57bf-ce44-4a7a-b63c-2545a5f2d840 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:21.367019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d57bf-ce44-4a7a-b63c-2545a5f2d840 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:21.367702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d57bf-ce44-4a7a-b63c-2545a5f2d840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:21.369115 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d57bf-ce44-4a7a-b63c-2545a5f2d840 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:21.376620 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 656/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Jul 11 15:40:21 2022] GET /identity/v3/services => generated 2191 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:40:23.349864 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bec02-3d80-4bee-87e8-c8d95d292f72 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:23.350420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bec02-3d80-4bee-87e8-c8d95d292f72 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:23.350420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bec02-3d80-4bee-87e8-c8d95d292f72 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:23.351791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 646/1302] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:40:23.358253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0a24c-3b56-4a32-ac68-85b86403b7d3 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:23.358997 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0a24c-3b56-4a32-ac68-85b86403b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:23.359140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0a24c-3b56-4a32-ac68-85b86403b7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:23.386388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-02d0a24c-3b56-4a32-ac68-85b86403b7d3 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:40:23.387590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-02d0a24c-3b56-4a32-ac68-85b86403b7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:40:23.459859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 657/1303] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:40:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 15:40:23.490732 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bec02-3d80-4bee-87e8-c8d95d292f72 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:23.590872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:23.602668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bec02-3d80-4bee-87e8-c8d95d292f72 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:23.639622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0d8e4-3ade-4050-accc-b69889ee98d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:23.640452 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0d8e4-3ade-4050-accc-b69889ee98d3 None admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:23.640736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0d8e4-3ade-4050-accc-b69889ee98d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:23.641013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0d8e4-3ade-4050-accc-b69889ee98d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:23.641679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0d8e4-3ade-4050-accc-b69889ee98d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:23.643068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0d8e4-3ade-4050-accc-b69889ee98d3 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application [None req-20a0d8e4-3ade-4050-accc-b69889ee98d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 15:40:23.655499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 15:40:23.656603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application with Lock( Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self._enter() Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application return self.creator() Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application created_value = creator( Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: ERROR keystone.server.flask.application Jul 11 15:40:23.657789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 647/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Jul 11 15:40:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 15:40:23.663123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0a24c-3b56-4a32-ac68-85b86403b7d3 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:23.740159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:23.766084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0a24c-3b56-4a32-ac68-85b86403b7d3 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:23.801666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103155c-a4c5-472a-b6fb-d2c570bf29a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:23.802317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103155c-a4c5-472a-b6fb-d2c570bf29a8 None admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:23.802596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103155c-a4c5-472a-b6fb-d2c570bf29a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:23.802865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103155c-a4c5-472a-b6fb-d2c570bf29a8 None admin] PATH_INFO: `/v3/services` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:23.803571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103155c-a4c5-472a-b6fb-d2c570bf29a8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:40:23.803880 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103155c-a4c5-472a-b6fb-d2c570bf29a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:23.805285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103155c-a4c5-472a-b6fb-d2c570bf29a8 None admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:23.810874 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 658/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Jul 11 15:40:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:40:23.817317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0d8e4-3ade-4050-accc-b69889ee98d3 None admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:40:23.933972 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0d8e4-3ade-4050-accc-b69889ee98d3 None admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:40:23.971515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb32e8-df83-4273-8fcb-de4c2d03ad96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:40:23.972465 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb32e8-df83-4273-8fcb-de4c2d03ad96 None admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:40:23.972746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb32e8-df83-4273-8fcb-de4c2d03ad96 None admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:40:23.973025 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb32e8-df83-4273-8fcb-de4c2d03ad96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:40:23.973768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb32e8-df83-4273-8fcb-de4c2d03ad96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:40:23.975147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb32e8-df83-4273-8fcb-de4c2d03ad96 None admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:40:23.995945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 648/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Jul 11 15:40:23 2022] POST /identity/v3/endpoints => generated 331 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:40:33.807378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=30 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:40:33.990120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:27.102441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcfbc3-ab6e-47e2-a2af-d3c53ea47738 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:27.104190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcfbc3-ab6e-47e2-a2af-d3c53ea47738 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:27.104190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcfbc3-ab6e-47e2-a2af-d3c53ea47738 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:27.108256 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 659/1307] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:41:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:41:27.110057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66504a7c-4d23-47ee-9da7-ab1ab14fee58 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:27.110813 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66504a7c-4d23-47ee-9da7-ab1ab14fee58 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:27.111239 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66504a7c-4d23-47ee-9da7-ab1ab14fee58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:27.203927 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-66504a7c-4d23-47ee-9da7-ab1ab14fee58 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:27.205439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-66504a7c-4d23-47ee-9da7-ab1ab14fee58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:27.332964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 649/1308] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:41:27.386830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a436fa-bc48-4220-8341-888e2f88f87f None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:27.386830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a436fa-bc48-4220-8341-888e2f88f87f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:27.386830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a436fa-bc48-4220-8341-888e2f88f87f None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:27.388325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 660/1309] 10.222.0.26 () {54 vars in 964 bytes} [Mon Jul 11 15:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:41:27.393937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e66bc4-b21d-4c14-92a6-dbdae61edb99 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:27.393937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e66bc4-b21d-4c14-92a6-dbdae61edb99 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:27.394233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e66bc4-b21d-4c14-92a6-dbdae61edb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:27.484314 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e1e66bc4-b21d-4c14-92a6-dbdae61edb99 None None] MFA Rules not processed for user `44a4d0441d4a423884d7adef45e2641f`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:27.485547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e1e66bc4-b21d-4c14-92a6-dbdae61edb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:27.511602 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:27.576462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 650/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Mon Jul 11 15:41:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:27.585818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a436fa-bc48-4220-8341-888e2f88f87f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:27.587643 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-82a436fa-bc48-4220-8341-888e2f88f87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:27.728096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a436fa-bc48-4220-8341-888e2f88f87f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:27.808614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec437d33-99b7-4ad7-90e4-5e216d276eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:27.809291 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec437d33-99b7-4ad7-90e4-5e216d276eda service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:27.809575 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec437d33-99b7-4ad7-90e4-5e216d276eda service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:27.809848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec437d33-99b7-4ad7-90e4-5e216d276eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:27.811504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ec437d33-99b7-4ad7-90e4-5e216d276eda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:27.871005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:27.938376 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec437d33-99b7-4ad7-90e4-5e216d276eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:27.939843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec437d33-99b7-4ad7-90e4-5e216d276eda service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:27.960845 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 661/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:30.288323 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6322fbb-fe76-4ae5-9fda-399cf074d52d None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:30.288883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6322fbb-fe76-4ae5-9fda-399cf074d52d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:30.288883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6322fbb-fe76-4ae5-9fda-399cf074d52d None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:30.290674 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 651/1312] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:41:30.295765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3f9b2-aa96-43a6-a32b-48d56d685022 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:30.296215 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3f9b2-aa96-43a6-a32b-48d56d685022 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:30.296464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3f9b2-aa96-43a6-a32b-48d56d685022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:30.383174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-49b3f9b2-aa96-43a6-a32b-48d56d685022 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:30.384698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-49b3f9b2-aa96-43a6-a32b-48d56d685022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:30.488131 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 662/1313] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:30.538424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32785cf8-1808-4f37-8bf1-68817e5c1c1b None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:30.538704 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32785cf8-1808-4f37-8bf1-68817e5c1c1b None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:30.539004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32785cf8-1808-4f37-8bf1-68817e5c1c1b None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:30.540767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 652/1314] 10.222.0.26 () {54 vars in 964 bytes} [Mon Jul 11 15:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:41:30.546847 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ca53e-56b1-45a6-8a30-9b27a8d437b3 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:30.547183 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ca53e-56b1-45a6-8a30-9b27a8d437b3 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:30.547600 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ca53e-56b1-45a6-8a30-9b27a8d437b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:30.559015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:30.646840 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-585ca53e-56b1-45a6-8a30-9b27a8d437b3 None None] MFA Rules not processed for user `44a4d0441d4a423884d7adef45e2641f`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:30.648231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-585ca53e-56b1-45a6-8a30-9b27a8d437b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:30.741195 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 663/1315] 10.222.0.26 () {58 vars in 1061 bytes} [Mon Jul 11 15:41:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:30.750998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32785cf8-1808-4f37-8bf1-68817e5c1c1b None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:30.752942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-32785cf8-1808-4f37-8bf1-68817e5c1c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:30.866465 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32785cf8-1808-4f37-8bf1-68817e5c1c1b None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:30.949988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:30.952959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43070b-b698-401f-9446-fe2ec788da28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:30.953724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43070b-b698-401f-9446-fe2ec788da28 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:30.954012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43070b-b698-401f-9446-fe2ec788da28 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:30.954321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43070b-b698-401f-9446-fe2ec788da28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:30.956472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7f43070b-b698-401f-9446-fe2ec788da28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:31.089021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43070b-b698-401f-9446-fe2ec788da28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:31.090544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43070b-b698-401f-9446-fe2ec788da28 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:31.113168 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 653/1316] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:33.853246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2d74e-b7c2-44fa-b75a-5f9ece641c59 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:33.853863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2d74e-b7c2-44fa-b75a-5f9ece641c59 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:33.853863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2d74e-b7c2-44fa-b75a-5f9ece641c59 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:33.855331 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 664/1317] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:41:33.861791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365f10a-2f13-4d64-87fa-18423d3e8ce3 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:33.862258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365f10a-2f13-4d64-87fa-18423d3e8ce3 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:33.862382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365f10a-2f13-4d64-87fa-18423d3e8ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:33.941888 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-3365f10a-2f13-4d64-87fa-18423d3e8ce3 None None] MFA Rules not processed for user `97b256ba96b24fd2b1c4c5c238befca3`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:33.943144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3365f10a-2f13-4d64-87fa-18423d3e8ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:33.998173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:34.060136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 654/1318] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:41:33 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:34.105872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2d74e-b7c2-44fa-b75a-5f9ece641c59 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:34.108220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-19c2d74e-b7c2-44fa-b75a-5f9ece641c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:34.225789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2d74e-b7c2-44fa-b75a-5f9ece641c59 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:34.228854 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:34.304689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b7c73-967c-49f9-84c0-345fc5396468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:34.305347 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7c73-967c-49f9-84c0-345fc5396468 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:34.305669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7c73-967c-49f9-84c0-345fc5396468 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:34.305973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7c73-967c-49f9-84c0-345fc5396468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:34.307655 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-764b7c73-967c-49f9-84c0-345fc5396468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:34.426538 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b7c73-967c-49f9-84c0-345fc5396468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:34.427906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b7c73-967c-49f9-84c0-345fc5396468 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:34.447052 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 665/1319] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:37.028322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2cc4f-3c4f-40ab-8746-55c69e00c440 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:37.028873 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2cc4f-3c4f-40ab-8746-55c69e00c440 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:37.028873 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2cc4f-3c4f-40ab-8746-55c69e00c440 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:37.030290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 655/1320] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:41:37.035465 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf4dd-557c-4afd-9344-c9ecb9862c56 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:37.035890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf4dd-557c-4afd-9344-c9ecb9862c56 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:37.035969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf4dd-557c-4afd-9344-c9ecb9862c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:37.075470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:37.104388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-a7acf4dd-557c-4afd-9344-c9ecb9862c56 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:37.105626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a7acf4dd-557c-4afd-9344-c9ecb9862c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:37.209194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 666/1321] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:41:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:37.251408 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2cc4f-3c4f-40ab-8746-55c69e00c440 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:37.254089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-13a2cc4f-3c4f-40ab-8746-55c69e00c440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:37.383087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2cc4f-3c4f-40ab-8746-55c69e00c440 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:37.459800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b835d0-aeab-4013-ba37-bb0922855a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:37.460817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b835d0-aeab-4013-ba37-bb0922855a85 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:37.461098 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b835d0-aeab-4013-ba37-bb0922855a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:37.461370 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b835d0-aeab-4013-ba37-bb0922855a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:37.463115 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a1b835d0-aeab-4013-ba37-bb0922855a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:37.471553 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:37.594239 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b835d0-aeab-4013-ba37-bb0922855a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:37.595703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b835d0-aeab-4013-ba37-bb0922855a85 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:37.614878 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 656/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:40.311512 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ade8-6e39-44e9-9a3d-aa003227a095 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:40.312067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ade8-6e39-44e9-9a3d-aa003227a095 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:40.312067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3ade8-6e39-44e9-9a3d-aa003227a095 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:40.313462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 667/1323] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:41:40.318941 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b36f6-a407-4929-a202-a16bd46a5ead None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:40.319377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b36f6-a407-4929-a202-a16bd46a5ead None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:40.319472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b36f6-a407-4929-a202-a16bd46a5ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:40.388474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e94b36f6-a407-4929-a202-a16bd46a5ead None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:40.389689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e94b36f6-a407-4929-a202-a16bd46a5ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:40.451829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:40.501394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 657/1324] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:40.537770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3ade8-6e39-44e9-9a3d-aa003227a095 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:40.539325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-04c3ade8-6e39-44e9-9a3d-aa003227a095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:40.651700 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3ade8-6e39-44e9-9a3d-aa003227a095 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:40.665508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:40.730212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a2d7d-2514-4563-853e-4f4325596f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:40.730741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a2d7d-2514-4563-853e-4f4325596f92 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:40.731059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a2d7d-2514-4563-853e-4f4325596f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:40.731332 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a2d7d-2514-4563-853e-4f4325596f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:40.733057 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6b3a2d7d-2514-4563-853e-4f4325596f92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:40.846940 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a2d7d-2514-4563-853e-4f4325596f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:40.848433 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a2d7d-2514-4563-853e-4f4325596f92 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:40.869969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 668/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:42.949673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f1ff-b451-4426-bef5-430246a22e8b None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:42.950204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f1ff-b451-4426-bef5-430246a22e8b None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:42.950204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f1ff-b451-4426-bef5-430246a22e8b None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:42.951495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 658/1326] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:41:42.956829 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc1bb5-a154-4a7c-8d9b-0f2087f81369 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:42.957257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc1bb5-a154-4a7c-8d9b-0f2087f81369 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:42.957388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc1bb5-a154-4a7c-8d9b-0f2087f81369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:43.007617 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:43.026815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-9edc1bb5-a154-4a7c-8d9b-0f2087f81369 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:43.028043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9edc1bb5-a154-4a7c-8d9b-0f2087f81369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:43.128731 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 669/1327] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:43.164046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701f1ff-b451-4426-bef5-430246a22e8b None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:43.166081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1701f1ff-b451-4426-bef5-430246a22e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:43.283420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701f1ff-b451-4426-bef5-430246a22e8b None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:43.361501 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73530fab-15af-4567-93e5-3a138a6d6b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:43.362160 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73530fab-15af-4567-93e5-3a138a6d6b67 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:43.362438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73530fab-15af-4567-93e5-3a138a6d6b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:43.362710 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73530fab-15af-4567-93e5-3a138a6d6b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:43.364345 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-73530fab-15af-4567-93e5-3a138a6d6b67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:43.381754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:43.476720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73530fab-15af-4567-93e5-3a138a6d6b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:43.478225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73530fab-15af-4567-93e5-3a138a6d6b67 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:43.497245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 659/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:45.576549 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe940a4e-3a0e-4bfe-acf4-7824098485ae None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:45.577132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe940a4e-3a0e-4bfe-acf4-7824098485ae None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:45.577132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe940a4e-3a0e-4bfe-acf4-7824098485ae None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:45.578665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 670/1329] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:41:45.584028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63e689-37fe-4d5c-a1f9-3c488f2cf0d4 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:45.584553 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63e689-37fe-4d5c-a1f9-3c488f2cf0d4 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:45.584748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63e689-37fe-4d5c-a1f9-3c488f2cf0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:45.651199 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-9d63e689-37fe-4d5c-a1f9-3c488f2cf0d4 None None] MFA Rules not processed for user `97b256ba96b24fd2b1c4c5c238befca3`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:45.652453 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9d63e689-37fe-4d5c-a1f9-3c488f2cf0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:45.724720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:45.758234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 660/1330] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:41:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:45.796483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe940a4e-3a0e-4bfe-acf4-7824098485ae None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:45.798021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-fe940a4e-3a0e-4bfe-acf4-7824098485ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:45.922149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe940a4e-3a0e-4bfe-acf4-7824098485ae None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:45.942424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:45.998563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea75e8-a05d-4eee-b51d-e3ed0e5ecf47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:45.999221 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea75e8-a05d-4eee-b51d-e3ed0e5ecf47 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:45.999497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea75e8-a05d-4eee-b51d-e3ed0e5ecf47 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:45.999767 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea75e8-a05d-4eee-b51d-e3ed0e5ecf47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:46.001475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b4ea75e8-a05d-4eee-b51d-e3ed0e5ecf47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:46.130480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea75e8-a05d-4eee-b51d-e3ed0e5ecf47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:46.131969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea75e8-a05d-4eee-b51d-e3ed0e5ecf47 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:46.153841 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 671/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:48.433468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d224325-7a96-4d5a-a64d-21c57d1426cb None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:48.434363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d224325-7a96-4d5a-a64d-21c57d1426cb None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:48.434363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d224325-7a96-4d5a-a64d-21c57d1426cb None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:48.436544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 661/1332] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:41:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:41:48.445344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40c54e-8446-4c90-83db-761c9e8534f8 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:48.445757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40c54e-8446-4c90-83db-761c9e8534f8 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:48.445887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40c54e-8446-4c90-83db-761c9e8534f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:48.517066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:48.520242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-fa40c54e-8446-4c90-83db-761c9e8534f8 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:48.522242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-fa40c54e-8446-4c90-83db-761c9e8534f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:48.629819 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 672/1333] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:48.666071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d224325-7a96-4d5a-a64d-21c57d1426cb None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:48.668479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2d224325-7a96-4d5a-a64d-21c57d1426cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:48.800708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d224325-7a96-4d5a-a64d-21c57d1426cb None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:48.880466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4c325-d8d4-4901-8d32-43723d0dbf62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:48.881116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c325-d8d4-4901-8d32-43723d0dbf62 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:48.881397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c325-d8d4-4901-8d32-43723d0dbf62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:48.881679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c325-d8d4-4901-8d32-43723d0dbf62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:48.883346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8dc4c325-d8d4-4901-8d32-43723d0dbf62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:48.913207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:49.010854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4c325-d8d4-4901-8d32-43723d0dbf62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:49.012368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4c325-d8d4-4901-8d32-43723d0dbf62 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:49.031614 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 662/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:51.085592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe2550-0de8-4990-ab0c-dc8abe58dc8b None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:51.086148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe2550-0de8-4990-ab0c-dc8abe58dc8b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:51.086148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe2550-0de8-4990-ab0c-dc8abe58dc8b None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:51.087604 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 673/1335] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:41:51.094089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91971c-523a-4153-bfd0-353746886983 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:51.094822 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91971c-523a-4153-bfd0-353746886983 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:51.094973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91971c-523a-4153-bfd0-353746886983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:51.165059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-bc91971c-523a-4153-bfd0-353746886983 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:51.166265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-bc91971c-523a-4153-bfd0-353746886983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:51.246478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:51.271840 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 663/1336] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:51.311931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe2550-0de8-4990-ab0c-dc8abe58dc8b None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:51.313554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a6fe2550-0de8-4990-ab0c-dc8abe58dc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:51.428128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe2550-0de8-4990-ab0c-dc8abe58dc8b None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:51.457519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:51.506248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d140-4441-43e8-b993-573265d59969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:51.506897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d140-4441-43e8-b993-573265d59969 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:51.507176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d140-4441-43e8-b993-573265d59969 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:51.507450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d140-4441-43e8-b993-573265d59969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:51.509343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5547d140-4441-43e8-b993-573265d59969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:51.646679 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d140-4441-43e8-b993-573265d59969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:51.648893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d140-4441-43e8-b993-573265d59969 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:51.669085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 674/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:41:54.015334 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a10a23-ba07-4239-9380-7e9271557a5d None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:54.016251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a10a23-ba07-4239-9380-7e9271557a5d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:54.016251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a10a23-ba07-4239-9380-7e9271557a5d None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:54.018541 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 664/1338] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:41:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:41:54.023984 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3087-150c-41f5-aa6e-5d575d114f11 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:54.024456 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3087-150c-41f5-aa6e-5d575d114f11 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:54.024558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3087-150c-41f5-aa6e-5d575d114f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:54.091743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-026c3087-150c-41f5-aa6e-5d575d114f11 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:54.092969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-026c3087-150c-41f5-aa6e-5d575d114f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:54.101399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:54.191908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 675/1339] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:41:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:54.239145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a10a23-ba07-4239-9380-7e9271557a5d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:54.241659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-05a10a23-ba07-4239-9380-7e9271557a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:54.355906 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a10a23-ba07-4239-9380-7e9271557a5d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:54.432937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f4231-643f-4378-9024-92c196152652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:54.433584 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f4231-643f-4378-9024-92c196152652 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:54.433858 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f4231-643f-4378-9024-92c196152652 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:54.434129 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f4231-643f-4378-9024-92c196152652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:54.435755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-394f4231-643f-4378-9024-92c196152652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:54.472328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:54.568894 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f4231-643f-4378-9024-92c196152652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:54.570256 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f4231-643f-4378-9024-92c196152652 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:54.589808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 665/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:41:58.567428 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834d447-4671-47bd-9997-b934ccf3b83b None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:58.567988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834d447-4671-47bd-9997-b934ccf3b83b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:58.567988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834d447-4671-47bd-9997-b934ccf3b83b None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:58.569445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 676/1341] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:41:58.574744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481b03-0cbd-4039-b7fc-e2c5f52442f2 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:58.575224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481b03-0cbd-4039-b7fc-e2c5f52442f2 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:58.575339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481b03-0cbd-4039-b7fc-e2c5f52442f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:58.641674 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-39481b03-0cbd-4039-b7fc-e2c5f52442f2 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:41:58.642917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-39481b03-0cbd-4039-b7fc-e2c5f52442f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:58.733259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:58.746301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 666/1342] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:41:58.785007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834d447-4671-47bd-9997-b934ccf3b83b None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:41:58.786534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7834d447-4671-47bd-9997-b934ccf3b83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:58.895496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834d447-4671-47bd-9997-b934ccf3b83b None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:41:58.937770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:41:58.976233 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e079c3e-bf8e-4c27-8b78-3fd9ab4b3558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:41:58.977077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079c3e-bf8e-4c27-8b78-3fd9ab4b3558 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:41:58.977352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079c3e-bf8e-4c27-8b78-3fd9ab4b3558 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:41:58.977747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079c3e-bf8e-4c27-8b78-3fd9ab4b3558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:41:58.979625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6e079c3e-bf8e-4c27-8b78-3fd9ab4b3558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:41:59.095916 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e079c3e-bf8e-4c27-8b78-3fd9ab4b3558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:41:59.097445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e079c3e-bf8e-4c27-8b78-3fd9ab4b3558 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:41:59.117690 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 677/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:01.782005 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cdc33-2708-4f93-ba1f-702e25bf9f01 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:01.782610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cdc33-2708-4f93-ba1f-702e25bf9f01 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:01.782610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cdc33-2708-4f93-ba1f-702e25bf9f01 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:01.783921 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 667/1344] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:01.790218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73226b-4557-4ac2-99f0-a5b0e3e0a91c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:01.790809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73226b-4557-4ac2-99f0-a5b0e3e0a91c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:01.790809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73226b-4557-4ac2-99f0-a5b0e3e0a91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:01.862696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-5c73226b-4557-4ac2-99f0-a5b0e3e0a91c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:01.863936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5c73226b-4557-4ac2-99f0-a5b0e3e0a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:01.883948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:01.976339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 678/1345] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:02.015148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cdc33-2708-4f93-ba1f-702e25bf9f01 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:02.016752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b45cdc33-2708-4f93-ba1f-702e25bf9f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:02.121827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cdc33-2708-4f93-ba1f-702e25bf9f01 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:02.200684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f01619-0157-43d5-ba47-ffad52da5fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:02.201352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f01619-0157-43d5-ba47-ffad52da5fcb service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:02.201636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f01619-0157-43d5-ba47-ffad52da5fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:02.201908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f01619-0157-43d5-ba47-ffad52da5fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:02.203574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-28f01619-0157-43d5-ba47-ffad52da5fcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:02.246947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:02.317826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f01619-0157-43d5-ba47-ffad52da5fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:02.319443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f01619-0157-43d5-ba47-ffad52da5fcb service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:02.339209 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 668/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:06.943489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb4153-3e8b-4f26-b4f0-024fa40a80ff None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:06.944019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb4153-3e8b-4f26-b4f0-024fa40a80ff None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:06.944019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb4153-3e8b-4f26-b4f0-024fa40a80ff None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:06.945926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 679/1347] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:06.951630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed83c0-4df4-4831-ac80-0ee521c4de8b None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:06.952108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed83c0-4df4-4831-ac80-0ee521c4de8b None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:06.952247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed83c0-4df4-4831-ac80-0ee521c4de8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:07.028650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-eeed83c0-4df4-4831-ac80-0ee521c4de8b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:07.029898 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-eeed83c0-4df4-4831-ac80-0ee521c4de8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:07.142047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:07.144646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 669/1348] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:07.183348 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb4153-3e8b-4f26-b4f0-024fa40a80ff None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:07.187309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e7bb4153-3e8b-4f26-b4f0-024fa40a80ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:07.307248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb4153-3e8b-4f26-b4f0-024fa40a80ff None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:07.359830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:07.393239 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8331f-4d2e-40d2-813e-5b0d864a67de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:07.393924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8331f-4d2e-40d2-813e-5b0d864a67de service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:07.394239 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8331f-4d2e-40d2-813e-5b0d864a67de service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:07.394523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8331f-4d2e-40d2-813e-5b0d864a67de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:07.396182 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-abd8331f-4d2e-40d2-813e-5b0d864a67de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:07.517955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8331f-4d2e-40d2-813e-5b0d864a67de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:07.519333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8331f-4d2e-40d2-813e-5b0d864a67de service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:07.539495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 680/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:12.509984 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57295a1-ca3e-4e02-a1ae-dc2f4a985b94 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:12.510516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57295a1-ca3e-4e02-a1ae-dc2f4a985b94 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:12.510620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57295a1-ca3e-4e02-a1ae-dc2f4a985b94 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:12.512837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 670/1350] 10.222.0.26 () {54 vars in 921 bytes} [Mon Jul 11 15:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:12.518199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f5218-41de-483b-9158-15fee4462e1a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:12.518618 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f5218-41de-483b-9158-15fee4462e1a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:12.518803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f5218-41de-483b-9158-15fee4462e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:12.600025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-4f7f5218-41de-483b-9158-15fee4462e1a None None] MFA Rules not processed for user `dbb5484ecb194023aa8415cb8b52ca5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:12.601389 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4f7f5218-41de-483b-9158-15fee4462e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:12.621626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:12.735347 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 681/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Jul 11 15:42:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:16.683204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b46ebc-8c96-4717-9b93-45f594e419db None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:16.683852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b46ebc-8c96-4717-9b93-45f594e419db None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:16.683852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b46ebc-8c96-4717-9b93-45f594e419db None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:16.685440 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 671/1352] 10.222.0.26 () {54 vars in 921 bytes} [Mon Jul 11 15:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:16.690872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201715e9-18c0-4ff9-9088-aa5c971a811a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:16.691328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201715e9-18c0-4ff9-9088-aa5c971a811a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:16.691419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201715e9-18c0-4ff9-9088-aa5c971a811a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:16.768521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-201715e9-18c0-4ff9-9088-aa5c971a811a None None] MFA Rules not processed for user `dbb5484ecb194023aa8415cb8b52ca5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:16.769866 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-201715e9-18c0-4ff9-9088-aa5c971a811a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:16.851170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:16.892794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 682/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Jul 11 15:42:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:18.358851 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025baace-d535-4472-85e8-c2b0bca517f5 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:18.359456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025baace-d535-4472-85e8-c2b0bca517f5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:18.359456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025baace-d535-4472-85e8-c2b0bca517f5 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:18.360807 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 672/1354] 10.222.0.26 () {54 vars in 921 bytes} [Mon Jul 11 15:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:18.366114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a750f-6492-459b-9218-52e24921916f None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:18.366549 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a750f-6492-459b-9218-52e24921916f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:18.366706 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a750f-6492-459b-9218-52e24921916f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:18.447705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-f39a750f-6492-459b-9218-52e24921916f None None] MFA Rules not processed for user `dbb5484ecb194023aa8415cb8b52ca5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:18.448855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f39a750f-6492-459b-9218-52e24921916f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:18.563227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 683/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Jul 11 15:42:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:21.972952 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d67c8-9679-4bfd-8bac-14037aa7ad27 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:21.973778 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d67c8-9679-4bfd-8bac-14037aa7ad27 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:21.974204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d67c8-9679-4bfd-8bac-14037aa7ad27 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:21.980322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 673/1356] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:42:21.982364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1839-98bd-4186-a5c7-f1e1181a2100 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:21.983148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1839-98bd-4186-a5c7-f1e1181a2100 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:21.983598 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1839-98bd-4186-a5c7-f1e1181a2100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:22.019401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:22.055001 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-71ac1839-98bd-4186-a5c7-f1e1181a2100 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:22.056628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-71ac1839-98bd-4186-a5c7-f1e1181a2100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:22.166859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 684/1357] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:22.218905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad9c50-5bf2-4c90-a015-371f3addf982 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:22.219618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad9c50-5bf2-4c90-a015-371f3addf982 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:22.220035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad9c50-5bf2-4c90-a015-371f3addf982 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:22.221628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 674/1358] 10.222.0.26 () {54 vars in 961 bytes} [Mon Jul 11 15:42:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:22.232698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ae3a-8fc6-4832-a193-e998afa5149a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:22.233455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ae3a-8fc6-4832-a193-e998afa5149a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:22.233902 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ae3a-8fc6-4832-a193-e998afa5149a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:22.322291 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-61c9ae3a-8fc6-4832-a193-e998afa5149a None None] MFA Rules not processed for user `fa038a2e30f544aaa609d32e0e1ceaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:22.323555 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-61c9ae3a-8fc6-4832-a193-e998afa5149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:22.374763 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:22.462084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 685/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Jul 11 15:42:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:22.470656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad9c50-5bf2-4c90-a015-371f3addf982 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:22.472370 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b0ad9c50-5bf2-4c90-a015-371f3addf982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:22.634007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad9c50-5bf2-4c90-a015-371f3addf982 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:22.716724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:22.761755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32167c-de37-438e-aae9-bb025fb73d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:22.762666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32167c-de37-438e-aae9-bb025fb73d57 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:22.763091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32167c-de37-438e-aae9-bb025fb73d57 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:22.763516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32167c-de37-438e-aae9-bb025fb73d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:22.765563 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-db32167c-de37-438e-aae9-bb025fb73d57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:22.865148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32167c-de37-438e-aae9-bb025fb73d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:22.866860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32167c-de37-438e-aae9-bb025fb73d57 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:22.886116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 675/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:25.119534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19cf3e-8b32-49a4-a70f-c2c9fe94a91b None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:25.120086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19cf3e-8b32-49a4-a70f-c2c9fe94a91b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:25.120086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19cf3e-8b32-49a4-a70f-c2c9fe94a91b None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:25.121611 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 686/1361] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:25.126920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3adc4-518c-49f1-9c53-834575554fc1 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:25.127405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3adc4-518c-49f1-9c53-834575554fc1 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:25.127498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3adc4-518c-49f1-9c53-834575554fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:25.197659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-05e3adc4-518c-49f1-9c53-834575554fc1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:25.198889 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-05e3adc4-518c-49f1-9c53-834575554fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:25.245995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:25.320748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 676/1362] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:25.363105 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19cf3e-8b32-49a4-a70f-c2c9fe94a91b None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:25.364677 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7d19cf3e-8b32-49a4-a70f-c2c9fe94a91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:25.533831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19cf3e-8b32-49a4-a70f-c2c9fe94a91b None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:25.557613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:25.666463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684647fe-da4d-45be-a1c3-5858d437a574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:25.667133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684647fe-da4d-45be-a1c3-5858d437a574 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:25.667414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684647fe-da4d-45be-a1c3-5858d437a574 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:25.667688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684647fe-da4d-45be-a1c3-5858d437a574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:25.669427 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-684647fe-da4d-45be-a1c3-5858d437a574 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:25.761953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684647fe-da4d-45be-a1c3-5858d437a574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:25.763585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684647fe-da4d-45be-a1c3-5858d437a574 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:25.782785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 687/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:28.137320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54d9ee-3e46-4803-b4e0-9b418f3787d8 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:28.137890 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54d9ee-3e46-4803-b4e0-9b418f3787d8 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:28.137890 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54d9ee-3e46-4803-b4e0-9b418f3787d8 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:28.139280 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 677/1364] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:28.144801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b5e9-492e-44d1-b74d-990096e227ec None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:28.145642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b5e9-492e-44d1-b74d-990096e227ec None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:28.146127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b5e9-492e-44d1-b74d-990096e227ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:28.164125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:28.237492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-0280b5e9-492e-44d1-b74d-990096e227ec None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:28.238688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-0280b5e9-492e-44d1-b74d-990096e227ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:28.360422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 688/1365] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:28.399451 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a958d-22b1-4f34-b989-5cafc4aa4711 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:28.399785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a958d-22b1-4f34-b989-5cafc4aa4711 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:28.400162 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a958d-22b1-4f34-b989-5cafc4aa4711 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:28.401924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 678/1366] 10.222.0.26 () {54 vars in 961 bytes} [Mon Jul 11 15:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:28.407869 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c632c-a56b-425b-b9e5-027890fcc53f None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:28.408129 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c632c-a56b-425b-b9e5-027890fcc53f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:28.408468 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c632c-a56b-425b-b9e5-027890fcc53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:28.492064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-a93c632c-a56b-425b-b9e5-027890fcc53f None None] MFA Rules not processed for user `fa038a2e30f544aaa609d32e0e1ceaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:28.493307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a93c632c-a56b-425b-b9e5-027890fcc53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:28.529055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:28.617615 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 689/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Jul 11 15:42:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:28.625271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a958d-22b1-4f34-b989-5cafc4aa4711 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:28.626742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-441a958d-22b1-4f34-b989-5cafc4aa4711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:28.780770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a958d-22b1-4f34-b989-5cafc4aa4711 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:28.802298 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:28.902063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e42e7-b8cd-433f-b478-c53a280f303a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:28.902722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e42e7-b8cd-433f-b478-c53a280f303a service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:28.903000 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e42e7-b8cd-433f-b478-c53a280f303a service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:28.903269 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e42e7-b8cd-433f-b478-c53a280f303a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:28.904958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-586e42e7-b8cd-433f-b478-c53a280f303a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:29.002568 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e42e7-b8cd-433f-b478-c53a280f303a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:29.004186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e42e7-b8cd-433f-b478-c53a280f303a service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:29.024495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 679/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:30.032053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe957a-6864-40ea-9d12-4fbd1f14b8e0 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:30.032730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe957a-6864-40ea-9d12-4fbd1f14b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:30.032730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe957a-6864-40ea-9d12-4fbd1f14b8e0 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:30.034218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 690/1369] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:30.039915 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ad50b-4719-44e3-92f7-09bb48fbf7a7 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:30.040533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ad50b-4719-44e3-92f7-09bb48fbf7a7 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:30.040533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ad50b-4719-44e3-92f7-09bb48fbf7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:30.075237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:30.113580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-084ad50b-4719-44e3-92f7-09bb48fbf7a7 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:30.114809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-084ad50b-4719-44e3-92f7-09bb48fbf7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:30.226190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 680/1370] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:30.577142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d9222-8552-4534-9e5f-319d561ca615 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:30.577304 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d9222-8552-4534-9e5f-319d561ca615 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:30.577601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d9222-8552-4534-9e5f-319d561ca615 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:30.579248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 691/1371] 10.222.0.26 () {54 vars in 963 bytes} [Mon Jul 11 15:42:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:30.584164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60356ee-e977-4057-8996-4ccfe9ad91e9 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:30.584555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60356ee-e977-4057-8996-4ccfe9ad91e9 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:30.585573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60356ee-e977-4057-8996-4ccfe9ad91e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:30.666793 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-a60356ee-e977-4057-8996-4ccfe9ad91e9 None None] MFA Rules not processed for user `73732594dbee480e9e5d153ca1382494`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:30.668102 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a60356ee-e977-4057-8996-4ccfe9ad91e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:30.718242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:30.751567 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 681/1372] 10.222.0.26 () {58 vars in 1060 bytes} [Mon Jul 11 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:30.760026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d9222-8552-4534-9e5f-319d561ca615 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:30.761694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c44d9222-8552-4534-9e5f-319d561ca615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:30.874003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d9222-8552-4534-9e5f-319d561ca615 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:30.917698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:30.954467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab107df3-2636-42c1-adc2-a3d59457443c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:30.955306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab107df3-2636-42c1-adc2-a3d59457443c service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:30.955683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab107df3-2636-42c1-adc2-a3d59457443c service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:30.956058 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab107df3-2636-42c1-adc2-a3d59457443c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:30.957863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ab107df3-2636-42c1-adc2-a3d59457443c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:31.083166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab107df3-2636-42c1-adc2-a3d59457443c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:31.084684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab107df3-2636-42c1-adc2-a3d59457443c service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:31.106053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 692/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:31.141738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98713e6c-f3b3-4354-a3d3-d793f4d4b397 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:31.142268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98713e6c-f3b3-4354-a3d3-d793f4d4b397 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:31.142268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98713e6c-f3b3-4354-a3d3-d793f4d4b397 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:31.147389 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 682/1374] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:31.149228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195e61-f21b-4ecf-be13-849dcac8597b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:31.149671 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195e61-f21b-4ecf-be13-849dcac8597b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:31.150147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195e61-f21b-4ecf-be13-849dcac8597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:31.217257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-4c195e61-f21b-4ecf-be13-849dcac8597b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:31.218771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4c195e61-f21b-4ecf-be13-849dcac8597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:31.239220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:31.326246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 693/1375] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:31.370751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98713e6c-f3b3-4354-a3d3-d793f4d4b397 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:31.372276 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-98713e6c-f3b3-4354-a3d3-d793f4d4b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:31.527058 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98713e6c-f3b3-4354-a3d3-d793f4d4b397 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:31.582100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:31.645364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c06dd-c0cc-4b71-81bb-17b8d61593dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:31.646133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c06dd-c0cc-4b71-81bb-17b8d61593dd service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:31.646477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c06dd-c0cc-4b71-81bb-17b8d61593dd service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:31.646815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c06dd-c0cc-4b71-81bb-17b8d61593dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:31.648802 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2c5c06dd-c0cc-4b71-81bb-17b8d61593dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:31.739835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c06dd-c0cc-4b71-81bb-17b8d61593dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:31.741524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c06dd-c0cc-4b71-81bb-17b8d61593dd service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:31.761286 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 683/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:33.814833 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd81e-41d5-49a2-b17f-8b98a7da0ef5 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:33.815399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd81e-41d5-49a2-b17f-8b98a7da0ef5 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:33.815399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd81e-41d5-49a2-b17f-8b98a7da0ef5 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:33.816831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 694/1377] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:33.822857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4d5ea-9b60-4741-b1ad-8fda540ae320 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:33.823351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4d5ea-9b60-4741-b1ad-8fda540ae320 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:33.823596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4d5ea-9b60-4741-b1ad-8fda540ae320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:33.899552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-b4b4d5ea-9b60-4741-b1ad-8fda540ae320 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:33.900941 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b4b4d5ea-9b60-4741-b1ad-8fda540ae320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:33.908076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:34.032045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 684/1378] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:34.091327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebd81e-41d5-49a2-b17f-8b98a7da0ef5 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:34.092959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9cebd81e-41d5-49a2-b17f-8b98a7da0ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:34.292759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebd81e-41d5-49a2-b17f-8b98a7da0ef5 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:34.296556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:34.430525 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896abdd-bc3f-41f4-825a-77f00098ac3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:34.431198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896abdd-bc3f-41f4-825a-77f00098ac3c service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:34.431481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896abdd-bc3f-41f4-825a-77f00098ac3c service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:34.431752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896abdd-bc3f-41f4-825a-77f00098ac3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:34.434816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a896abdd-bc3f-41f4-825a-77f00098ac3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:34.555415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896abdd-bc3f-41f4-825a-77f00098ac3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:34.557292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896abdd-bc3f-41f4-825a-77f00098ac3c service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:34.578980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 695/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:36.666017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72a95b-57b8-486a-9f7c-da5a85eff904 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:36.666574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72a95b-57b8-486a-9f7c-da5a85eff904 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:36.666755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72a95b-57b8-486a-9f7c-da5a85eff904 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:36.668498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 685/1380] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:36.673750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854be96-afb5-4371-8819-6b54d378b65c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:36.674272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854be96-afb5-4371-8819-6b54d378b65c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:36.674272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854be96-afb5-4371-8819-6b54d378b65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:36.685597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:36.758675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-2854be96-afb5-4371-8819-6b54d378b65c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:36.760158 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2854be96-afb5-4371-8819-6b54d378b65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:36.867009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 696/1381] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:36.909691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72a95b-57b8-486a-9f7c-da5a85eff904 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:36.911408 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fa72a95b-57b8-486a-9f7c-da5a85eff904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:37.079937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:37.092334 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72a95b-57b8-486a-9f7c-da5a85eff904 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:37.222456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6c1fe-3ab1-49cc-aef9-8d17923c655b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:37.223115 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6c1fe-3ab1-49cc-aef9-8d17923c655b service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:37.223402 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6c1fe-3ab1-49cc-aef9-8d17923c655b service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:37.223679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6c1fe-3ab1-49cc-aef9-8d17923c655b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:37.225692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5cb6c1fe-3ab1-49cc-aef9-8d17923c655b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:37.327150 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6c1fe-3ab1-49cc-aef9-8d17923c655b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:37.328861 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6c1fe-3ab1-49cc-aef9-8d17923c655b service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:37.341499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:37.352321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 686/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:42:39.752471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462164c-aad8-4f27-9cb0-386c561b4757 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:39.753002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462164c-aad8-4f27-9cb0-386c561b4757 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:39.753002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462164c-aad8-4f27-9cb0-386c561b4757 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:39.754503 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 697/1383] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:39.761814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdec85-c8b5-4e14-b9bd-ac0378b6187d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:39.762284 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdec85-c8b5-4e14-b9bd-ac0378b6187d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:39.762476 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdec85-c8b5-4e14-b9bd-ac0378b6187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:39.851773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-0dcdec85-c8b5-4e14-b9bd-ac0378b6187d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:39.853767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-0dcdec85-c8b5-4e14-b9bd-ac0378b6187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:39.960132 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 687/1384] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:40.006326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462164c-aad8-4f27-9cb0-386c561b4757 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:40.008866 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8462164c-aad8-4f27-9cb0-386c561b4757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:40.115576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:40.184314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462164c-aad8-4f27-9cb0-386c561b4757 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:40.306981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12a104-301e-4d38-8619-d690d9e6ef5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:40.307621 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12a104-301e-4d38-8619-d690d9e6ef5f service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:40.307976 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12a104-301e-4d38-8619-d690d9e6ef5f service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:40.308210 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12a104-301e-4d38-8619-d690d9e6ef5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:40.309980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5d12a104-301e-4d38-8619-d690d9e6ef5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:40.363929 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:40.410315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12a104-301e-4d38-8619-d690d9e6ef5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:40.411964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12a104-301e-4d38-8619-d690d9e6ef5f service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:40.431468 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 698/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:42.606901 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06099de3-a10d-48e7-91d8-7488edb885b0 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:42.607553 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06099de3-a10d-48e7-91d8-7488edb885b0 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:42.607729 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06099de3-a10d-48e7-91d8-7488edb885b0 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:42.609842 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 688/1386] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:42.617375 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351532-b507-46ee-9097-2a77209d1afb None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:42.617868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351532-b507-46ee-9097-2a77209d1afb None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:42.618185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351532-b507-46ee-9097-2a77209d1afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:42.693042 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-96351532-b507-46ee-9097-2a77209d1afb None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:42.694268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-96351532-b507-46ee-9097-2a77209d1afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:42.803659 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 699/1387] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:42.851275 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06099de3-a10d-48e7-91d8-7488edb885b0 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:42.852975 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-06099de3-a10d-48e7-91d8-7488edb885b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:42.941155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:43.040012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06099de3-a10d-48e7-91d8-7488edb885b0 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:43.196671 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33c080-7c19-4298-a973-db5dc2185b45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:43.197563 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c080-7c19-4298-a973-db5dc2185b45 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:43.197951 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c080-7c19-4298-a973-db5dc2185b45 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:43.198333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c080-7c19-4298-a973-db5dc2185b45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:43.200828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3f33c080-7c19-4298-a973-db5dc2185b45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:43.247002 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:43.303748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33c080-7c19-4298-a973-db5dc2185b45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:43.305345 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33c080-7c19-4298-a973-db5dc2185b45 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:43.324439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 689/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:45.498776 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f341128-e667-4559-b670-7c0f9a991163 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:45.499353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f341128-e667-4559-b670-7c0f9a991163 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:45.499353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f341128-e667-4559-b670-7c0f9a991163 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:45.500675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 700/1389] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:45.505930 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820139-2f6a-4903-8530-836cc69da90d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:45.506380 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820139-2f6a-4903-8530-836cc69da90d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:45.506490 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820139-2f6a-4903-8530-836cc69da90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:45.573196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-06820139-2f6a-4903-8530-836cc69da90d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:45.574399 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-06820139-2f6a-4903-8530-836cc69da90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:45.674448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 690/1390] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:45.720104 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f341128-e667-4559-b670-7c0f9a991163 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:45.721697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6f341128-e667-4559-b670-7c0f9a991163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:45.755741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:45.872691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f341128-e667-4559-b670-7c0f9a991163 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:45.979473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:45.993418 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc96445-0674-424f-acec-4f5dd071c55f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:45.994109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc96445-0674-424f-acec-4f5dd071c55f service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:45.994396 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc96445-0674-424f-acec-4f5dd071c55f service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:45.994673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc96445-0674-424f-acec-4f5dd071c55f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:45.996397 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6cc96445-0674-424f-acec-4f5dd071c55f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:46.090234 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc96445-0674-424f-acec-4f5dd071c55f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:46.091978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc96445-0674-424f-acec-4f5dd071c55f service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:46.111639 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 701/1391] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:46.185815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed840f92-b783-4c2a-b804-04962402d4fa None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:46.186127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed840f92-b783-4c2a-b804-04962402d4fa None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:46.186373 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed840f92-b783-4c2a-b804-04962402d4fa None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:46.187836 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 691/1392] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:46.193909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1ccb1-6b64-419b-bdf6-8c8907f88b1b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:46.194306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1ccb1-6b64-419b-bdf6-8c8907f88b1b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:46.194584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1ccb1-6b64-419b-bdf6-8c8907f88b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:46.270851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-dbd1ccb1-6b64-419b-bdf6-8c8907f88b1b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:46.272128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-dbd1ccb1-6b64-419b-bdf6-8c8907f88b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:46.340564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:46.379520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 702/1393] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:46.436817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707ee8b-141c-4c8b-b6e1-874f942f6d10 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:46.437103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707ee8b-141c-4c8b-b6e1-874f942f6d10 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:46.437375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707ee8b-141c-4c8b-b6e1-874f942f6d10 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:46.438824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 692/1394] 10.222.0.26 () {54 vars in 962 bytes} [Mon Jul 11 15:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:46.444214 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39cd7a-26bb-426a-b644-ea6c6f2d8a0b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:46.444540 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39cd7a-26bb-426a-b644-ea6c6f2d8a0b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:46.444818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39cd7a-26bb-426a-b644-ea6c6f2d8a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:46.524524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-2b39cd7a-26bb-426a-b644-ea6c6f2d8a0b None None] MFA Rules not processed for user `3be29cfa76174b44b99ddaf3d293ead1`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:46.525727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2b39cd7a-26bb-426a-b644-ea6c6f2d8a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:46.602922 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 703/1395] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Jul 11 15:42:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:46.610607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707ee8b-141c-4c8b-b6e1-874f942f6d10 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:46.612131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-0707ee8b-141c-4c8b-b6e1-874f942f6d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:46.626682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:46.721071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707ee8b-141c-4c8b-b6e1-874f942f6d10 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:46.796607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8253478-5d81-4b17-ae1d-861638ba2a3f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be29cfa76174b44b99ddaf3d293ead1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:46.797262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253478-5d81-4b17-ae1d-861638ba2a3f service glance] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:46.797522 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253478-5d81-4b17-ae1d-861638ba2a3f service glance] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:46.797777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253478-5d81-4b17-ae1d-861638ba2a3f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:46.799728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a8253478-5d81-4b17-ae1d-861638ba2a3f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:46.870599 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:46.912759 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8253478-5d81-4b17-ae1d-861638ba2a3f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:46.914481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8253478-5d81-4b17-ae1d-861638ba2a3f service glance] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:46.933461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 693/1396] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:47.651950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc856f-6e52-4cc7-b414-f8e937b216fc None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:47.652506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc856f-6e52-4cc7-b414-f8e937b216fc None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:47.652597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc856f-6e52-4cc7-b414-f8e937b216fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:47.717317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-19dc856f-6e52-4cc7-b414-f8e937b216fc None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:47.718517 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-19dc856f-6e52-4cc7-b414-f8e937b216fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:47.727339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:47.811511 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 704/1397] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Jul 11 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:47.858066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4053f4a-6752-45d6-94ff-c0cda08a9733 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:47.858598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4053f4a-6752-45d6-94ff-c0cda08a9733 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:47.858711 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4053f4a-6752-45d6-94ff-c0cda08a9733 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:47.860151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 694/1398] 10.222.0.26 () {54 vars in 942 bytes} [Mon Jul 11 15:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:47.866696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67972685-7d07-49bf-a549-d9bce31058fc None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:47.866989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67972685-7d07-49bf-a549-d9bce31058fc None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:47.867264 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67972685-7d07-49bf-a549-d9bce31058fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:47.942292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-67972685-7d07-49bf-a549-d9bce31058fc None None] MFA Rules not processed for user `8eaff8748f8b47e088e0cb7875992a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:47.943509 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-67972685-7d07-49bf-a549-d9bce31058fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:48.032521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:48.056807 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 705/1399] 10.222.0.26 () {58 vars in 1039 bytes} [Mon Jul 11 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:48.066087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4053f4a-6752-45d6-94ff-c0cda08a9733 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:48.067676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b4053f4a-6752-45d6-94ff-c0cda08a9733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:48.211117 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4053f4a-6752-45d6-94ff-c0cda08a9733 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:48.225239 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178fbd5-7102-4c14-bb46-182f925220e2 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:48.225624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178fbd5-7102-4c14-bb46-182f925220e2 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:48.225933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178fbd5-7102-4c14-bb46-182f925220e2 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:48.227318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 706/1400] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:42:48.232474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132b528-65b9-4632-b395-cd0147694ef5 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:48.232851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132b528-65b9-4632-b395-cd0147694ef5 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:48.233138 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132b528-65b9-4632-b395-cd0147694ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:48.249030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:48.324487 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e15cb-919d-4084-bbb2-e225cc65182a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:48.325160 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e15cb-919d-4084-bbb2-e225cc65182a service swift] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:48.325440 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e15cb-919d-4084-bbb2-e225cc65182a service swift] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:48.325716 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e15cb-919d-4084-bbb2-e225cc65182a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:48.327542 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-de6e15cb-919d-4084-bbb2-e225cc65182a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:48.419227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e15cb-919d-4084-bbb2-e225cc65182a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:48.421171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e15cb-919d-4084-bbb2-e225cc65182a service swift] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:48.424145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-e132b528-65b9-4632-b395-cd0147694ef5 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:48.425440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e132b528-65b9-4632-b395-cd0147694ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:48.429383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 695/1401] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 15:42:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:42:48.527741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 707/1402] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:42:48.575407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e15cb-919d-4084-bbb2-e225cc65182a service swift] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:48.576658 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-de6e15cb-919d-4084-bbb2-e225cc65182a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:48.649252 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:48.677224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e15cb-919d-4084-bbb2-e225cc65182a service swift] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:48.807311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d216b-b1f3-4567-98a9-628c97fbf17c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:48.808092 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d216b-b1f3-4567-98a9-628c97fbf17c service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:48.809219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d216b-b1f3-4567-98a9-628c97fbf17c service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:48.809219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d216b-b1f3-4567-98a9-628c97fbf17c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:48.810582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-dc7d216b-b1f3-4567-98a9-628c97fbf17c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:48.910328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:48.914579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d216b-b1f3-4567-98a9-628c97fbf17c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:48.916211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d216b-b1f3-4567-98a9-628c97fbf17c service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:48.935652 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 696/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:51.011082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32833996-361f-4616-856c-7dfcf2acabca None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:51.011699 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32833996-361f-4616-856c-7dfcf2acabca None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:51.011699 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32833996-361f-4616-856c-7dfcf2acabca None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:51.013058 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 708/1404] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:51.018345 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1dac0-c1e2-49f6-a38f-6da91adaec9d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:51.018763 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1dac0-c1e2-49f6-a38f-6da91adaec9d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:51.018880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1dac0-c1e2-49f6-a38f-6da91adaec9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:51.087057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-22b1dac0-c1e2-49f6-a38f-6da91adaec9d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:51.088264 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-22b1dac0-c1e2-49f6-a38f-6da91adaec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:51.196433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 697/1405] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:42:51.237628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32833996-361f-4616-856c-7dfcf2acabca None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:51.239325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-32833996-361f-4616-856c-7dfcf2acabca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:51.311654 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:51.397609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32833996-361f-4616-856c-7dfcf2acabca None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:51.520711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e0220-6f0e-4379-9fff-6b879fe711fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:51.521361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e0220-6f0e-4379-9fff-6b879fe711fb service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:51.521635 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e0220-6f0e-4379-9fff-6b879fe711fb service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:51.521906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e0220-6f0e-4379-9fff-6b879fe711fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:51.523679 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-342e0220-6f0e-4379-9fff-6b879fe711fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:51.548703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:51.624132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e0220-6f0e-4379-9fff-6b879fe711fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:51.625704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e0220-6f0e-4379-9fff-6b879fe711fb service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:51.645364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 709/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:42:53.725555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350d676-5025-45f2-8747-b1009eebdce5 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:53.726620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350d676-5025-45f2-8747-b1009eebdce5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:53.726620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350d676-5025-45f2-8747-b1009eebdce5 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:53.728335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 698/1407] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:42:53.732686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d1b5c-484f-4c38-8aa6-6d155d89e16b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:53.733104 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d1b5c-484f-4c38-8aa6-6d155d89e16b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:53.733257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d1b5c-484f-4c38-8aa6-6d155d89e16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:53.810871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-5a4d1b5c-484f-4c38-8aa6-6d155d89e16b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:42:53.812107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5a4d1b5c-484f-4c38-8aa6-6d155d89e16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:53.918857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:53.932506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 710/1408] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:42:53.967575 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350d676-5025-45f2-8747-b1009eebdce5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:42:53.969197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d350d676-5025-45f2-8747-b1009eebdce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:54.046843 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:54.151713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350d676-5025-45f2-8747-b1009eebdce5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:42:54.343765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94545f-2b20-4f0b-a316-ca09ca325755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:42:54.343765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94545f-2b20-4f0b-a316-ca09ca325755 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:42:54.343765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94545f-2b20-4f0b-a316-ca09ca325755 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:42:54.343765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94545f-2b20-4f0b-a316-ca09ca325755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:42:54.344284 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-eb94545f-2b20-4f0b-a316-ca09ca325755 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:42:54.404754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:42:54.479950 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94545f-2b20-4f0b-a316-ca09ca325755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:42:54.481706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94545f-2b20-4f0b-a316-ca09ca325755 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:42:54.501391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 699/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:04.499180 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=34 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:10.266717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bece7-9d0c-4d13-882a-9cc3ce5b1ce3 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:10.267307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bece7-9d0c-4d13-882a-9cc3ce5b1ce3 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:10.267307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bece7-9d0c-4d13-882a-9cc3ce5b1ce3 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:10.268742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 711/1410] 10.222.0.26 () {54 vars in 918 bytes} [Mon Jul 11 15:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:10.274788 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953595b1-e5b2-4afc-aeec-7572a6185e60 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:10.275530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953595b1-e5b2-4afc-aeec-7572a6185e60 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:10.275659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953595b1-e5b2-4afc-aeec-7572a6185e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:10.376353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-953595b1-e5b2-4afc-aeec-7572a6185e60 None None] MFA Rules not processed for user `dbb5484ecb194023aa8415cb8b52ca5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:10.377578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-953595b1-e5b2-4afc-aeec-7572a6185e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:10.498560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 700/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Jul 11 15:43:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:10.515971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccf617-31b8-427a-965e-c249f9364d53 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:10.516253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccf617-31b8-427a-965e-c249f9364d53 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:10.516569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccf617-31b8-427a-965e-c249f9364d53 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:10.517971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 712/1412] 10.222.0.26 () {54 vars in 918 bytes} [Mon Jul 11 15:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:10.523170 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba27ff-242b-40b2-a5d1-06f6fa8970c8 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:10.523457 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba27ff-242b-40b2-a5d1-06f6fa8970c8 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:10.523732 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba27ff-242b-40b2-a5d1-06f6fa8970c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:10.604038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:10.607368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-7eba27ff-242b-40b2-a5d1-06f6fa8970c8 None None] MFA Rules not processed for user `fa038a2e30f544aaa609d32e0e1ceaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:10.609338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7eba27ff-242b-40b2-a5d1-06f6fa8970c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:10.739510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 701/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Jul 11 15:43:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:13.203895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e8049-9b10-4012-bed8-5d8e61de2937 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:13.204465 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e8049-9b10-4012-bed8-5d8e61de2937 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:13.204570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e8049-9b10-4012-bed8-5d8e61de2937 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:13.206605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:43:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:13.213600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30772e8-da69-454a-841f-9aaf011b2e55 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:13.214086 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30772e8-da69-454a-841f-9aaf011b2e55 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:13.214188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30772e8-da69-454a-841f-9aaf011b2e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:13.278895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-b30772e8-da69-454a-841f-9aaf011b2e55 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:13.280088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b30772e8-da69-454a-841f-9aaf011b2e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:13.346379 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:13.389126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:13.432368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e8049-9b10-4012-bed8-5d8e61de2937 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:13.434478 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-789e8049-9b10-4012-bed8-5d8e61de2937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:13.594995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e8049-9b10-4012-bed8-5d8e61de2937 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:13.677290 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:13.728201 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff335dd-27c2-4daa-89d7-c8c033d2196e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:13.728878 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff335dd-27c2-4daa-89d7-c8c033d2196e service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:13.729158 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff335dd-27c2-4daa-89d7-c8c033d2196e service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:13.729420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff335dd-27c2-4daa-89d7-c8c033d2196e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:13.731082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9ff335dd-27c2-4daa-89d7-c8c033d2196e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:13.828045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff335dd-27c2-4daa-89d7-c8c033d2196e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:13.829690 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff335dd-27c2-4daa-89d7-c8c033d2196e service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:13.848362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 714/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:14.746112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cbdc8-d21a-4fd8-b8fa-a407d26333f2 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:14.746714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cbdc8-d21a-4fd8-b8fa-a407d26333f2 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:14.746714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cbdc8-d21a-4fd8-b8fa-a407d26333f2 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:14.748125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:14.754207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced3a9-fcd3-4b92-88c4-a13f44d4c7da None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:14.754890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced3a9-fcd3-4b92-88c4-a13f44d4c7da None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:14.755055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced3a9-fcd3-4b92-88c4-a13f44d4c7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:14.838784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-4aced3a9-fcd3-4b92-88c4-a13f44d4c7da None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:14.839949 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4aced3a9-fcd3-4b92-88c4-a13f44d4c7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:14.867227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:14.945296 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:15.095079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cbdc8-d21a-4fd8-b8fa-a407d26333f2 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:15.097598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-605cbdc8-d21a-4fd8-b8fa-a407d26333f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:15.253491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cbdc8-d21a-4fd8-b8fa-a407d26333f2 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:15.293849 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:15.376389 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9cc68-57f7-48a1-9d36-6661a1ceb819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:15.376987 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9cc68-57f7-48a1-9d36-6661a1ceb819 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:15.377268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9cc68-57f7-48a1-9d36-6661a1ceb819 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:15.377537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9cc68-57f7-48a1-9d36-6661a1ceb819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:15.379218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d7c9cc68-57f7-48a1-9d36-6661a1ceb819 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:15.475646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9cc68-57f7-48a1-9d36-6661a1ceb819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:15.477343 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9cc68-57f7-48a1-9d36-6661a1ceb819 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:15.497434 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 704/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:16.391605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d2999-b3ea-43c6-8336-7396183b7b92 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:16.392534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d2999-b3ea-43c6-8336-7396183b7b92 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:16.392534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d2999-b3ea-43c6-8336-7396183b7b92 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:16.394725 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:43:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:16.400028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aeea1-e85f-43a0-8b01-72e7ead8d24c None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:16.400541 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aeea1-e85f-43a0-8b01-72e7ead8d24c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:16.400632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aeea1-e85f-43a0-8b01-72e7ead8d24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:16.461255 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:16.484226 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-267aeea1-e85f-43a0-8b01-72e7ead8d24c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:16.485469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-267aeea1-e85f-43a0-8b01-72e7ead8d24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:16.589071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:43:16.745304 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d2999-b3ea-43c6-8336-7396183b7b92 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:16.747647 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4d4d2999-b3ea-43c6-8336-7396183b7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:16.913283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d2999-b3ea-43c6-8336-7396183b7b92 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:16.926120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:17.040347 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751facd1-a187-411e-996f-b1d0591d6c17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:17.041027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751facd1-a187-411e-996f-b1d0591d6c17 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:17.041314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751facd1-a187-411e-996f-b1d0591d6c17 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:17.041586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751facd1-a187-411e-996f-b1d0591d6c17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:17.043264 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-751facd1-a187-411e-996f-b1d0591d6c17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:17.133308 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751facd1-a187-411e-996f-b1d0591d6c17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:17.134929 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751facd1-a187-411e-996f-b1d0591d6c17 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:17.153181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 717/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:18.035948 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac64e-856a-49cf-8c71-2997817685c6 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:18.036585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac64e-856a-49cf-8c71-2997817685c6 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:18.036585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac64e-856a-49cf-8c71-2997817685c6 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:18.038287 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:43:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:18.043418 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fc68b-4755-429e-8f29-4cb76e95f9c0 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:18.043906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fc68b-4755-429e-8f29-4cb76e95f9c0 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:18.044018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fc68b-4755-429e-8f29-4cb76e95f9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:18.066236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:18.124854 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3d3fc68b-4755-429e-8f29-4cb76e95f9c0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:18.126057 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3d3fc68b-4755-429e-8f29-4cb76e95f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:18.241352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:18.395107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ac64e-856a-49cf-8c71-2997817685c6 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:18.396728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-c61ac64e-856a-49cf-8c71-2997817685c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:18.512827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:18.548520 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ac64e-856a-49cf-8c71-2997817685c6 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:18.681366 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afebbd-eaca-4fc5-bf83-d36d50d3b48e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:18.681935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afebbd-eaca-4fc5-bf83-d36d50d3b48e service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:18.682234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afebbd-eaca-4fc5-bf83-d36d50d3b48e service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:18.682484 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afebbd-eaca-4fc5-bf83-d36d50d3b48e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:18.684137 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-83afebbd-eaca-4fc5-bf83-d36d50d3b48e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:18.764496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:18.779473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afebbd-eaca-4fc5-bf83-d36d50d3b48e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:18.781195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afebbd-eaca-4fc5-bf83-d36d50d3b48e service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:18.799819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 707/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:19.694277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ccd4f-44fc-41d5-8ec6-7db902050576 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:19.694887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ccd4f-44fc-41d5-8ec6-7db902050576 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:19.694887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ccd4f-44fc-41d5-8ec6-7db902050576 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:19.696271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:43:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:19.701578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a7dd2-a002-454e-ad9c-5a49ff5b8488 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:19.702050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a7dd2-a002-454e-ad9c-5a49ff5b8488 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:19.702151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a7dd2-a002-454e-ad9c-5a49ff5b8488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:19.783503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e03a7dd2-a002-454e-ad9c-5a49ff5b8488 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:19.784748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e03a7dd2-a002-454e-ad9c-5a49ff5b8488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:19.892916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:20.044642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ccd4f-44fc-41d5-8ec6-7db902050576 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:20.047090 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-576ccd4f-44fc-41d5-8ec6-7db902050576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:20.134934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:20.206049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ccd4f-44fc-41d5-8ec6-7db902050576 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:20.327735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1667c66-d93e-4da1-b6bc-6c0b664fc874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:20.328404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1667c66-d93e-4da1-b6bc-6c0b664fc874 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:20.328686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1667c66-d93e-4da1-b6bc-6c0b664fc874 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:20.328952 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1667c66-d93e-4da1-b6bc-6c0b664fc874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:20.330579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c1667c66-d93e-4da1-b6bc-6c0b664fc874 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:20.379084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:20.424074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1667c66-d93e-4da1-b6bc-6c0b664fc874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:20.426633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1667c66-d93e-4da1-b6bc-6c0b664fc874 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:20.451613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 720/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:21.286583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7f68a-738d-4bd7-a12d-202325d49a5e None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:21.287566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7f68a-738d-4bd7-a12d-202325d49a5e None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:21.287566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7f68a-738d-4bd7-a12d-202325d49a5e None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:21.289025 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:43:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:21.294123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13684d-e5dd-42e0-9f17-ea9a883d600d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:21.294561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13684d-e5dd-42e0-9f17-ea9a883d600d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:21.294666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13684d-e5dd-42e0-9f17-ea9a883d600d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:21.375613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-8c13684d-e5dd-42e0-9f17-ea9a883d600d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:21.376786 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8c13684d-e5dd-42e0-9f17-ea9a883d600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:21.478958 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:21.633652 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7f68a-738d-4bd7-a12d-202325d49a5e None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:21.635987 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-efe7f68a-738d-4bd7-a12d-202325d49a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:21.694301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:21.807964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7f68a-738d-4bd7-a12d-202325d49a5e None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:21.939208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1039dcd-126c-4278-8c5b-15fe5a2b9742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:21.939791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1039dcd-126c-4278-8c5b-15fe5a2b9742 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:21.940076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1039dcd-126c-4278-8c5b-15fe5a2b9742 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:21.940386 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1039dcd-126c-4278-8c5b-15fe5a2b9742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:21.942088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d1039dcd-126c-4278-8c5b-15fe5a2b9742 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:21.949174 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:22.041692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1039dcd-126c-4278-8c5b-15fe5a2b9742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:22.045075 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1039dcd-126c-4278-8c5b-15fe5a2b9742 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:22.064800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 710/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:22.878527 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4908b-acfa-4c61-878a-e625ecf82141 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:22.879464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4908b-acfa-4c61-878a-e625ecf82141 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:22.879464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4908b-acfa-4c61-878a-e625ecf82141 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:22.881672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:43:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:22.889931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c0009-df19-4d6a-96e9-5387226506bb None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:22.890372 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c0009-df19-4d6a-96e9-5387226506bb None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:22.890505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c0009-df19-4d6a-96e9-5387226506bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:22.977257 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-782c0009-df19-4d6a-96e9-5387226506bb None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:22.979431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-782c0009-df19-4d6a-96e9-5387226506bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:23.061107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:23.094004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:23.242776 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4908b-acfa-4c61-878a-e625ecf82141 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:23.244313 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4ba4908b-acfa-4c61-878a-e625ecf82141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:23.262470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:23.411545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4908b-acfa-4c61-878a-e625ecf82141 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:23.517715 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:23.544884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d8c11-207f-4b2a-9e1a-ac9472f13861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:23.545549 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d8c11-207f-4b2a-9e1a-ac9472f13861 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:23.545829 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d8c11-207f-4b2a-9e1a-ac9472f13861 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:23.546118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d8c11-207f-4b2a-9e1a-ac9472f13861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:23.547769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2b3d8c11-207f-4b2a-9e1a-ac9472f13861 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:23.656953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d8c11-207f-4b2a-9e1a-ac9472f13861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:23.658577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d8c11-207f-4b2a-9e1a-ac9472f13861 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:23.677865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 723/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:24.503964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd60ed-71ab-4898-8a24-ddff59e17837 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:24.504572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd60ed-71ab-4898-8a24-ddff59e17837 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:24.504572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd60ed-71ab-4898-8a24-ddff59e17837 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:24.505872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:24.511824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047431f-e510-4a2f-a1c4-9682c9cf1c3c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:24.512606 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047431f-e510-4a2f-a1c4-9682c9cf1c3c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:24.512708 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047431f-e510-4a2f-a1c4-9682c9cf1c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:24.593443 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-b047431f-e510-4a2f-a1c4-9682c9cf1c3c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:24.594640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b047431f-e510-4a2f-a1c4-9682c9cf1c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:24.638633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:24.696239 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:24.846688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd60ed-71ab-4898-8a24-ddff59e17837 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:24.849059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-86bd60ed-71ab-4898-8a24-ddff59e17837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:25.011873 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd60ed-71ab-4898-8a24-ddff59e17837 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:25.067686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:25.131484 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7024534-9770-49db-b923-9bac35337be1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:25.132067 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7024534-9770-49db-b923-9bac35337be1 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:25.132358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7024534-9770-49db-b923-9bac35337be1 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:25.132645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7024534-9770-49db-b923-9bac35337be1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:25.134297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-f7024534-9770-49db-b923-9bac35337be1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:25.239100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7024534-9770-49db-b923-9bac35337be1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:25.240862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7024534-9770-49db-b923-9bac35337be1 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:25.259987 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 713/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:26.063440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5d76e-bc8d-40a6-8915-738fbbe6ca70 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.064326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5d76e-bc8d-40a6-8915-738fbbe6ca70 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.064326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5d76e-bc8d-40a6-8915-738fbbe6ca70 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.066474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:43:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:26.072431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7109dd-cf17-4b4c-9912-674908b50884 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.072898 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7109dd-cf17-4b4c-9912-674908b50884 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.073003 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7109dd-cf17-4b4c-9912-674908b50884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.157161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-4e7109dd-cf17-4b4c-9912-674908b50884 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:26.158387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4e7109dd-cf17-4b4c-9912-674908b50884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:26.160450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:26.265298 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:26.425393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5d76e-bc8d-40a6-8915-738fbbe6ca70 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:26.427618 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3ad5d76e-bc8d-40a6-8915-738fbbe6ca70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:26.584549 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5d76e-bc8d-40a6-8915-738fbbe6ca70 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:26.613508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:26.700160 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def589ea-dee8-42f2-98d2-6005acbc3ebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:26.700773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def589ea-dee8-42f2-98d2-6005acbc3ebf service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:26.701037 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def589ea-dee8-42f2-98d2-6005acbc3ebf service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:26.701308 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def589ea-dee8-42f2-98d2-6005acbc3ebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:26.702951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-def589ea-dee8-42f2-98d2-6005acbc3ebf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:26.798200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def589ea-dee8-42f2-98d2-6005acbc3ebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:26.799848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def589ea-dee8-42f2-98d2-6005acbc3ebf service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:26.819429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 726/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:28.762777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb1bef-bebb-4774-b6e4-2893790ea98d None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:28.763407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb1bef-bebb-4774-b6e4-2893790ea98d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:28.763407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb1bef-bebb-4774-b6e4-2893790ea98d None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:28.764787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:28.773926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a5db0-5fe6-4ccc-92dd-f7bf42e29c3d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:28.774653 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a5db0-5fe6-4ccc-92dd-f7bf42e29c3d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:28.774846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a5db0-5fe6-4ccc-92dd-f7bf42e29c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:28.822291 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:28.858309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-2a9a5db0-5fe6-4ccc-92dd-f7bf42e29c3d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:28.859555 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2a9a5db0-5fe6-4ccc-92dd-f7bf42e29c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:28.964302 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:29.007106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb1bef-bebb-4774-b6e4-2893790ea98d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:29.009419 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6fbb1bef-bebb-4774-b6e4-2893790ea98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:29.126805 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb1bef-bebb-4774-b6e4-2893790ea98d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:29.166753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:29.212068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ad81b-701f-4090-987b-8c1a0503b8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:29.212775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ad81b-701f-4090-987b-8c1a0503b8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:29.213081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ad81b-701f-4090-987b-8c1a0503b8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:29.213350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ad81b-701f-4090-987b-8c1a0503b8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:29.215031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e79ad81b-701f-4090-987b-8c1a0503b8e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:29.325284 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ad81b-701f-4090-987b-8c1a0503b8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:29.326630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ad81b-701f-4090-987b-8c1a0503b8e8 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:29.346489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 716/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:31.480984 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ad4ed-774d-4b46-943f-1a17adf0759c None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:31.481539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ad4ed-774d-4b46-943f-1a17adf0759c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:31.481539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ad4ed-774d-4b46-943f-1a17adf0759c None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:31.482833 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:31.489218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9513ebc-34a6-4f98-b5b5-9f772cb86a18 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:31.489664 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9513ebc-34a6-4f98-b5b5-9f772cb86a18 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:31.489842 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9513ebc-34a6-4f98-b5b5-9f772cb86a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:31.568816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e9513ebc-34a6-4f98-b5b5-9f772cb86a18 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:31.570045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e9513ebc-34a6-4f98-b5b5-9f772cb86a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:31.583003 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:31.678566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:31.727054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ad4ed-774d-4b46-943f-1a17adf0759c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:31.728621 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-042ad4ed-774d-4b46-943f-1a17adf0759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:31.844307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ad4ed-774d-4b46-943f-1a17adf0759c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:31.857289 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:31.924617 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f6fdc-a6bb-4c02-94df-3aab2ef9c754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:31.925275 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f6fdc-a6bb-4c02-94df-3aab2ef9c754 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:31.925560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f6fdc-a6bb-4c02-94df-3aab2ef9c754 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:31.925830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f6fdc-a6bb-4c02-94df-3aab2ef9c754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:31.927540 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-630f6fdc-a6bb-4c02-94df-3aab2ef9c754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:32.045589 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f6fdc-a6bb-4c02-94df-3aab2ef9c754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:32.047141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f6fdc-a6bb-4c02-94df-3aab2ef9c754 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:32.067930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 729/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:34.391309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51fd9e-6181-4b87-8f23-3ae71ddfde25 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:34.392215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51fd9e-6181-4b87-8f23-3ae71ddfde25 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:34.392215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51fd9e-6181-4b87-8f23-3ae71ddfde25 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:34.394449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:43:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:34.402079 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0480e51-08af-403f-b2df-220ddd639ed2 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:34.402508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0480e51-08af-403f-b2df-220ddd639ed2 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:34.402685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0480e51-08af-403f-b2df-220ddd639ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:34.465173 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:34.485081 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-a0480e51-08af-403f-b2df-220ddd639ed2 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:34.486302 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a0480e51-08af-403f-b2df-220ddd639ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:34.588837 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:34.633423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51fd9e-6181-4b87-8f23-3ae71ddfde25 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:34.634979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ff51fd9e-6181-4b87-8f23-3ae71ddfde25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:34.760269 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51fd9e-6181-4b87-8f23-3ae71ddfde25 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:34.813793 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:34.855697 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c33ef9-e12f-4ee6-ab68-421a2797b883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:34.856682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c33ef9-e12f-4ee6-ab68-421a2797b883 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:34.857082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c33ef9-e12f-4ee6-ab68-421a2797b883 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:34.857470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c33ef9-e12f-4ee6-ab68-421a2797b883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:34.859383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-18c33ef9-e12f-4ee6-ab68-421a2797b883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:34.989045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c33ef9-e12f-4ee6-ab68-421a2797b883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:34.990924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c33ef9-e12f-4ee6-ab68-421a2797b883 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:35.014042 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 719/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:37.299890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f4560-d4dc-4dc1-914d-ab3c0565e55f None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:37.300482 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f4560-d4dc-4dc1-914d-ab3c0565e55f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:37.300482 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f4560-d4dc-4dc1-914d-ab3c0565e55f None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:37.301848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:37.307395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bececfad-514b-4a1b-8d0e-f70f0ea9c175 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:37.307834 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bececfad-514b-4a1b-8d0e-f70f0ea9c175 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:37.307938 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bececfad-514b-4a1b-8d0e-f70f0ea9c175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:37.375023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-bececfad-514b-4a1b-8d0e-f70f0ea9c175 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:37.376143 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-bececfad-514b-4a1b-8d0e-f70f0ea9c175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:37.397609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:37.482072 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:37.522731 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f4560-d4dc-4dc1-914d-ab3c0565e55f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:37.524416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7c4f4560-d4dc-4dc1-914d-ab3c0565e55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:37.632275 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f4560-d4dc-4dc1-914d-ab3c0565e55f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:37.653870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:37.711120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f2d16-88e8-422d-95e6-7e81f6f14fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:37.711758 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2d16-88e8-422d-95e6-7e81f6f14fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:37.712035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2d16-88e8-422d-95e6-7e81f6f14fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:37.712321 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2d16-88e8-422d-95e6-7e81f6f14fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:37.713999 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-dc1f2d16-88e8-422d-95e6-7e81f6f14fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:37.827189 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f2d16-88e8-422d-95e6-7e81f6f14fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:37.828684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f2d16-88e8-422d-95e6-7e81f6f14fd6 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:37.847941 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 732/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:39.902654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647481a-d5e5-441b-8534-4d5fa1f7dc64 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:39.903562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647481a-d5e5-441b-8534-4d5fa1f7dc64 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:39.903562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647481a-d5e5-441b-8534-4d5fa1f7dc64 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:39.905859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:43:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:39.912308 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086f772-f8ee-4c1b-9e26-ea83743ab2dd None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:39.912308 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086f772-f8ee-4c1b-9e26-ea83743ab2dd None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:39.913279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086f772-f8ee-4c1b-9e26-ea83743ab2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:39.976535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:39.980935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-4086f772-f8ee-4c1b-9e26-ea83743ab2dd None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:39.982552 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4086f772-f8ee-4c1b-9e26-ea83743ab2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:40.099360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:40.142728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647481a-d5e5-441b-8534-4d5fa1f7dc64 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:40.145145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a647481a-d5e5-441b-8534-4d5fa1f7dc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:40.260389 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647481a-d5e5-441b-8534-4d5fa1f7dc64 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:40.316578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:40.342561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0eafe8-007b-4db8-b40d-fb8f1c37a4f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:40.343215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eafe8-007b-4db8-b40d-fb8f1c37a4f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:40.343526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eafe8-007b-4db8-b40d-fb8f1c37a4f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:40.343796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eafe8-007b-4db8-b40d-fb8f1c37a4f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:40.345494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3f0eafe8-007b-4db8-b40d-fb8f1c37a4f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:40.463968 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0eafe8-007b-4db8-b40d-fb8f1c37a4f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:40.465377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0eafe8-007b-4db8-b40d-fb8f1c37a4f6 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:40.484637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 722/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:42.578513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc00f2-850f-4670-bffc-ec125223fda8 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:42.579379 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc00f2-850f-4670-bffc-ec125223fda8 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:42.579379 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc00f2-850f-4670-bffc-ec125223fda8 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:42.581668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:43:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:42.589222 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b1aa9-527d-4d6d-836a-6833576dae29 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:42.589687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b1aa9-527d-4d6d-836a-6833576dae29 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:42.589795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b1aa9-527d-4d6d-836a-6833576dae29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:42.659881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-8c2b1aa9-527d-4d6d-836a-6833576dae29 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:42.661126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8c2b1aa9-527d-4d6d-836a-6833576dae29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:42.697636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:42.783268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:42.820972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc00f2-850f-4670-bffc-ec125223fda8 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:42.822501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-65cc00f2-850f-4670-bffc-ec125223fda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:42.940747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc00f2-850f-4670-bffc-ec125223fda8 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:42.972271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:43.021713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6dfb7-645c-419f-970f-4b3c372b72b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:43.022364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6dfb7-645c-419f-970f-4b3c372b72b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:43.022643 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6dfb7-645c-419f-970f-4b3c372b72b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:43.022916 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6dfb7-645c-419f-970f-4b3c372b72b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:43.024669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-02d6dfb7-645c-419f-970f-4b3c372b72b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:43.147298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6dfb7-645c-419f-970f-4b3c372b72b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:43.148688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6dfb7-645c-419f-970f-4b3c372b72b1 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:43.168266 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 735/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:45.244805 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b7aa9-e1d0-4cb4-a91b-e3b820d9a53a None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:45.245370 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b7aa9-e1d0-4cb4-a91b-e3b820d9a53a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:45.245370 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b7aa9-e1d0-4cb4-a91b-e3b820d9a53a None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:45.247454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:43:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:45.252868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440e108-0365-472d-bb08-69c014db62c9 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:45.253317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440e108-0365-472d-bb08-69c014db62c9 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:45.253420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440e108-0365-472d-bb08-69c014db62c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:45.317789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-8440e108-0365-472d-bb08-69c014db62c9 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:45.319034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8440e108-0365-472d-bb08-69c014db62c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:45.328414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:45.437480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:45.475314 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b7aa9-e1d0-4cb4-a91b-e3b820d9a53a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:45.476947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e57b7aa9-e1d0-4cb4-a91b-e3b820d9a53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:45.607191 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b7aa9-e1d0-4cb4-a91b-e3b820d9a53a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:45.665797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:45.685422 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebda803-5884-4b09-ae82-98db6cf045f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:45.686074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebda803-5884-4b09-ae82-98db6cf045f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:45.686356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebda803-5884-4b09-ae82-98db6cf045f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:45.686633 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebda803-5884-4b09-ae82-98db6cf045f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:45.688368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-eebda803-5884-4b09-ae82-98db6cf045f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:45.811627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebda803-5884-4b09-ae82-98db6cf045f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:45.813104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebda803-5884-4b09-ae82-98db6cf045f9 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:45.832902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 725/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:47.894829 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab72617-2031-4f33-aea5-07ed1c62e681 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:47.895736 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab72617-2031-4f33-aea5-07ed1c62e681 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:47.895736 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab72617-2031-4f33-aea5-07ed1c62e681 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:47.897412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:43:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:47.903251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4732138-cd9e-4834-a837-e614e17b97f6 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:47.903679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4732138-cd9e-4834-a837-e614e17b97f6 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:47.903803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4732138-cd9e-4834-a837-e614e17b97f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:47.984527 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-d4732138-cd9e-4834-a837-e614e17b97f6 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:47.985753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d4732138-cd9e-4834-a837-e614e17b97f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:48.025726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:48.085390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:48.122212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab72617-2031-4f33-aea5-07ed1c62e681 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:48.124547 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-fab72617-2031-4f33-aea5-07ed1c62e681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:48.244235 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab72617-2031-4f33-aea5-07ed1c62e681 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:48.283321 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:48.322194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393548a-dd27-4f9a-a7cd-4573dd8e361e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:48.322860 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393548a-dd27-4f9a-a7cd-4573dd8e361e service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:48.323138 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393548a-dd27-4f9a-a7cd-4573dd8e361e service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:48.323403 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393548a-dd27-4f9a-a7cd-4573dd8e361e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:48.325109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8393548a-dd27-4f9a-a7cd-4573dd8e361e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:48.436146 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393548a-dd27-4f9a-a7cd-4573dd8e361e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:48.437625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393548a-dd27-4f9a-a7cd-4573dd8e361e service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:48.456551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 738/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:50.504928 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972064b-218f-4e15-b663-9da0f86669d5 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:50.505641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972064b-218f-4e15-b663-9da0f86669d5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:50.505641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972064b-218f-4e15-b663-9da0f86669d5 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:50.506907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:50.512948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1630d9-2246-4750-8455-12937b77a525 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:50.513409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1630d9-2246-4750-8455-12937b77a525 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:50.513519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1630d9-2246-4750-8455-12937b77a525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:50.589905 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-9e1630d9-2246-4750-8455-12937b77a525 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:50.591112 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9e1630d9-2246-4750-8455-12937b77a525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:50.609969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:50.693770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:50.733237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972064b-218f-4e15-b663-9da0f86669d5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:50.734760 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b972064b-218f-4e15-b663-9da0f86669d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:50.855017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972064b-218f-4e15-b663-9da0f86669d5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:50.934579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:50.945074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fad0cb-d37e-4220-aaa8-aecd24839770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:50.946054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fad0cb-d37e-4220-aaa8-aecd24839770 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:50.946483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fad0cb-d37e-4220-aaa8-aecd24839770 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:50.946861 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fad0cb-d37e-4220-aaa8-aecd24839770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:50.949518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-74fad0cb-d37e-4220-aaa8-aecd24839770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:51.077927 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fad0cb-d37e-4220-aaa8-aecd24839770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:51.079385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fad0cb-d37e-4220-aaa8-aecd24839770 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:51.100825 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 728/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:43:53.156937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7681dfb-91e5-4994-b758-46bb69146c01 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:53.157496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7681dfb-91e5-4994-b758-46bb69146c01 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:53.157496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7681dfb-91e5-4994-b758-46bb69146c01 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:53.158908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:43:53.165474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70fa48-3f59-49cf-85bd-416464f6e3e0 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:53.166224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70fa48-3f59-49cf-85bd-416464f6e3e0 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:53.166346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70fa48-3f59-49cf-85bd-416464f6e3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:53.244839 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-1b70fa48-3f59-49cf-85bd-416464f6e3e0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:43:53.246723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1b70fa48-3f59-49cf-85bd-416464f6e3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:53.300085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:53.352451 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:43:53.398556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7681dfb-91e5-4994-b758-46bb69146c01 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:43:53.400112 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b7681dfb-91e5-4994-b758-46bb69146c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:53.508254 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7681dfb-91e5-4994-b758-46bb69146c01 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:43:53.558349 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:43:53.585929 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dab0d-e5ed-4041-a185-6f78984a8cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:43:53.586583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dab0d-e5ed-4041-a185-6f78984a8cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:43:53.586869 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dab0d-e5ed-4041-a185-6f78984a8cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:43:53.587148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dab0d-e5ed-4041-a185-6f78984a8cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:43:53.588847 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d41dab0d-e5ed-4041-a185-6f78984a8cd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:43:53.710972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dab0d-e5ed-4041-a185-6f78984a8cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:43:53.712337 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dab0d-e5ed-4041-a185-6f78984a8cd5 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:43:53.731961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 741/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:44:03.350356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=22 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:03.729224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=66 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:13.367416 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b868b56-f1b4-4175-aa4f-6846aa794590 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:13.367971 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b868b56-f1b4-4175-aa4f-6846aa794590 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:13.367971 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b868b56-f1b4-4175-aa4f-6846aa794590 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:13.369288 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 730/1471] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:44:13.375515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12b1d-c72e-4962-b36e-338304b957e3 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:13.375956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12b1d-c72e-4962-b36e-338304b957e3 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:13.376066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12b1d-c72e-4962-b36e-338304b957e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:13.450991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-44c12b1d-c72e-4962-b36e-338304b957e3 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:13.452188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-44c12b1d-c72e-4962-b36e-338304b957e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:13.551507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 742/1472] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:44:13.644096 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02c801-1802-4c4f-bc6b-e0051f4414d7 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:13.644497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02c801-1802-4c4f-bc6b-e0051f4414d7 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:13.644857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02c801-1802-4c4f-bc6b-e0051f4414d7 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:13.647154 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 731/1473] 10.222.0.26 () {54 vars in 962 bytes} [Mon Jul 11 15:44:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:13.653280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d58fe-1fff-476d-8c6b-55cd839e362b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:13.653578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d58fe-1fff-476d-8c6b-55cd839e362b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:13.653929 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d58fe-1fff-476d-8c6b-55cd839e362b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:13.734255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-b59d58fe-1fff-476d-8c6b-55cd839e362b None None] MFA Rules not processed for user `3be29cfa76174b44b99ddaf3d293ead1`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:13.735440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b59d58fe-1fff-476d-8c6b-55cd839e362b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:13.758147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:13.814309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 743/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Jul 11 15:44:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:44:13.821958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02c801-1802-4c4f-bc6b-e0051f4414d7 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:13.823481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fc02c801-1802-4c4f-bc6b-e0051f4414d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:13.946017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02c801-1802-4c4f-bc6b-e0051f4414d7 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:14.020616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6073f6-e0ae-4e87-a9ce-e10cde8c1bca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be29cfa76174b44b99ddaf3d293ead1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:14.021228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6073f6-e0ae-4e87-a9ce-e10cde8c1bca service glance] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:14.021508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6073f6-e0ae-4e87-a9ce-e10cde8c1bca service glance] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:14.021777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6073f6-e0ae-4e87-a9ce-e10cde8c1bca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:14.023702 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7d6073f6-e0ae-4e87-a9ce-e10cde8c1bca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:14.079985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:14.139216 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6073f6-e0ae-4e87-a9ce-e10cde8c1bca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:14.140745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6073f6-e0ae-4e87-a9ce-e10cde8c1bca service glance] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:14.161583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 732/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:44:16.255413 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4ef03-a31c-4bb3-920a-b310a03f9e6c None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:16.255962 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4ef03-a31c-4bb3-920a-b310a03f9e6c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:16.255962 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4ef03-a31c-4bb3-920a-b310a03f9e6c None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:16.257380 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 744/1476] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:16.263811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ef235-5524-4863-adbb-431b8bd83837 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:16.264276 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ef235-5524-4863-adbb-431b8bd83837 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:16.264422 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ef235-5524-4863-adbb-431b8bd83837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:16.332374 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-846ef235-5524-4863-adbb-431b8bd83837 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:16.333635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-846ef235-5524-4863-adbb-431b8bd83837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:16.436744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 733/1477] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:44:16.468586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4ef03-a31c-4bb3-920a-b310a03f9e6c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:16.470040 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c2c4ef03-a31c-4bb3-920a-b310a03f9e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:16.618196 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4ef03-a31c-4bb3-920a-b310a03f9e6c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:16.675344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:16.722884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb11df3-3f81-4f7e-8f7a-ea40d1588c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:16.723680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb11df3-3f81-4f7e-8f7a-ea40d1588c87 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:16.724281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb11df3-3f81-4f7e-8f7a-ea40d1588c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:16.724592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb11df3-3f81-4f7e-8f7a-ea40d1588c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:16.725344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb11df3-3f81-4f7e-8f7a-ea40d1588c87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:16.727085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: WARNING py.warnings [None req-4eb11df3-3f81-4f7e-8f7a-ea40d1588c87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:44:16.727085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: warnings.warn(msg) Jul 11 15:44:16.727085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: Jul 11 15:44:16.728234 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb11df3-3f81-4f7e-8f7a-ea40d1588c87 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:16.749851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 745/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Jul 11 15:44:16 2022] GET /identity/v3/projects => generated 2553 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:44:18.783741 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffe94e-ca37-407d-bb6b-7ca5cc853bad None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:18.784364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffe94e-ca37-407d-bb6b-7ca5cc853bad None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:18.784364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffe94e-ca37-407d-bb6b-7ca5cc853bad None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:18.785713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 734/1479] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:18.792890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27baf0-94f5-42c0-b78e-4d10096c2d1d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:18.793615 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27baf0-94f5-42c0-b78e-4d10096c2d1d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:18.793876 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27baf0-94f5-42c0-b78e-4d10096c2d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:18.878698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-2b27baf0-94f5-42c0-b78e-4d10096c2d1d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:18.880612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2b27baf0-94f5-42c0-b78e-4d10096c2d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:18.983415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 746/1480] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:44:19.028024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffe94e-ca37-407d-bb6b-7ca5cc853bad None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:19.030352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-11ffe94e-ca37-407d-bb6b-7ca5cc853bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:19.042673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:19.190573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffe94e-ca37-407d-bb6b-7ca5cc853bad None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:19.280610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:19.314378 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775239e3-a33c-4070-9b7c-122f8d6d64f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:19.314956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775239e3-a33c-4070-9b7c-122f8d6d64f8 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:19.315237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775239e3-a33c-4070-9b7c-122f8d6d64f8 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:19.315512 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775239e3-a33c-4070-9b7c-122f8d6d64f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:19.317199 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-775239e3-a33c-4070-9b7c-122f8d6d64f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:19.410415 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775239e3-a33c-4070-9b7c-122f8d6d64f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:19.412190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775239e3-a33c-4070-9b7c-122f8d6d64f8 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:19.431573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 735/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:44:21.642818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a601e-ad1d-4fbb-b30a-73ef534ffe6b None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:21.643527 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a601e-ad1d-4fbb-b30a-73ef534ffe6b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:21.643527 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a601e-ad1d-4fbb-b30a-73ef534ffe6b None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:21.644801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 747/1482] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:21.651053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9d8b1-c64a-4b68-bcb6-68ced8fe0892 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:21.651526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9d8b1-c64a-4b68-bcb6-68ced8fe0892 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:21.651631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9d8b1-c64a-4b68-bcb6-68ced8fe0892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:21.730894 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-13b9d8b1-c64a-4b68-bcb6-68ced8fe0892 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:21.732108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-13b9d8b1-c64a-4b68-bcb6-68ced8fe0892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:21.784598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:21.840475 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 736/1483] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:44:21.876744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a601e-ad1d-4fbb-b30a-73ef534ffe6b None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:21.878283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-324a601e-ad1d-4fbb-b30a-73ef534ffe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:21.902348 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:21.999220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a601e-ad1d-4fbb-b30a-73ef534ffe6b None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:22.087753 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1f830-e829-4863-9cc3-6119019bee14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:22.088423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1f830-e829-4863-9cc3-6119019bee14 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:22.088704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1f830-e829-4863-9cc3-6119019bee14 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:22.088980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1f830-e829-4863-9cc3-6119019bee14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:22.090585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-26e1f830-e829-4863-9cc3-6119019bee14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:22.175813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:22.212757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1f830-e829-4863-9cc3-6119019bee14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:22.214224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1f830-e829-4863-9cc3-6119019bee14 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:22.232880 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 748/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:44:24.307459 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083dee8-e94b-4ee9-8cf0-6bdba5e5a638 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:24.307958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083dee8-e94b-4ee9-8cf0-6bdba5e5a638 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:24.308062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083dee8-e94b-4ee9-8cf0-6bdba5e5a638 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:24.309453 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 737/1485] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:24.314865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d414d-d953-43ac-abe4-36826b556064 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:24.315310 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d414d-d953-43ac-abe4-36826b556064 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:24.315416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d414d-d953-43ac-abe4-36826b556064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:24.381889 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-446d414d-d953-43ac-abe4-36826b556064 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:24.383133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-446d414d-d953-43ac-abe4-36826b556064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:24.489995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 749/1486] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:44:24.531032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083dee8-e94b-4ee9-8cf0-6bdba5e5a638 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:24.533388 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9083dee8-e94b-4ee9-8cf0-6bdba5e5a638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:24.655189 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083dee8-e94b-4ee9-8cf0-6bdba5e5a638 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:24.733357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:24.735211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d052c-236f-47ff-8d70-5d3d7365b3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:24.736112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d052c-236f-47ff-8d70-5d3d7365b3ea service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:24.736391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d052c-236f-47ff-8d70-5d3d7365b3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:24.736827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d052c-236f-47ff-8d70-5d3d7365b3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:24.739146 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ee2d052c-236f-47ff-8d70-5d3d7365b3ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:24.854217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d052c-236f-47ff-8d70-5d3d7365b3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:24.855707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d052c-236f-47ff-8d70-5d3d7365b3ea service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:24.876043 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 738/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:44:27.056464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cf6d1-9544-4460-9982-c451e04cbcaa None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.057383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cf6d1-9544-4460-9982-c451e04cbcaa None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.057383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cf6d1-9544-4460-9982-c451e04cbcaa None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.059518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 750/1488] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:44:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:27.065986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b8d1-b562-4195-b0af-8ca1c9727b3d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.066456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b8d1-b562-4195-b0af-8ca1c9727b3d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.066559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b8d1-b562-4195-b0af-8ca1c9727b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.139491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-3ca6b8d1-b562-4195-b0af-8ca1c9727b3d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:27.140744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3ca6b8d1-b562-4195-b0af-8ca1c9727b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:27.195904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:27.243340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 739/1489] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:44:27.283615 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cf6d1-9544-4460-9982-c451e04cbcaa None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:27.286009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ba2cf6d1-9544-4460-9982-c451e04cbcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:27.329101 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:27.432794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cf6d1-9544-4460-9982-c451e04cbcaa None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:27.517782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7794f49-b994-4f22-b01c-3aa03b97a1a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:27.518443 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7794f49-b994-4f22-b01c-3aa03b97a1a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:27.518727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7794f49-b994-4f22-b01c-3aa03b97a1a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:27.519000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7794f49-b994-4f22-b01c-3aa03b97a1a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:27.520809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d7794f49-b994-4f22-b01c-3aa03b97a1a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:27.613344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:27.643920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7794f49-b994-4f22-b01c-3aa03b97a1a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:27.645614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7794f49-b994-4f22-b01c-3aa03b97a1a6 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:27.665011 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 751/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:44:29.943151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5be3b-c2ed-4a12-9e89-3d760958886d None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.943749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5be3b-c2ed-4a12-9e89-3d760958886d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.943749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5be3b-c2ed-4a12-9e89-3d760958886d None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:29.945219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 740/1491] 10.222.0.26 () {54 vars in 926 bytes} [Mon Jul 11 15:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:44:29.950712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ae46c-83e9-4dec-87e8-375768c62bba None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:29.951173 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ae46c-83e9-4dec-87e8-375768c62bba None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:29.951279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ae46c-83e9-4dec-87e8-375768c62bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:30.016862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-da4ae46c-83e9-4dec-87e8-375768c62bba None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:44:30.018065 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-da4ae46c-83e9-4dec-87e8-375768c62bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:30.137521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 752/1492] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Jul 11 15:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:44:30.179525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5be3b-c2ed-4a12-9e89-3d760958886d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:44:30.181983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8ed5be3b-c2ed-4a12-9e89-3d760958886d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:30.296214 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5be3b-c2ed-4a12-9e89-3d760958886d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:44:30.371374 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15593cc1-7c85-4db9-8055-ea81a213ab1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:44:30.372025 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15593cc1-7c85-4db9-8055-ea81a213ab1e service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:44:30.372338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15593cc1-7c85-4db9-8055-ea81a213ab1e service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:44:30.372598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15593cc1-7c85-4db9-8055-ea81a213ab1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:44:30.374242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-15593cc1-7c85-4db9-8055-ea81a213ab1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:44:30.384043 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:30.486604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15593cc1-7c85-4db9-8055-ea81a213ab1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:44:30.488064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15593cc1-7c85-4db9-8055-ea81a213ab1e service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:44:30.507290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 741/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:44:40.135619 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=82 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:44:40.505073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=50 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:56.736233 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f1cfa-8213-4890-911b-ad8f93c95c31 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:56.737276 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f1cfa-8213-4890-911b-ad8f93c95c31 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:56.737276 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f1cfa-8213-4890-911b-ad8f93c95c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:56.832187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-170f1cfa-8213-4890-911b-ad8f93c95c31 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:56.833435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-170f1cfa-8213-4890-911b-ad8f93c95c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:56.953224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 753/1494] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:56.962091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd726639-9a97-4a01-802b-2f0523611363 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:56.962604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd726639-9a97-4a01-802b-2f0523611363 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:56.962604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd726639-9a97-4a01-802b-2f0523611363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:57.041092 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-bd726639-9a97-4a01-802b-2f0523611363 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:57.042313 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-bd726639-9a97-4a01-802b-2f0523611363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:57.162656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 742/1495] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:57.167444 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f1cfa-8213-4890-911b-ad8f93c95c31 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:57.168702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-170f1cfa-8213-4890-911b-ad8f93c95c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:57.180827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f1cfa-8213-4890-911b-ad8f93c95c31 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:57.246203 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:57.283203 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f2513-d039-4be5-a405-8696590424a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:57.283950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2513-d039-4be5-a405-8696590424a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:57.284237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2513-d039-4be5-a405-8696590424a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:57.284546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2513-d039-4be5-a405-8696590424a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:57.285293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f2513-d039-4be5-a405-8696590424a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:45:57.285592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f2513-d039-4be5-a405-8696590424a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:57.286622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: WARNING py.warnings [None req-a70f2513-d039-4be5-a405-8696590424a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:45:57.286622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: warnings.warn(msg) Jul 11 15:45:57.286622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: Jul 11 15:45:57.287523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f2513-d039-4be5-a405-8696590424a5 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:57.299463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 754/1496] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:45:57.311688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd726639-9a97-4a01-802b-2f0523611363 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:57.321536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd726639-9a97-4a01-802b-2f0523611363 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:57.389510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:57.424954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74a919-6831-4734-b5a6-c8fac58bd664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:57.425542 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74a919-6831-4734-b5a6-c8fac58bd664 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:57.425826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74a919-6831-4734-b5a6-c8fac58bd664 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:57.426098 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74a919-6831-4734-b5a6-c8fac58bd664 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:57.426777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74a919-6831-4734-b5a6-c8fac58bd664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:57.428600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: WARNING py.warnings [None req-8c74a919-6831-4734-b5a6-c8fac58bd664 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:45:57.428600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: warnings.warn(msg) Jul 11 15:45:57.428600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: Jul 11 15:45:57.429799 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74a919-6831-4734-b5a6-c8fac58bd664 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:57.505292 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 743/1497] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:45:57 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:57.509728 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f2513-d039-4be5-a405-8696590424a5 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:57.511268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a70f2513-d039-4be5-a405-8696590424a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:57.552612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f2513-d039-4be5-a405-8696590424a5 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:57.653393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce26be-fde7-45ce-9d16-f2a7147e736e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:57.654071 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce26be-fde7-45ce-9d16-f2a7147e736e admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:57.654355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce26be-fde7-45ce-9d16-f2a7147e736e admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:57.654629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce26be-fde7-45ce-9d16-f2a7147e736e admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:57.655327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce26be-fde7-45ce-9d16-f2a7147e736e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:57.656359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: WARNING py.warnings [None req-23ce26be-fde7-45ce-9d16-f2a7147e736e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:45:57.656359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: warnings.warn(msg) Jul 11 15:45:57.656359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: Jul 11 15:45:57.657606 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce26be-fde7-45ce-9d16-f2a7147e736e admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:57.701926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 755/1498] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:45:57 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:45:57.706177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74a919-6831-4734-b5a6-c8fac58bd664 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:57.707678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8c74a919-6831-4734-b5a6-c8fac58bd664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:57.773672 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74a919-6831-4734-b5a6-c8fac58bd664 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:57.870782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:57.886041 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2756453-65e1-423e-8196-86fed4f65dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:57.886767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756453-65e1-423e-8196-86fed4f65dce admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:57.887048 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756453-65e1-423e-8196-86fed4f65dce admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:57.887320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756453-65e1-423e-8196-86fed4f65dce admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:57.888055 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2756453-65e1-423e-8196-86fed4f65dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:57.889428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: WARNING py.warnings [None req-d2756453-65e1-423e-8196-86fed4f65dce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:45:57.889428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: warnings.warn(msg) Jul 11 15:45:57.889428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: Jul 11 15:45:57.890313 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2756453-65e1-423e-8196-86fed4f65dce admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:57.904111 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 744/1499] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:45:57.908515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce26be-fde7-45ce-9d16-f2a7147e736e admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:57.910132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-23ce26be-fde7-45ce-9d16-f2a7147e736e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:57.922150 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce26be-fde7-45ce-9d16-f2a7147e736e admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:57.949587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:58.027802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9a4b5-833a-4a28-b71c-b3f59632f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:58.028515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9a4b5-833a-4a28-b71c-b3f59632f17e admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:58.028794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9a4b5-833a-4a28-b71c-b3f59632f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:58.029059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9a4b5-833a-4a28-b71c-b3f59632f17e admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:58.029824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9a4b5-833a-4a28-b71c-b3f59632f17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:58.030848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: WARNING py.warnings [None req-afd9a4b5-833a-4a28-b71c-b3f59632f17e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:45:58.030848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: warnings.warn(msg) Jul 11 15:45:58.030848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: Jul 11 15:45:58.031746 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9a4b5-833a-4a28-b71c-b3f59632f17e admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:58.044731 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 756/1500] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:45:58.049147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2756453-65e1-423e-8196-86fed4f65dce admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:58.051007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d2756453-65e1-423e-8196-86fed4f65dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:58.089628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2756453-65e1-423e-8196-86fed4f65dce admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:58.202664 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201157d-4862-4fe9-81fe-c1090089bd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:58.203579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201157d-4862-4fe9-81fe-c1090089bd12 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:58.203969 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201157d-4862-4fe9-81fe-c1090089bd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:58.204502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201157d-4862-4fe9-81fe-c1090089bd12 admin admin] PATH_INFO: `/v3/projects/e7ca61f5306e42d5a70cc35802944539/users/367a9dd92ede4e7481f1dbd27afd84c3/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:58.232047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201157d-4862-4fe9-81fe-c1090089bd12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ca61f5306e42d5a70cc35802944539, user_id=367a9dd92ede4e7481f1dbd27afd84c3, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:58.233049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: WARNING py.warnings [None req-5201157d-4862-4fe9-81fe-c1090089bd12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:45:58.233049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: warnings.warn(msg) Jul 11 15:45:58.233049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: Jul 11 15:45:58.235007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201157d-4862-4fe9-81fe-c1090089bd12 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:58.263627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 745/1501] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:45:58 2022] PUT /identity/v3/projects/e7ca61f5306e42d5a70cc35802944539/users/367a9dd92ede4e7481f1dbd27afd84c3/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:58.276343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d68f08-28b7-40c4-93d3-c397349bb0d2 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:58.280426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d68f08-28b7-40c4-93d3-c397349bb0d2 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:58.280714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d68f08-28b7-40c4-93d3-c397349bb0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:58.342919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-42d68f08-28b7-40c4-93d3-c397349bb0d2 None None] MFA Rules not processed for user `367a9dd92ede4e7481f1dbd27afd84c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:58.344166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-42d68f08-28b7-40c4-93d3-c397349bb0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:58.431517 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 757/1502] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:45:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:58.445456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c606dc-24eb-408b-915d-c4b758da435e None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:58.445743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c606dc-24eb-408b-915d-c4b758da435e None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:58.446010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c606dc-24eb-408b-915d-c4b758da435e None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:58.447411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 746/1503] 10.222.0.26 () {54 vars in 963 bytes} [Mon Jul 11 15:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:58.452319 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750f60a-265b-4966-afb1-60288ff84498 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:58.452624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750f60a-265b-4966-afb1-60288ff84498 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:58.452903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750f60a-265b-4966-afb1-60288ff84498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:58.484185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:58.530154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-f750f60a-265b-4966-afb1-60288ff84498 None None] MFA Rules not processed for user `73732594dbee480e9e5d153ca1382494`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:58.531348 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f750f60a-265b-4966-afb1-60288ff84498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:58.612823 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 758/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Mon Jul 11 15:45:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:58.620679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c606dc-24eb-408b-915d-c4b758da435e None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:58.622208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-16c606dc-24eb-408b-915d-c4b758da435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:58.676362 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:58.744283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c606dc-24eb-408b-915d-c4b758da435e None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:58.827502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376f014-c082-446e-bf40-866f687a7441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:58.828147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376f014-c082-446e-bf40-866f687a7441 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:58.828458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376f014-c082-446e-bf40-866f687a7441 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:58.828733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376f014-c082-446e-bf40-866f687a7441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:58.830390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b376f014-c082-446e-bf40-866f687a7441 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:58.959769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376f014-c082-446e-bf40-866f687a7441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:58.961589 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376f014-c082-446e-bf40-866f687a7441 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:58.965088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:58.981144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 747/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:45:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:45:59.027597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32aae9-1219-4f7d-bbeb-70a0dc22eb36 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:59.028062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32aae9-1219-4f7d-bbeb-70a0dc22eb36 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:59.028179 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32aae9-1219-4f7d-bbeb-70a0dc22eb36 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:59.029515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 759/1506] 10.222.0.26 () {52 vars in 829 bytes} [Mon Jul 11 15:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:45:59.035021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376f014-c082-446e-bf40-866f687a7441 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:59.036242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b376f014-c082-446e-bf40-866f687a7441 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:59.142477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376f014-c082-446e-bf40-866f687a7441 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:59.245048 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:59.246465 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:59.246872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:59.247284 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] PATH_INFO: `/v3/users/367a9dd92ede4e7481f1dbd27afd84c3` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:59.263169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=367a9dd92ede4e7481f1dbd27afd84c3)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:59.264160 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: WARNING py.warnings [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:45:59.264160 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: warnings.warn(msg) Jul 11 15:45:59.264160 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: Jul 11 15:45:59.265418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:59.276190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:59.344147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367a9dd92ede4e7481f1dbd27afd84c3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:59.363334 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367a9dd92ede4e7481f1dbd27afd84c3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:59.363892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367a9dd92ede4e7481f1dbd27afd84c3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:59.364331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367a9dd92ede4e7481f1dbd27afd84c3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:59.376267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367a9dd92ede4e7481f1dbd27afd84c3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:45:59.400167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 748/1507] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:45:59 2022] DELETE /identity/v3/users/367a9dd92ede4e7481f1dbd27afd84c3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:45:59.404585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67a264-dedc-48cc-a7fd-d3a6c61f16fb None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:59.404858 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67a264-dedc-48cc-a7fd-d3a6c61f16fb None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:59.405137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67a264-dedc-48cc-a7fd-d3a6c61f16fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:59.470237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-fc67a264-dedc-48cc-a7fd-d3a6c61f16fb None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:45:59.472342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-fc67a264-dedc-48cc-a7fd-d3a6c61f16fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:59.555468 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:59.569240 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 760/1508] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:45:59.583239 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:45:59.584518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:59.698154 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8738f3-bf6c-4a52-8909-db89cac9bdb9 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:45:59.755371 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:45:59.777226 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4050316-b9c8-4c16-8737-cea94ded323d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:45:59.777882 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4050316-b9c8-4c16-8737-cea94ded323d service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:45:59.778157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4050316-b9c8-4c16-8737-cea94ded323d service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:45:59.778408 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4050316-b9c8-4c16-8737-cea94ded323d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:45:59.780050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a4050316-b9c8-4c16-8737-cea94ded323d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:45:59.899583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4050316-b9c8-4c16-8737-cea94ded323d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:45:59.900984 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4050316-b9c8-4c16-8737-cea94ded323d service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:45:59.922736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 749/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:46:00.277992 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67a264-dedc-48cc-a7fd-d3a6c61f16fb None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:46:00.279245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-fc67a264-dedc-48cc-a7fd-d3a6c61f16fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:46:00.291161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67a264-dedc-48cc-a7fd-d3a6c61f16fb None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:46:00.388514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:46:00.389378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:46:00.389666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:46:00.389941 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92 admin admin] PATH_INFO: `/v3/projects/e7ca61f5306e42d5a70cc35802944539` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:46:00.400060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ca61f5306e42d5a70cc35802944539)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:46:00.401134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: WARNING py.warnings [None req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:46:00.401134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: warnings.warn(msg) Jul 11 15:46:00.401134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: Jul 11 15:46:00.402359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:46:00.464252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ca61f5306e42d5a70cc35802944539', 'request_id': 'req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:46:00.477416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ca61f5306e42d5a70cc35802944539', 'request_id': 'req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:46:00.483552 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ca61f5306e42d5a70cc35802944539', 'request_id': 'req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:46:00.511863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92 admin admin] The token cache is being invalidate because project e7ca61f5306e42d5a70cc35802944539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:46:00.512152 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:46:00.512705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3e7b89fc-670f-46a6-9e2b-3087c2dcfe92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:46:00.514090 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 761/1510] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:46:00 2022] DELETE /identity/v3/projects/e7ca61f5306e42d5a70cc35802944539 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:46:09.918500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=62 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:46:10.509955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:39.137694 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94be9e-163c-40bf-8502-3e71e30636d5 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:39.138659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94be9e-163c-40bf-8502-3e71e30636d5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:39.138659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94be9e-163c-40bf-8502-3e71e30636d5 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:39.140950 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:47:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:39.145972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c945f6a-3621-41ac-afd4-ca6043f34c62 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:39.146460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c945f6a-3621-41ac-afd4-ca6043f34c62 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:39.146553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c945f6a-3621-41ac-afd4-ca6043f34c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:39.240679 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-0c945f6a-3621-41ac-afd4-ca6043f34c62 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:39.241808 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-0c945f6a-3621-41ac-afd4-ca6043f34c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:39.354661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:39.506073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94be9e-163c-40bf-8502-3e71e30636d5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:39.509626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8d94be9e-163c-40bf-8502-3e71e30636d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:39.647801 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94be9e-163c-40bf-8502-3e71e30636d5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:39.654447 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa5b69-383b-4b7f-bdd3-47ad74761d1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:39.655103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa5b69-383b-4b7f-bdd3-47ad74761d1c service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:39.655396 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa5b69-383b-4b7f-bdd3-47ad74761d1c service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:39.655673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa5b69-383b-4b7f-bdd3-47ad74761d1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:39.664565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa5b69-383b-4b7f-bdd3-47ad74761d1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:39.666198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa5b69-383b-4b7f-bdd3-47ad74761d1c service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:39.675928 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 751/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:47:40.510563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cca37-9ce2-4323-862e-e6394a35eee8 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:40.511104 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cca37-9ce2-4323-862e-e6394a35eee8 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:40.511104 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cca37-9ce2-4323-862e-e6394a35eee8 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:40.512486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:40.518420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50a19a-dedc-400f-8403-de79a102d9ee None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:40.519118 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50a19a-dedc-400f-8403-de79a102d9ee None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:40.519267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50a19a-dedc-400f-8403-de79a102d9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:40.545940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-7a50a19a-dedc-400f-8403-de79a102d9ee None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:40.547815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7a50a19a-dedc-400f-8403-de79a102d9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:40.558288 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:40.711739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cca37-9ce2-4323-862e-e6394a35eee8 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:40.730659 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cca37-9ce2-4323-862e-e6394a35eee8 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:40.739205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db019475-8a9b-45f4-8555-75540e9f4f02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:40.739851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db019475-8a9b-45f4-8555-75540e9f4f02 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:40.740135 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db019475-8a9b-45f4-8555-75540e9f4f02 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:40.740440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db019475-8a9b-45f4-8555-75540e9f4f02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:40.749582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db019475-8a9b-45f4-8555-75540e9f4f02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:40.752738 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db019475-8a9b-45f4-8555-75540e9f4f02 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:40.768515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 764/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:47:41.131459 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678e03e-5f42-453f-8676-0999144faf26 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:41.131742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678e03e-5f42-453f-8676-0999144faf26 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:41.132055 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678e03e-5f42-453f-8676-0999144faf26 None None] PATH_INFO: `/v3` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:41.133549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 753/1517] 10.222.0.27 () {54 vars in 925 bytes} [Mon Jul 11 15:47:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:47:41.140175 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82484a9-3d72-4a24-8c95-d972d5f7d02a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:41.140506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82484a9-3d72-4a24-8c95-d972d5f7d02a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:41.140778 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82484a9-3d72-4a24-8c95-d972d5f7d02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:41.218126 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-a82484a9-3d72-4a24-8c95-d972d5f7d02a None None] MFA Rules not processed for user `dbb5484ecb194023aa8415cb8b52ca5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:41.219350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a82484a9-3d72-4a24-8c95-d972d5f7d02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:41.237715 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:47:41.304684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 765/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Jul 11 15:47:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:45.144782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22906ad-d683-4965-978b-c76b9dc26769 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:45.145627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22906ad-d683-4965-978b-c76b9dc26769 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:45.145627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22906ad-d683-4965-978b-c76b9dc26769 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:45.147797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 754/1519] 10.222.0.26 () {54 vars in 960 bytes} [Mon Jul 11 15:47:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:45.154914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99094f-328b-4999-9f3d-0d2aa33119f7 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:45.155338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99094f-328b-4999-9f3d-0d2aa33119f7 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:45.155495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99094f-328b-4999-9f3d-0d2aa33119f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:45.175205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-7d99094f-328b-4999-9f3d-0d2aa33119f7 None None] MFA Rules not processed for user `dbb5484ecb194023aa8415cb8b52ca5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:45.176452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7d99094f-328b-4999-9f3d-0d2aa33119f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:45.186390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 766/1520] 10.222.0.26 () {58 vars in 1057 bytes} [Mon Jul 11 15:47:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:45.193857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22906ad-d683-4965-978b-c76b9dc26769 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:45.210527 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22906ad-d683-4965-978b-c76b9dc26769 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:45.216131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bc160-666e-4a2c-a2f8-86c277198a77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:45.216808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bc160-666e-4a2c-a2f8-86c277198a77 service placement] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:45.217094 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bc160-666e-4a2c-a2f8-86c277198a77 service placement] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:45.217366 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bc160-666e-4a2c-a2f8-86c277198a77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:45.226738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616bc160-666e-4a2c-a2f8-86c277198a77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:45.228409 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616bc160-666e-4a2c-a2f8-86c277198a77 service placement] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:45.239164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 755/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:47:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:47:52.010268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a04ca-471b-452a-85c2-6602d57312b2 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:52.010808 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a04ca-471b-452a-85c2-6602d57312b2 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:52.010808 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a04ca-471b-452a-85c2-6602d57312b2 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:52.012132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:52.018548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80f596-6b34-4a46-a8ac-7682d37c0487 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:52.019103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80f596-6b34-4a46-a8ac-7682d37c0487 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:52.019391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80f596-6b34-4a46-a8ac-7682d37c0487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:52.039994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-4e80f596-6b34-4a46-a8ac-7682d37c0487 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:52.041217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4e80f596-6b34-4a46-a8ac-7682d37c0487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:52.051650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:52.208052 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a04ca-471b-452a-85c2-6602d57312b2 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:52.229362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a04ca-471b-452a-85c2-6602d57312b2 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:52.235725 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686589e2-2118-4b89-b0fe-2a0da027aafc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:52.236504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686589e2-2118-4b89-b0fe-2a0da027aafc service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:52.236813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686589e2-2118-4b89-b0fe-2a0da027aafc service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:52.237128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686589e2-2118-4b89-b0fe-2a0da027aafc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:52.246285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686589e2-2118-4b89-b0fe-2a0da027aafc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:52.247911 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686589e2-2118-4b89-b0fe-2a0da027aafc service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:52.259848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 768/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:47:53.090796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f659e-c3a9-474d-9cd6-e3b8c5444581 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:53.091731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f659e-c3a9-474d-9cd6-e3b8c5444581 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:53.091902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f659e-c3a9-474d-9cd6-e3b8c5444581 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:53.094599 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 15:47:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:53.099766 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e52d7-dd94-4065-8474-85586a9b6c74 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:53.100193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e52d7-dd94-4065-8474-85586a9b6c74 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:53.100361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e52d7-dd94-4065-8474-85586a9b6c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:53.121442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-cc3e52d7-dd94-4065-8474-85586a9b6c74 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:53.122624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-cc3e52d7-dd94-4065-8474-85586a9b6c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:53.131834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 15:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:53.287559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f659e-c3a9-474d-9cd6-e3b8c5444581 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:53.306640 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f659e-c3a9-474d-9cd6-e3b8c5444581 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:53.318063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342974a-ae20-4523-9829-fc038f4ffe1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:53.318997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342974a-ae20-4523-9829-fc038f4ffe1b service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:53.319394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342974a-ae20-4523-9829-fc038f4ffe1b service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:53.319753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342974a-ae20-4523-9829-fc038f4ffe1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:53.332134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342974a-ae20-4523-9829-fc038f4ffe1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:53.333814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342974a-ae20-4523-9829-fc038f4ffe1b service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:53.344264 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 758/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:47:57.331171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4485b6e-1a44-4ed5-afde-89a02730333c None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:57.332421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4485b6e-1a44-4ed5-afde-89a02730333c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:57.332603 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4485b6e-1a44-4ed5-afde-89a02730333c None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:57.335588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:47:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:57.344242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfdd0e-a012-4d60-869f-6d474bc303ec None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:57.344748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfdd0e-a012-4d60-869f-6d474bc303ec None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:57.344862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfdd0e-a012-4d60-869f-6d474bc303ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:57.364407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-ecbfdd0e-a012-4d60-869f-6d474bc303ec None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:57.365645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ecbfdd0e-a012-4d60-869f-6d474bc303ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:57.374148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:57.450578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4485b6e-1a44-4ed5-afde-89a02730333c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:57.453906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f4485b6e-1a44-4ed5-afde-89a02730333c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:57.549597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4485b6e-1a44-4ed5-afde-89a02730333c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:57.554058 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5877657-4bf5-4909-9104-bd910b549e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:57.554711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5877657-4bf5-4909-9104-bd910b549e5c service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:57.554991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5877657-4bf5-4909-9104-bd910b549e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:57.555253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5877657-4bf5-4909-9104-bd910b549e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:57.567323 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5877657-4bf5-4909-9104-bd910b549e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:57.568824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5877657-4bf5-4909-9104-bd910b549e5c service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:57.578367 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 771/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:47:59.569814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8700df-b148-4d0e-bc8e-cdf9b7e2d32f None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:59.570486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8700df-b148-4d0e-bc8e-cdf9b7e2d32f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:59.570486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8700df-b148-4d0e-bc8e-cdf9b7e2d32f None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:59.571779 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:47:59.578088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835d807-375a-4b07-b757-875ac7b7d13b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:59.578551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835d807-375a-4b07-b757-875ac7b7d13b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:59.578741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835d807-375a-4b07-b757-875ac7b7d13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:59.603500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-f835d807-375a-4b07-b757-875ac7b7d13b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:47:59.604729 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f835d807-375a-4b07-b757-875ac7b7d13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:47:59.613728 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:47:59.649552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8700df-b148-4d0e-bc8e-cdf9b7e2d32f None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:47:59.662990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8700df-b148-4d0e-bc8e-cdf9b7e2d32f None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:47:59.667422 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d093c53-b1a6-426f-8d2e-13b4d0460bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:47:59.668071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d093c53-b1a6-426f-8d2e-13b4d0460bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:47:59.668385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d093c53-b1a6-426f-8d2e-13b4d0460bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:47:59.668693 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d093c53-b1a6-426f-8d2e-13b4d0460bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:47:59.678353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d093c53-b1a6-426f-8d2e-13b4d0460bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:47:59.679822 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d093c53-b1a6-426f-8d2e-13b4d0460bd9 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:47:59.689459 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 761/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:48:03.080094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384ce87-a800-4984-8661-148828f1743c None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:03.080772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384ce87-a800-4984-8661-148828f1743c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:03.080772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384ce87-a800-4984-8661-148828f1743c None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:03.082116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:48:03.088758 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce24955-2cba-4213-b3fc-068c52e50568 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:03.089488 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce24955-2cba-4213-b3fc-068c52e50568 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:03.089641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce24955-2cba-4213-b3fc-068c52e50568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:03.097645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=81 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:03.112979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-4ce24955-2cba-4213-b3fc-068c52e50568 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:03.114181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4ce24955-2cba-4213-b3fc-068c52e50568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:03.122581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:48:03.430786 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384ce87-a800-4984-8661-148828f1743c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:03.433480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9384ce87-a800-4984-8661-148828f1743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:03.503774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:03.524852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384ce87-a800-4984-8661-148828f1743c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:03.532132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a90bf-8c24-4e78-bf52-962040a3d442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:03.533108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a90bf-8c24-4e78-bf52-962040a3d442 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:03.533483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a90bf-8c24-4e78-bf52-962040a3d442 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:03.533954 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a90bf-8c24-4e78-bf52-962040a3d442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:03.544165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a90bf-8c24-4e78-bf52-962040a3d442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:03.545656 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a90bf-8c24-4e78-bf52-962040a3d442 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:03.556014 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 774/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:48:05.586915 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eaf81-8575-4ff3-b935-d13d7ce0adff None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:05.587518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eaf81-8575-4ff3-b935-d13d7ce0adff None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:05.587518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eaf81-8575-4ff3-b935-d13d7ce0adff None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:05.588894 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 15:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:48:05.595139 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cac25a-eabc-46d5-ab4c-527753ef0b81 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:05.595892 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cac25a-eabc-46d5-ab4c-527753ef0b81 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:05.596030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cac25a-eabc-46d5-ab4c-527753ef0b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:05.614987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-75cac25a-eabc-46d5-ab4c-527753ef0b81 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:48:05.616196 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-75cac25a-eabc-46d5-ab4c-527753ef0b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:05.624520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 15:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:48:05.938165 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eaf81-8575-4ff3-b935-d13d7ce0adff None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:48:05.941222 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fe2eaf81-8575-4ff3-b935-d13d7ce0adff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:48:05.955003 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eaf81-8575-4ff3-b935-d13d7ce0adff None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:48:05.958939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbfe61-b13b-4942-8be8-61dd671bc6fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:48:05.959584 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbfe61-b13b-4942-8be8-61dd671bc6fd service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:48:05.960175 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbfe61-b13b-4942-8be8-61dd671bc6fd service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:48:05.960475 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbfe61-b13b-4942-8be8-61dd671bc6fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:48:05.969795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbfe61-b13b-4942-8be8-61dd671bc6fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:48:05.971314 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbfe61-b13b-4942-8be8-61dd671bc6fd service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:48:05.980874 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 764/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:48:15.609831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=11 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:48:15.976936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=8 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:33.323141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39efbc-0bdd-4011-9a66-0f03fa72d9a2 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.323814 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39efbc-0bdd-4011-9a66-0f03fa72d9a2 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.323814 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39efbc-0bdd-4011-9a66-0f03fa72d9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.355629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-2c39efbc-0bdd-4011-9a66-0f03fa72d9a2 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.356895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2c39efbc-0bdd-4011-9a66-0f03fa72d9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:33.389206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 776/1540] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:33.398774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a424156-c2cb-48b6-a727-0e3ef8220792 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.399375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a424156-c2cb-48b6-a727-0e3ef8220792 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.399375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a424156-c2cb-48b6-a727-0e3ef8220792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.427029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b5cf-dacc-4099-ae5d-f177254559e0 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.427395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b5cf-dacc-4099-ae5d-f177254559e0 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.427904 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b5cf-dacc-4099-ae5d-f177254559e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.480137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-78b6b5cf-dacc-4099-ae5d-f177254559e0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.481335 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-78b6b5cf-dacc-4099-ae5d-f177254559e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:33.506338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 777/1541] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:49:33.507710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26091170-6d1a-4a5d-904e-f7c195f54379 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.508005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26091170-6d1a-4a5d-904e-f7c195f54379 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.508302 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26091170-6d1a-4a5d-904e-f7c195f54379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.544162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-26091170-6d1a-4a5d-904e-f7c195f54379 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.545448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-26091170-6d1a-4a5d-904e-f7c195f54379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:33.565641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-9a424156-c2cb-48b6-a727-0e3ef8220792 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.566869 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9a424156-c2cb-48b6-a727-0e3ef8220792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:33.569450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 778/1542] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:33.570760 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d8a7-68ec-4fd6-bf5f-75a3f7cb8df7 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.571052 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d8a7-68ec-4fd6-bf5f-75a3f7cb8df7 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.571332 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d8a7-68ec-4fd6-bf5f-75a3f7cb8df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.587336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 765/1543] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:33.594362 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd562ec2-b545-42bd-9fa4-8c8090fb917d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.594870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd562ec2-b545-42bd-9fa4-8c8090fb917d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.595406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd562ec2-b545-42bd-9fa4-8c8090fb917d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.606809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-d8a5d8a7-68ec-4fd6-bf5f-75a3f7cb8df7 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.608072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d8a5d8a7-68ec-4fd6-bf5f-75a3f7cb8df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:33.627365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-cd562ec2-b545-42bd-9fa4-8c8090fb917d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.628999 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-cd562ec2-b545-42bd-9fa4-8c8090fb917d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:33.631681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 779/1544] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:33.633521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f178e3-64d0-4ca2-a655-163b65cb4208 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.634036 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f178e3-64d0-4ca2-a655-163b65cb4208 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.634531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f178e3-64d0-4ca2-a655-163b65cb4208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.637916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 766/1545] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:33.640962 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd562ec2-b545-42bd-9fa4-8c8090fb917d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:33.656679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd562ec2-b545-42bd-9fa4-8c8090fb917d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:33.662091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-82f178e3-64d0-4ca2-a655-163b65cb4208 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.662275 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45458097-eb66-45f9-8380-5061fb08a4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:33.662863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45458097-eb66-45f9-8380-5061fb08a4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.663145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45458097-eb66-45f9-8380-5061fb08a4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.663323 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-82f178e3-64d0-4ca2-a655-163b65cb4208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:33.663430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45458097-eb66-45f9-8380-5061fb08a4a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.664142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45458097-eb66-45f9-8380-5061fb08a4a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:49:33.664493 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45458097-eb66-45f9-8380-5061fb08a4a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:33.665518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: WARNING py.warnings [None req-45458097-eb66-45f9-8380-5061fb08a4a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:49:33.665518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: warnings.warn(msg) Jul 11 15:49:33.665518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: Jul 11 15:49:33.666414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45458097-eb66-45f9-8380-5061fb08a4a4 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:33.671656 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 780/1546] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:33.673463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6f36e-a59f-4a8e-9b87-27b7dec03087 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.673995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6f36e-a59f-4a8e-9b87-27b7dec03087 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.674483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6f36e-a59f-4a8e-9b87-27b7dec03087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.679956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 767/1547] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:49:33.681397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfa5f6-8385-4cba-a038-34e3ed5c5331 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.681686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfa5f6-8385-4cba-a038-34e3ed5c5331 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.681961 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfa5f6-8385-4cba-a038-34e3ed5c5331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.694094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-09d6f36e-a59f-4a8e-9b87-27b7dec03087 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.695633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-09d6f36e-a59f-4a8e-9b87-27b7dec03087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:33.701158 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-6cdfa5f6-8385-4cba-a038-34e3ed5c5331 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.702334 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6cdfa5f6-8385-4cba-a038-34e3ed5c5331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:33.704768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 781/1548] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:33.705801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6f36e-a59f-4a8e-9b87-27b7dec03087 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:33.716520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6f36e-a59f-4a8e-9b87-27b7dec03087 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:33.720798 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 768/1549] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:33.722519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68389d6a-596d-49b4-96f4-5368fa5243c6 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.722898 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68389d6a-596d-49b4-96f4-5368fa5243c6 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.723283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68389d6a-596d-49b4-96f4-5368fa5243c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.724310 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635e124-adcf-4565-bd73-e3776473dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:33.724987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635e124-adcf-4565-bd73-e3776473dc36 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.725269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635e124-adcf-4565-bd73-e3776473dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.725543 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635e124-adcf-4565-bd73-e3776473dc36 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.726274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635e124-adcf-4565-bd73-e3776473dc36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:49:33.726577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635e124-adcf-4565-bd73-e3776473dc36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:33.728183 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635e124-adcf-4565-bd73-e3776473dc36 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:33.740822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 782/1550] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:49:33.741853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad32fd-2569-4585-9203-ef44a55bf921 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.742072 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-68389d6a-596d-49b4-96f4-5368fa5243c6 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.742188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad32fd-2569-4585-9203-ef44a55bf921 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.742408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad32fd-2569-4585-9203-ef44a55bf921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.743260 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-68389d6a-596d-49b4-96f4-5368fa5243c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:33.752281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 769/1551] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:33.752281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68389d6a-596d-49b4-96f4-5368fa5243c6 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:33.760828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-2bad32fd-2569-4585-9203-ef44a55bf921 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.762013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2bad32fd-2569-4585-9203-ef44a55bf921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:33.763917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68389d6a-596d-49b4-96f4-5368fa5243c6 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:33.769008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2375ac-88f6-4b44-83b0-f432d38bd764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:33.769654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2375ac-88f6-4b44-83b0-f432d38bd764 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.769928 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2375ac-88f6-4b44-83b0-f432d38bd764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.770084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 783/1552] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:33.770181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2375ac-88f6-4b44-83b0-f432d38bd764 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.770813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad32fd-2569-4585-9203-ef44a55bf921 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:33.771047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2375ac-88f6-4b44-83b0-f432d38bd764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:49:33.771476 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2375ac-88f6-4b44-83b0-f432d38bd764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:33.773114 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2375ac-88f6-4b44-83b0-f432d38bd764 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:33.780083 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad32fd-2569-4585-9203-ef44a55bf921 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:33.785281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc0ba5-8c45-451f-9887-2afe073ded63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:33.785928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc0ba5-8c45-451f-9887-2afe073ded63 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.792882 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 770/1553] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:49:33.793015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc0ba5-8c45-451f-9887-2afe073ded63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.793015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc0ba5-8c45-451f-9887-2afe073ded63 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.793015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc0ba5-8c45-451f-9887-2afe073ded63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:33.793278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14767d-2dbe-4628-b206-4e230dc5e439 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.793278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14767d-2dbe-4628-b206-4e230dc5e439 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.793278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14767d-2dbe-4628-b206-4e230dc5e439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.793531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: WARNING py.warnings [None req-19cc0ba5-8c45-451f-9887-2afe073ded63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:49:33.793531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: warnings.warn(msg) Jul 11 15:49:33.793531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: Jul 11 15:49:33.793531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc0ba5-8c45-451f-9887-2afe073ded63 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:33.810245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-9a14767d-2dbe-4628-b206-4e230dc5e439 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.811448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9a14767d-2dbe-4628-b206-4e230dc5e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:33.819966 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 771/1554] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:33.821215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63bdd1-0d48-4896-89ab-bc77eb8960ff None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.821498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63bdd1-0d48-4896-89ab-bc77eb8960ff None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.821770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63bdd1-0d48-4896-89ab-bc77eb8960ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.833194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 784/1555] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:33.833194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780c219-d8ff-4fb8-8bf8-7c060093a21c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.833194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780c219-d8ff-4fb8-8bf8-7c060093a21c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.833194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780c219-d8ff-4fb8-8bf8-7c060093a21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.840089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-eb63bdd1-0d48-4896-89ab-bc77eb8960ff None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.841342 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-eb63bdd1-0d48-4896-89ab-bc77eb8960ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:33.850759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-1780c219-d8ff-4fb8-8bf8-7c060093a21c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.852065 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1780c219-d8ff-4fb8-8bf8-7c060093a21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:33.905914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 772/1556] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:33.905914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63bdd1-0d48-4896-89ab-bc77eb8960ff None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:33.912142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 785/1557] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:33.912605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63bdd1-0d48-4896-89ab-bc77eb8960ff None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:33.917170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780c219-d8ff-4fb8-8bf8-7c060093a21c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:33.917426 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dfbed-32d2-4d8a-84ed-464a987bf6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:33.918076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dfbed-32d2-4d8a-84ed-464a987bf6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.918361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dfbed-32d2-4d8a-84ed-464a987bf6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.919061 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dfbed-32d2-4d8a-84ed-464a987bf6f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.919774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762dfbed-32d2-4d8a-84ed-464a987bf6f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:33.921783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762dfbed-32d2-4d8a-84ed-464a987bf6f5 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:33.926691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780c219-d8ff-4fb8-8bf8-7c060093a21c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:33.931229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e20bf-9cb6-4573-8ea9-9855704f06ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:33.932202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e20bf-9cb6-4573-8ea9-9855704f06ae admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.932202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e20bf-9cb6-4573-8ea9-9855704f06ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.932456 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e20bf-9cb6-4573-8ea9-9855704f06ae admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.933193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e20bf-9cb6-4573-8ea9-9855704f06ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:49:33.933508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e20bf-9cb6-4573-8ea9-9855704f06ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:33.935119 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e20bf-9cb6-4573-8ea9-9855704f06ae admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:33.948528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 786/1558] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:49:33.949708 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b8a44-c7a1-46a0-b877-93391d74b95d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:33.950004 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b8a44-c7a1-46a0-b877-93391d74b95d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:33.950339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 773/1559] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:33.950459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b8a44-c7a1-46a0-b877-93391d74b95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:33.951241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dfbed-32d2-4d8a-84ed-464a987bf6f5 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:33.977192 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3d2b8a44-c7a1-46a0-b877-93391d74b95d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:33.978591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3d2b8a44-c7a1-46a0-b877-93391d74b95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:34.024695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dfbed-32d2-4d8a-84ed-464a987bf6f5 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.029967 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e34204-3887-4cfd-95cd-4cf1bce7d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.030827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e34204-3887-4cfd-95cd-4cf1bce7d5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.031112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e34204-3887-4cfd-95cd-4cf1bce7d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.031374 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e34204-3887-4cfd-95cd-4cf1bce7d5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.032491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e34204-3887-4cfd-95cd-4cf1bce7d5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.034120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:34.034401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e34204-3887-4cfd-95cd-4cf1bce7d5f1 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.044350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 787/1560] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:34.045162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b8a44-c7a1-46a0-b877-93391d74b95d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.054421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b8a44-c7a1-46a0-b877-93391d74b95d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.059190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e6d7b-6b53-4c2c-b72d-0fd691535b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.059845 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e6d7b-6b53-4c2c-b72d-0fd691535b18 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.060124 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e6d7b-6b53-4c2c-b72d-0fd691535b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.060431 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e6d7b-6b53-4c2c-b72d-0fd691535b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.061163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e6d7b-6b53-4c2c-b72d-0fd691535b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:49:34.061467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e6d7b-6b53-4c2c-b72d-0fd691535b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.063155 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e6d7b-6b53-4c2c-b72d-0fd691535b18 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.065891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 774/1561] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:33 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:34.066582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e34204-3887-4cfd-95cd-4cf1bce7d5f1 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.071815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:34.079517 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 788/1562] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:49:34.080618 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e6d7b-6b53-4c2c-b72d-0fd691535b18 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.090888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e6d7b-6b53-4c2c-b72d-0fd691535b18 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.129802 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e34204-3887-4cfd-95cd-4cf1bce7d5f1 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.134708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267edb48-fae6-4bfc-b1d8-a82e8c3dc361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.135396 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267edb48-fae6-4bfc-b1d8-a82e8c3dc361 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.135691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267edb48-fae6-4bfc-b1d8-a82e8c3dc361 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.135970 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267edb48-fae6-4bfc-b1d8-a82e8c3dc361 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.136704 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267edb48-fae6-4bfc-b1d8-a82e8c3dc361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.137767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: WARNING py.warnings [None req-267edb48-fae6-4bfc-b1d8-a82e8c3dc361 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:49:34.137767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: warnings.warn(msg) Jul 11 15:49:34.137767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: Jul 11 15:49:34.139001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267edb48-fae6-4bfc-b1d8-a82e8c3dc361 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.146373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa45954-a744-4cb4-9473-1aae71ee13c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.147051 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa45954-a744-4cb4-9473-1aae71ee13c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.147314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa45954-a744-4cb4-9473-1aae71ee13c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.147586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa45954-a744-4cb4-9473-1aae71ee13c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.148341 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa45954-a744-4cb4-9473-1aae71ee13c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:49:34.148646 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa45954-a744-4cb4-9473-1aae71ee13c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.150245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa45954-a744-4cb4-9473-1aae71ee13c3 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.159534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 775/1563] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:34 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:34.162498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 789/1564] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:49:34.163279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa45954-a744-4cb4-9473-1aae71ee13c3 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.169766 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa05bd5-ba62-4358-9034-420620db36fd None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.170302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa05bd5-ba62-4358-9034-420620db36fd None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.170558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa05bd5-ba62-4358-9034-420620db36fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.173133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa45954-a744-4cb4-9473-1aae71ee13c3 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.178134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9a625-be8d-41c3-9a59-c5ebc430096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.178775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9a625-be8d-41c3-9a59-c5ebc430096a admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.179055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9a625-be8d-41c3-9a59-c5ebc430096a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.179361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9a625-be8d-41c3-9a59-c5ebc430096a admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.180049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9a625-be8d-41c3-9a59-c5ebc430096a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.181981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9a625-be8d-41c3-9a59-c5ebc430096a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.188722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-6aa05bd5-ba62-4358-9034-420620db36fd None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:34.190053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6aa05bd5-ba62-4358-9034-420620db36fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:34.201700 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 776/1565] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:34.202488 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa05bd5-ba62-4358-9034-420620db36fd None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.212844 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa05bd5-ba62-4358-9034-420620db36fd None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.216676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 790/1566] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:34 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:34.216676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9a625-be8d-41c3-9a59-c5ebc430096a admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.274349 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e270446-6a8c-45ef-82ae-dc2c611028fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.274943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e270446-6a8c-45ef-82ae-dc2c611028fc admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.275241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e270446-6a8c-45ef-82ae-dc2c611028fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.275498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e270446-6a8c-45ef-82ae-dc2c611028fc admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.276011 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9a625-be8d-41c3-9a59-c5ebc430096a admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.276188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e270446-6a8c-45ef-82ae-dc2c611028fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.278890 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e270446-6a8c-45ef-82ae-dc2c611028fc admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.280573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01829dcf-ee5f-4c37-9d55-c5a298b36048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.281242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01829dcf-ee5f-4c37-9d55-c5a298b36048 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.281546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01829dcf-ee5f-4c37-9d55-c5a298b36048 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.281850 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01829dcf-ee5f-4c37-9d55-c5a298b36048 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.282668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01829dcf-ee5f-4c37-9d55-c5a298b36048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:49:34.282957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01829dcf-ee5f-4c37-9d55-c5a298b36048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.284572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01829dcf-ee5f-4c37-9d55-c5a298b36048 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.298415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 791/1567] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:49:34.299001 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01829dcf-ee5f-4c37-9d55-c5a298b36048 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.306102 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 777/1568] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:34 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:34.306893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e270446-6a8c-45ef-82ae-dc2c611028fc admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.313823 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01829dcf-ee5f-4c37-9d55-c5a298b36048 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.316443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e270446-6a8c-45ef-82ae-dc2c611028fc admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.319095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebfe26-2d7d-41b3-8eda-24cff17e7170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.319768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebfe26-2d7d-41b3-8eda-24cff17e7170 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.320056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebfe26-2d7d-41b3-8eda-24cff17e7170 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.320442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebfe26-2d7d-41b3-8eda-24cff17e7170 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.321145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebfe26-2d7d-41b3-8eda-24cff17e7170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.321273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a38e8f-bd9f-4a66-bac0-8101119e21f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.321869 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a38e8f-bd9f-4a66-bac0-8101119e21f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.322176 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a38e8f-bd9f-4a66-bac0-8101119e21f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.322450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a38e8f-bd9f-4a66-bac0-8101119e21f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.323103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebfe26-2d7d-41b3-8eda-24cff17e7170 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.323233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a38e8f-bd9f-4a66-bac0-8101119e21f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.325091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a38e8f-bd9f-4a66-bac0-8101119e21f5 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.347133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 792/1569] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:34 2022] POST /identity/v3/users => generated 288 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:34.348033 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebfe26-2d7d-41b3-8eda-24cff17e7170 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.355919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 778/1570] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:34 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:34.355919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a38e8f-bd9f-4a66-bac0-8101119e21f5 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.357502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebfe26-2d7d-41b3-8eda-24cff17e7170 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.386556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:34.413983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:34.415958 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732dbf0-56a1-4317-b63e-100f1b64d2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.416670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732dbf0-56a1-4317-b63e-100f1b64d2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.416950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732dbf0-56a1-4317-b63e-100f1b64d2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.417240 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732dbf0-56a1-4317-b63e-100f1b64d2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.417970 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732dbf0-56a1-4317-b63e-100f1b64d2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.419729 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732dbf0-56a1-4317-b63e-100f1b64d2f4 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.420331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a38e8f-bd9f-4a66-bac0-8101119e21f5 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.425656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cc501-1b2a-45d9-a2b8-6d055892cc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.426345 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cc501-1b2a-45d9-a2b8-6d055892cc3f admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.426628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cc501-1b2a-45d9-a2b8-6d055892cc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.426904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cc501-1b2a-45d9-a2b8-6d055892cc3f admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.427596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cc501-1b2a-45d9-a2b8-6d055892cc3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.429524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cc501-1b2a-45d9-a2b8-6d055892cc3f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.429933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 793/1571] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:34.430820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732dbf0-56a1-4317-b63e-100f1b64d2f4 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.440812 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732dbf0-56a1-4317-b63e-100f1b64d2f4 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.445435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adf37b-2416-4e3b-90fc-16c361009f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.446121 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adf37b-2416-4e3b-90fc-16c361009f78 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.446412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adf37b-2416-4e3b-90fc-16c361009f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.446697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adf37b-2416-4e3b-90fc-16c361009f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.447419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adf37b-2416-4e3b-90fc-16c361009f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:49:34.447773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adf37b-2416-4e3b-90fc-16c361009f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.449481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adf37b-2416-4e3b-90fc-16c361009f78 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.456398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 779/1572] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:34 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:34.457135 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cc501-1b2a-45d9-a2b8-6d055892cc3f admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.467891 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 794/1573] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:49:34.467891 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adf37b-2416-4e3b-90fc-16c361009f78 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.477398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adf37b-2416-4e3b-90fc-16c361009f78 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.533509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cc501-1b2a-45d9-a2b8-6d055892cc3f admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.538327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffcf5f-64aa-4ddf-9148-af3724dd06e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.538807 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b70094-ee00-42fc-88dd-c02a73b3a3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.539316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffcf5f-64aa-4ddf-9148-af3724dd06e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.539482 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b70094-ee00-42fc-88dd-c02a73b3a3bf admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.539769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b70094-ee00-42fc-88dd-c02a73b3a3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.539886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffcf5f-64aa-4ddf-9148-af3724dd06e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.540044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b70094-ee00-42fc-88dd-c02a73b3a3bf admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.540185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffcf5f-64aa-4ddf-9148-af3724dd06e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.540775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b70094-ee00-42fc-88dd-c02a73b3a3bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.541051 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffcf5f-64aa-4ddf-9148-af3724dd06e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.542717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b70094-ee00-42fc-88dd-c02a73b3a3bf admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.543170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffcf5f-64aa-4ddf-9148-af3724dd06e0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.565724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 780/1574] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:34 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:34.569586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b70094-ee00-42fc-88dd-c02a73b3a3bf admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.575084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 795/1575] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:34 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:34.575084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffcf5f-64aa-4ddf-9148-af3724dd06e0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.580119 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b70094-ee00-42fc-88dd-c02a73b3a3bf admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.634045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffcf5f-64aa-4ddf-9148-af3724dd06e0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.637153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d0c2e-8b96-4e5b-9c44-225101f1ed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.637837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d0c2e-8b96-4e5b-9c44-225101f1ed66 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.638120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d0c2e-8b96-4e5b-9c44-225101f1ed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.638400 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d0c2e-8b96-4e5b-9c44-225101f1ed66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.638825 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c956c-5570-43e2-b8e3-d1913121d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.639136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d0c2e-8b96-4e5b-9c44-225101f1ed66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.639491 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c956c-5570-43e2-b8e3-d1913121d600 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.639769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c956c-5570-43e2-b8e3-d1913121d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.640040 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c956c-5570-43e2-b8e3-d1913121d600 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.640813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c956c-5570-43e2-b8e3-d1913121d600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.640920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d0c2e-8b96-4e5b-9c44-225101f1ed66 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.642472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c956c-5570-43e2-b8e3-d1913121d600 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.651059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 781/1576] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:34.651917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d0c2e-8b96-4e5b-9c44-225101f1ed66 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.652555 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 796/1577] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:34.655986 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c956c-5570-43e2-b8e3-d1913121d600 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.661970 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d0c2e-8b96-4e5b-9c44-225101f1ed66 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.665840 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c956c-5570-43e2-b8e3-d1913121d600 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.666577 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03826061-70a1-4c78-b9d0-eadc9e169cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.667233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03826061-70a1-4c78-b9d0-eadc9e169cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.667576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03826061-70a1-4c78-b9d0-eadc9e169cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.667795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03826061-70a1-4c78-b9d0-eadc9e169cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.668517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03826061-70a1-4c78-b9d0-eadc9e169cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.670425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3ad42-4f56-4718-83a9-b7c8ca4cd809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.670559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03826061-70a1-4c78-b9d0-eadc9e169cc4 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.671116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3ad42-4f56-4718-83a9-b7c8ca4cd809 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.671400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3ad42-4f56-4718-83a9-b7c8ca4cd809 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.671679 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3ad42-4f56-4718-83a9-b7c8ca4cd809 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.672462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3ad42-4f56-4718-83a9-b7c8ca4cd809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.674057 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3ad42-4f56-4718-83a9-b7c8ca4cd809 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.684196 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 797/1578] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:34.688122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3ad42-4f56-4718-83a9-b7c8ca4cd809 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.694766 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 782/1579] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:34 2022] POST /identity/v3/users => generated 282 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:34.694766 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03826061-70a1-4c78-b9d0-eadc9e169cc4 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.700025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3ad42-4f56-4718-83a9-b7c8ca4cd809 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.702311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03826061-70a1-4c78-b9d0-eadc9e169cc4 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.704849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a025f5-0d5f-419c-91ad-02dd6ddbe886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.705528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a025f5-0d5f-419c-91ad-02dd6ddbe886 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.705820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a025f5-0d5f-419c-91ad-02dd6ddbe886 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.706078 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a025f5-0d5f-419c-91ad-02dd6ddbe886 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.706771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a025f5-0d5f-419c-91ad-02dd6ddbe886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.707538 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4a023-33bf-4e3e-8c7b-5cf04fd32641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.708177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4a023-33bf-4e3e-8c7b-5cf04fd32641 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.708491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4a023-33bf-4e3e-8c7b-5cf04fd32641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.708738 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a025f5-0d5f-419c-91ad-02dd6ddbe886 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.708833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4a023-33bf-4e3e-8c7b-5cf04fd32641 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.709753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4a023-33bf-4e3e-8c7b-5cf04fd32641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.711615 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4a023-33bf-4e3e-8c7b-5cf04fd32641 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.730254 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 798/1580] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:34 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:34.734005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a025f5-0d5f-419c-91ad-02dd6ddbe886 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.740765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 783/1581] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:34 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:34.741362 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4a023-33bf-4e3e-8c7b-5cf04fd32641 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.744617 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a025f5-0d5f-419c-91ad-02dd6ddbe886 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.749403 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:34.771978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:34.805398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fe795-ae83-43dd-a719-9bb26194c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.806068 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe795-ae83-43dd-a719-9bb26194c60f admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.806356 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe795-ae83-43dd-a719-9bb26194c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.806637 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe795-ae83-43dd-a719-9bb26194c60f admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.807378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fe795-ae83-43dd-a719-9bb26194c60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.809042 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fe795-ae83-43dd-a719-9bb26194c60f admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.809857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4a023-33bf-4e3e-8c7b-5cf04fd32641 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.815353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82806f-b454-4f19-a92c-5dd14b4b2eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.816027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82806f-b454-4f19-a92c-5dd14b4b2eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.816323 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82806f-b454-4f19-a92c-5dd14b4b2eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.816601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82806f-b454-4f19-a92c-5dd14b4b2eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.817300 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82806f-b454-4f19-a92c-5dd14b4b2eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.819220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82806f-b454-4f19-a92c-5dd14b4b2eb8 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.833113 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 799/1582] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:34.834052 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fe795-ae83-43dd-a719-9bb26194c60f admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.843901 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 784/1583] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:34 2022] POST /identity/v3/users => generated 302 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:34.844875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82806f-b454-4f19-a92c-5dd14b4b2eb8 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.849197 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fe795-ae83-43dd-a719-9bb26194c60f admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.854830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1bdc-c64e-4756-b230-f08ba560f9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.855189 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82806f-b454-4f19-a92c-5dd14b4b2eb8 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.855492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1bdc-c64e-4756-b230-f08ba560f9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.855773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1bdc-c64e-4756-b230-f08ba560f9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.856048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1bdc-c64e-4756-b230-f08ba560f9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.856820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d1bdc-c64e-4756-b230-f08ba560f9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.858502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d1bdc-c64e-4756-b230-f08ba560f9a4 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.860034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2d2de-db61-498c-9e89-463115f81968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.860730 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2d2de-db61-498c-9e89-463115f81968 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.861011 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2d2de-db61-498c-9e89-463115f81968 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.861285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2d2de-db61-498c-9e89-463115f81968 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.862015 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2d2de-db61-498c-9e89-463115f81968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.863619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2d2de-db61-498c-9e89-463115f81968 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.869272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 800/1584] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:34.870214 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1bdc-c64e-4756-b230-f08ba560f9a4 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.877473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 785/1585] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:34.878217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2d2de-db61-498c-9e89-463115f81968 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.882742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1bdc-c64e-4756-b230-f08ba560f9a4 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.887619 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb67e-b500-44f5-b91d-5d3bb8fa16cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.888686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb67e-b500-44f5-b91d-5d3bb8fa16cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.888938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb67e-b500-44f5-b91d-5d3bb8fa16cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.889104 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb67e-b500-44f5-b91d-5d3bb8fa16cf admin admin] PATH_INFO: `/v3/projects/a9722fc206784e65880628276076ac7a/users/965e3434001a4b8ab02020e1b9133691/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.889543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2d2de-db61-498c-9e89-463115f81968 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.894200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe3115-6154-43bd-a33f-321b8c78bb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.894854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe3115-6154-43bd-a33f-321b8c78bb34 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.895134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe3115-6154-43bd-a33f-321b8c78bb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.895517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe3115-6154-43bd-a33f-321b8c78bb34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.896248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe3115-6154-43bd-a33f-321b8c78bb34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.897880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe3115-6154-43bd-a33f-321b8c78bb34 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.904557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cb67e-b500-44f5-b91d-5d3bb8fa16cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9722fc206784e65880628276076ac7a, user_id=965e3434001a4b8ab02020e1b9133691, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.905596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: WARNING py.warnings [None req-ad2cb67e-b500-44f5-b91d-5d3bb8fa16cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:49:34.905596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: warnings.warn(msg) Jul 11 15:49:34.905596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: Jul 11 15:49:34.907830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cb67e-b500-44f5-b91d-5d3bb8fa16cf admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.908673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 786/1586] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:34.909544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe3115-6154-43bd-a33f-321b8c78bb34 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.921988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe3115-6154-43bd-a33f-321b8c78bb34 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.925191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 801/1587] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:34 2022] PUT /identity/v3/projects/a9722fc206784e65880628276076ac7a/users/965e3434001a4b8ab02020e1b9133691/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:34.926004 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb67e-b500-44f5-b91d-5d3bb8fa16cf admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:34.987440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb67e-b500-44f5-b91d-5d3bb8fa16cf admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:34.988979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01240b01-743f-4d5b-8153-c21832edc8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.989673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01240b01-743f-4d5b-8153-c21832edc8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.989954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01240b01-743f-4d5b-8153-c21832edc8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.990228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01240b01-743f-4d5b-8153-c21832edc8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.990973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01240b01-743f-4d5b-8153-c21832edc8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.992554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9f619-6350-4f01-86c1-4e6dfa7c6614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:34.992705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01240b01-743f-4d5b-8153-c21832edc8f2 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:34.993260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9f619-6350-4f01-86c1-4e6dfa7c6614 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:34.993542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9f619-6350-4f01-86c1-4e6dfa7c6614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:34.993818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9f619-6350-4f01-86c1-4e6dfa7c6614 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:34.994848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9f619-6350-4f01-86c1-4e6dfa7c6614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:34.996549 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9f619-6350-4f01-86c1-4e6dfa7c6614 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.003337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 787/1588] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:35.004445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01240b01-743f-4d5b-8153-c21832edc8f2 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.015962 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01240b01-743f-4d5b-8153-c21832edc8f2 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.019727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 802/1589] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:34 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:35.020571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9f619-6350-4f01-86c1-4e6dfa7c6614 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.021244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c99a37-6c98-4a8a-86ca-48772591352a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.022063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c99a37-6c98-4a8a-86ca-48772591352a admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.022349 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c99a37-6c98-4a8a-86ca-48772591352a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.022843 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c99a37-6c98-4a8a-86ca-48772591352a admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.023494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c99a37-6c98-4a8a-86ca-48772591352a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.025115 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c99a37-6c98-4a8a-86ca-48772591352a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.030161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9f619-6350-4f01-86c1-4e6dfa7c6614 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.035171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 788/1590] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:35.035544 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c084a-3de1-445a-b8e1-34dccc2d74d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.036116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c99a37-6c98-4a8a-86ca-48772591352a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.036230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c084a-3de1-445a-b8e1-34dccc2d74d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.036509 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c084a-3de1-445a-b8e1-34dccc2d74d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.036789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c084a-3de1-445a-b8e1-34dccc2d74d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.037521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c084a-3de1-445a-b8e1-34dccc2d74d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.039132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c084a-3de1-445a-b8e1-34dccc2d74d2 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.046740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c99a37-6c98-4a8a-86ca-48772591352a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.049875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 803/1591] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:35.050622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c084a-3de1-445a-b8e1-34dccc2d74d2 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.054292 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713581d0-f436-4882-ad56-873c97c05954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.055275 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713581d0-f436-4882-ad56-873c97c05954 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.055863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713581d0-f436-4882-ad56-873c97c05954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.056159 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713581d0-f436-4882-ad56-873c97c05954 admin admin] PATH_INFO: `/v3/projects/5c230554e8a34a7086e433e797360e28/users/9d44f1f434534cc0b373943d48d672df/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.060263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c084a-3de1-445a-b8e1-34dccc2d74d2 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.065218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f2dc9-090e-4b28-8bf5-51496df1b1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.066167 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f2dc9-090e-4b28-8bf5-51496df1b1a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.066451 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f2dc9-090e-4b28-8bf5-51496df1b1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.066724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f2dc9-090e-4b28-8bf5-51496df1b1a2 admin admin] PATH_INFO: `/v3/projects/f6145a3ef3d147afbeb90dd49d01af2e/users/052b95d2857c4e728a8008d00fc34780/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.072197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713581d0-f436-4882-ad56-873c97c05954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c230554e8a34a7086e433e797360e28, user_id=9d44f1f434534cc0b373943d48d672df, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.075059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713581d0-f436-4882-ad56-873c97c05954 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.083839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f2dc9-090e-4b28-8bf5-51496df1b1a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6145a3ef3d147afbeb90dd49d01af2e, user_id=052b95d2857c4e728a8008d00fc34780, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.087190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f2dc9-090e-4b28-8bf5-51496df1b1a2 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.090729 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 789/1592] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:35 2022] PUT /identity/v3/projects/5c230554e8a34a7086e433e797360e28/users/9d44f1f434534cc0b373943d48d672df/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:35.091538 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713581d0-f436-4882-ad56-873c97c05954 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.106672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 804/1593] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:35 2022] PUT /identity/v3/projects/f6145a3ef3d147afbeb90dd49d01af2e/users/052b95d2857c4e728a8008d00fc34780/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:35.108117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd95af4-6e3e-4cae-9b03-f938462e923d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.108431 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd95af4-6e3e-4cae-9b03-f938462e923d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.108929 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd95af4-6e3e-4cae-9b03-f938462e923d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.134745 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-5cd95af4-6e3e-4cae-9b03-f938462e923d None None] MFA Rules not processed for user `965e3434001a4b8ab02020e1b9133691`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:35.135942 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5cd95af4-6e3e-4cae-9b03-f938462e923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:35.149406 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:35.164381 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:35.169449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713581d0-f436-4882-ad56-873c97c05954 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.216486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 805/1594] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:35.217455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd95af4-6e3e-4cae-9b03-f938462e923d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.235609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891a0e8-53d2-491a-a281-c8de7b668064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.236308 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a0e8-53d2-491a-a281-c8de7b668064 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.236599 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a0e8-53d2-491a-a281-c8de7b668064 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.236872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a0e8-53d2-491a-a281-c8de7b668064 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.237611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891a0e8-53d2-491a-a281-c8de7b668064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.239228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891a0e8-53d2-491a-a281-c8de7b668064 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.252811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 790/1595] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:35.252811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891a0e8-53d2-491a-a281-c8de7b668064 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.264889 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891a0e8-53d2-491a-a281-c8de7b668064 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.271464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235545c3-47b9-4011-aaa8-1ba8fd89d87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.271464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235545c3-47b9-4011-aaa8-1ba8fd89d87d admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.271464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235545c3-47b9-4011-aaa8-1ba8fd89d87d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.271464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235545c3-47b9-4011-aaa8-1ba8fd89d87d admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.271827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235545c3-47b9-4011-aaa8-1ba8fd89d87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.273297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235545c3-47b9-4011-aaa8-1ba8fd89d87d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.284384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd95af4-6e3e-4cae-9b03-f938462e923d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.285096 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 791/1596] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:35.285963 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235545c3-47b9-4011-aaa8-1ba8fd89d87d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.289192 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468bb7d-c960-45d0-86ec-215b33257df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.289871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468bb7d-c960-45d0-86ec-215b33257df5 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.290156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468bb7d-c960-45d0-86ec-215b33257df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.290435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468bb7d-c960-45d0-86ec-215b33257df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.291182 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468bb7d-c960-45d0-86ec-215b33257df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.293064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468bb7d-c960-45d0-86ec-215b33257df5 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.295579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235545c3-47b9-4011-aaa8-1ba8fd89d87d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.300936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6015a-269c-4e36-ae30-0054f0b8baaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.301862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6015a-269c-4e36-ae30-0054f0b8baaf admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.302151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6015a-269c-4e36-ae30-0054f0b8baaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.302428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6015a-269c-4e36-ae30-0054f0b8baaf admin admin] PATH_INFO: `/v3/projects/bf151ebb2425421d8cdc3e2773fbd558/users/c0e395655fb14e3b92ed88eb3ea231db/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.307274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 806/1597] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:35.307274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468bb7d-c960-45d0-86ec-215b33257df5 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.317151 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468bb7d-c960-45d0-86ec-215b33257df5 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.320277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6015a-269c-4e36-ae30-0054f0b8baaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf151ebb2425421d8cdc3e2773fbd558, user_id=c0e395655fb14e3b92ed88eb3ea231db, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.322179 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01f5af-5adb-4734-b0f4-e90849618f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.322845 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01f5af-5adb-4734-b0f4-e90849618f6a admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.322993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6015a-269c-4e36-ae30-0054f0b8baaf admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.323088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01f5af-5adb-4734-b0f4-e90849618f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.323396 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01f5af-5adb-4734-b0f4-e90849618f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.324132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01f5af-5adb-4734-b0f4-e90849618f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.325765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01f5af-5adb-4734-b0f4-e90849618f6a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.337270 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 792/1598] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:35 2022] PUT /identity/v3/projects/bf151ebb2425421d8cdc3e2773fbd558/users/c0e395655fb14e3b92ed88eb3ea231db/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:35.337425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 807/1598] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:35.338573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1447e-8fd0-4ede-95fb-758c8da58d42 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.338802 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d75fe-c5cd-4814-93ec-609c0a4c6600 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.338924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1447e-8fd0-4ede-95fb-758c8da58d42 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.339124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d75fe-c5cd-4814-93ec-609c0a4c6600 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.339225 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1447e-8fd0-4ede-95fb-758c8da58d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.339383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d75fe-c5cd-4814-93ec-609c0a4c6600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.356799 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-e1b1447e-8fd0-4ede-95fb-758c8da58d42 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:35.357988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e1b1447e-8fd0-4ede-95fb-758c8da58d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:35.360701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-101d75fe-c5cd-4814-93ec-609c0a4c6600 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:35.361880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-101d75fe-c5cd-4814-93ec-609c0a4c6600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:35.416324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 808/1599] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:35.417558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408b64e-aabf-468c-8269-7a3b8c36463f None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.417846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408b64e-aabf-468c-8269-7a3b8c36463f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.418121 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408b64e-aabf-468c-8269-7a3b8c36463f None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.419394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 809/1600] 10.222.0.26 () {54 vars in 961 bytes} [Mon Jul 11 15:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:35.421093 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408b64e-aabf-468c-8269-7a3b8c36463f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.428341 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 793/1601] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:35.429868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d75fe-c5cd-4814-93ec-609c0a4c6600 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.435443 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408b64e-aabf-468c-8269-7a3b8c36463f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.440281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaea90-f6ce-4a55-a922-7e14e60f4bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.440896 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d75fe-c5cd-4814-93ec-609c0a4c6600 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.441117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaea90-f6ce-4a55-a922-7e14e60f4bee admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.441393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaea90-f6ce-4a55-a922-7e14e60f4bee admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.441664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaea90-f6ce-4a55-a922-7e14e60f4bee admin admin] PATH_INFO: `/v3/projects/a2a9ec729f214ddca015f734732db211/users/c7e6ab4867c64d03938da958d02f653c/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.446834 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351aa7f-24d9-4399-9dbf-95414bc98bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.447507 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351aa7f-24d9-4399-9dbf-95414bc98bfb admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.447791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351aa7f-24d9-4399-9dbf-95414bc98bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.448062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351aa7f-24d9-4399-9dbf-95414bc98bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.448841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351aa7f-24d9-4399-9dbf-95414bc98bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.450461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351aa7f-24d9-4399-9dbf-95414bc98bfb admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.457113 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaea90-f6ce-4a55-a922-7e14e60f4bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a9ec729f214ddca015f734732db211, user_id=c7e6ab4867c64d03938da958d02f653c, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.460117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaea90-f6ce-4a55-a922-7e14e60f4bee admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.462610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 794/1602] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:35.463421 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351aa7f-24d9-4399-9dbf-95414bc98bfb admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.475000 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351aa7f-24d9-4399-9dbf-95414bc98bfb admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.478384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 810/1603] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:35 2022] PUT /identity/v3/projects/a2a9ec729f214ddca015f734732db211/users/c7e6ab4867c64d03938da958d02f653c/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:35.479368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaea90-f6ce-4a55-a922-7e14e60f4bee admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.497577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:35.534777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:35.542979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaea90-f6ce-4a55-a922-7e14e60f4bee admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.546053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bf451-cf24-46c2-9e2b-1aecc489d274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.547166 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bf451-cf24-46c2-9e2b-1aecc489d274 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.547572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55020327-6990-4094-882e-75b397a2e8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.547775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bf451-cf24-46c2-9e2b-1aecc489d274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.548134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bf451-cf24-46c2-9e2b-1aecc489d274 admin admin] PATH_INFO: `/v3/projects/83cc4ffd462346bca1d62ba43dfd980e/users/0cb58263f8d64508852375306d31ba91/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.548493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55020327-6990-4094-882e-75b397a2e8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.548773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55020327-6990-4094-882e-75b397a2e8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.549044 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55020327-6990-4094-882e-75b397a2e8a8 admin admin] PATH_INFO: `/v3/projects/fc255e84b25a44f58a5d9ce955ce4bce/users/4046223c20754d68af45ce96044fb252/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.563079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bf451-cf24-46c2-9e2b-1aecc489d274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cc4ffd462346bca1d62ba43dfd980e, user_id=0cb58263f8d64508852375306d31ba91, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.563457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55020327-6990-4094-882e-75b397a2e8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc255e84b25a44f58a5d9ce955ce4bce, user_id=4046223c20754d68af45ce96044fb252, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.565673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bf451-cf24-46c2-9e2b-1aecc489d274 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.566142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55020327-6990-4094-882e-75b397a2e8a8 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.580873 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 811/1604] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:35 2022] PUT /identity/v3/projects/fc255e84b25a44f58a5d9ce955ce4bce/users/4046223c20754d68af45ce96044fb252/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:35.581623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 795/1605] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:35 2022] PUT /identity/v3/projects/83cc4ffd462346bca1d62ba43dfd980e/users/0cb58263f8d64508852375306d31ba91/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:35.582275 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6497108-b924-454d-b026-544bd55d0019 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.582562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6497108-b924-454d-b026-544bd55d0019 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.582884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6497108-b924-454d-b026-544bd55d0019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.583122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388e1d7-2b52-439a-a0fd-3d73c2a598b4 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.583472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388e1d7-2b52-439a-a0fd-3d73c2a598b4 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.583809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388e1d7-2b52-439a-a0fd-3d73c2a598b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.604794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-c6497108-b924-454d-b026-544bd55d0019 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:35.606024 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c6497108-b924-454d-b026-544bd55d0019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:35.623178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-b388e1d7-2b52-439a-a0fd-3d73c2a598b4 None None] MFA Rules not processed for user `fa038a2e30f544aaa609d32e0e1ceaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:35.624382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b388e1d7-2b52-439a-a0fd-3d73c2a598b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:35.663059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 812/1606] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:35.665280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6497108-b924-454d-b026-544bd55d0019 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.689390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 796/1607] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Jul 11 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:35.696272 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388e1d7-2b52-439a-a0fd-3d73c2a598b4 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.697999 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b388e1d7-2b52-439a-a0fd-3d73c2a598b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:35.722317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6497108-b924-454d-b026-544bd55d0019 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.726627 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d268c-2398-4d00-994e-72d306a36577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.727285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d268c-2398-4d00-994e-72d306a36577 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.727571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d268c-2398-4d00-994e-72d306a36577 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.727850 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d268c-2398-4d00-994e-72d306a36577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.738356 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d268c-2398-4d00-994e-72d306a36577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.739860 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d268c-2398-4d00-994e-72d306a36577 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.749601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 813/1609] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:35.750354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d268c-2398-4d00-994e-72d306a36577 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.753883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388e1d7-2b52-439a-a0fd-3d73c2a598b4 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.757838 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079638c3-a04d-42e1-9bf1-d98d176d06cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.758474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079638c3-a04d-42e1-9bf1-d98d176d06cb service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.758752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079638c3-a04d-42e1-9bf1-d98d176d06cb service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.759021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079638c3-a04d-42e1-9bf1-d98d176d06cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.761215 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d268c-2398-4d00-994e-72d306a36577 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:35.766209 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9daa56-f87a-4afc-b7d0-45d210569ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:35.767396 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9daa56-f87a-4afc-b7d0-45d210569ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.767684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9daa56-f87a-4afc-b7d0-45d210569ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.767967 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9daa56-f87a-4afc-b7d0-45d210569ba6 admin admin] PATH_INFO: `/v3/projects/87584a54dff444ceaf7ed8b7f735ea64/users/a81c7ea0cff54779b29d6ec2dfeba926/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.769212 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079638c3-a04d-42e1-9bf1-d98d176d06cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.770657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079638c3-a04d-42e1-9bf1-d98d176d06cb service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.782413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 797/1610] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:35.784774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ce875-76a5-415d-b1c9-24027904f64f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.785254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ce875-76a5-415d-b1c9-24027904f64f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.785431 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9daa56-f87a-4afc-b7d0-45d210569ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87584a54dff444ceaf7ed8b7f735ea64, user_id=a81c7ea0cff54779b29d6ec2dfeba926, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:35.785538 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ce875-76a5-415d-b1c9-24027904f64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.788277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9daa56-f87a-4afc-b7d0-45d210569ba6 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:35.807255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 814/1611] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:35 2022] PUT /identity/v3/projects/87584a54dff444ceaf7ed8b7f735ea64/users/a81c7ea0cff54779b29d6ec2dfeba926/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:35.809931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8e4e-34b3-4f2d-b1af-50d1293f8824 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.809931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8e4e-34b3-4f2d-b1af-50d1293f8824 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.809931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8e4e-34b3-4f2d-b1af-50d1293f8824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.824607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-1d9ce875-76a5-415d-b1c9-24027904f64f None None] MFA Rules not processed for user `c7e6ab4867c64d03938da958d02f653c`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:35.826559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1d9ce875-76a5-415d-b1c9-24027904f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:35.844422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-341c8e4e-34b3-4f2d-b1af-50d1293f8824 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:35.846628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-341c8e4e-34b3-4f2d-b1af-50d1293f8824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:35.863180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:35.887917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:35.918976 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 798/1612] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:35.924617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5c73-317c-4ffe-ada5-1ad96a5967b5 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:35.924912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5c73-317c-4ffe-ada5-1ad96a5967b5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:35.925191 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5c73-317c-4ffe-ada5-1ad96a5967b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:35.934341 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 815/1613] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:35.934341 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c8e4e-34b3-4f2d-b1af-50d1293f8824 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:35.958817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-936d5c73-317c-4ffe-ada5-1ad96a5967b5 None None] MFA Rules not processed for user `0cb58263f8d64508852375306d31ba91`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:35.960800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-936d5c73-317c-4ffe-ada5-1ad96a5967b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:36.024872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c8e4e-34b3-4f2d-b1af-50d1293f8824 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:36.030556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bda6d-187f-435e-97d4-a84de84e827b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:36.031225 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bda6d-187f-435e-97d4-a84de84e827b service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:36.031509 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bda6d-187f-435e-97d4-a84de84e827b service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:36.032218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bda6d-187f-435e-97d4-a84de84e827b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:36.046410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bda6d-187f-435e-97d4-a84de84e827b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:36.049048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bda6d-187f-435e-97d4-a84de84e827b service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:36.067424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 799/1614] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:36.068554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d5c73-317c-4ffe-ada5-1ad96a5967b5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:36.071544 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 816/1615] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:36.079321 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024a24d-8498-4341-ab28-001dd7f76f8a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:36.079321 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024a24d-8498-4341-ab28-001dd7f76f8a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:36.079775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024a24d-8498-4341-ab28-001dd7f76f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:36.117471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3024a24d-8498-4341-ab28-001dd7f76f8a None None] MFA Rules not processed for user `a81c7ea0cff54779b29d6ec2dfeba926`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:36.118823 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3024a24d-8498-4341-ab28-001dd7f76f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:36.186801 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d5c73-317c-4ffe-ada5-1ad96a5967b5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:36.195634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc4a78-8e24-42c5-aa14-f91aff0eb3ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:36.195634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc4a78-8e24-42c5-aa14-f91aff0eb3ff service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:36.195634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc4a78-8e24-42c5-aa14-f91aff0eb3ff service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:36.195634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc4a78-8e24-42c5-aa14-f91aff0eb3ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:36.216924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 817/1616] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:36.218129 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024a24d-8498-4341-ab28-001dd7f76f8a None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:36.234947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024a24d-8498-4341-ab28-001dd7f76f8a None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:36.243074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c10114-a2f8-4a7e-8431-cbfeb83b3605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:36.245844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c10114-a2f8-4a7e-8431-cbfeb83b3605 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:36.246488 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c10114-a2f8-4a7e-8431-cbfeb83b3605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:36.247601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c10114-a2f8-4a7e-8431-cbfeb83b3605 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:36.250406 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c10114-a2f8-4a7e-8431-cbfeb83b3605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:36.253168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c10114-a2f8-4a7e-8431-cbfeb83b3605 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:36.279708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc4a78-8e24-42c5-aa14-f91aff0eb3ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:36.281424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc4a78-8e24-42c5-aa14-f91aff0eb3ff service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:36.296067 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 800/1617] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:36.297080 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc4a78-8e24-42c5-aa14-f91aff0eb3ff service nova] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:36.301805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 818/1618] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:36 2022] POST /identity/v3/projects => generated 363 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:36.303299 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebef8ea-0a3c-458f-884e-3f40b9f4b92d None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:36.303657 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebef8ea-0a3c-458f-884e-3f40b9f4b92d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:36.304007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebef8ea-0a3c-458f-884e-3f40b9f4b92d None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:36.305844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 819/1619] 10.222.0.26 () {54 vars in 961 bytes} [Mon Jul 11 15:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:36.306516 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebef8ea-0a3c-458f-884e-3f40b9f4b92d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:36.308630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc4a78-8e24-42c5-aa14-f91aff0eb3ff service nova] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:36.321904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:36.357110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:36.379648 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae7686-679d-4a36-9daf-caa0913e6e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:36.380828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae7686-679d-4a36-9daf-caa0913e6e98 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:36.381273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae7686-679d-4a36-9daf-caa0913e6e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:36.381878 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae7686-679d-4a36-9daf-caa0913e6e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:36.435344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebef8ea-0a3c-458f-884e-3f40b9f4b92d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:36.445453 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c61074-7f47-447d-9539-43c3628e51e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:36.447355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c61074-7f47-447d-9539-43c3628e51e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:36.449283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c61074-7f47-447d-9539-43c3628e51e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:36.449749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c61074-7f47-447d-9539-43c3628e51e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:36.452635 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c61074-7f47-447d-9539-43c3628e51e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:36.456664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c61074-7f47-447d-9539-43c3628e51e3 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:36.457524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae7686-679d-4a36-9daf-caa0913e6e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:36.459205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae7686-679d-4a36-9daf-caa0913e6e98 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:36.470505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 801/1620] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:36.471242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae7686-679d-4a36-9daf-caa0913e6e98 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:36.482991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae7686-679d-4a36-9daf-caa0913e6e98 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:36.487767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8c378-cc9e-45e5-adad-d83155cc04b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:36.488746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8c378-cc9e-45e5-adad-d83155cc04b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:36.489122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8c378-cc9e-45e5-adad-d83155cc04b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:36.489996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8c378-cc9e-45e5-adad-d83155cc04b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:36.490858 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8c378-cc9e-45e5-adad-d83155cc04b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:36.493323 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8c378-cc9e-45e5-adad-d83155cc04b1 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:36.531403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 802/1621] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:36 2022] POST /identity/v3/users => generated 288 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:36.534182 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 820/1622] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:36 2022] POST /identity/v3/projects => generated 405 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:36.535485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c61074-7f47-447d-9539-43c3628e51e3 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:36.538430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330b1eb-2d30-4390-bc5d-9d09cdb1596f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:36.538868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330b1eb-2d30-4390-bc5d-9d09cdb1596f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:36.539486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330b1eb-2d30-4390-bc5d-9d09cdb1596f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:36.561586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-9330b1eb-2d30-4390-bc5d-9d09cdb1596f None None] MFA Rules not processed for user `fa038a2e30f544aaa609d32e0e1ceaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:36.563259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9330b1eb-2d30-4390-bc5d-9d09cdb1596f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:36.659083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 803/1623] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Jul 11 15:49:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:36.660970 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330b1eb-2d30-4390-bc5d-9d09cdb1596f None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:36.662556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c61074-7f47-447d-9539-43c3628e51e3 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:36.676694 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330b1eb-2d30-4390-bc5d-9d09cdb1596f None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:36.677686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93610e-38fa-4c0a-aad4-42fcbfcc5adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:36.678877 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93610e-38fa-4c0a-aad4-42fcbfcc5adb admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:36.679245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93610e-38fa-4c0a-aad4-42fcbfcc5adb admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:36.679524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93610e-38fa-4c0a-aad4-42fcbfcc5adb admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:36.680553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93610e-38fa-4c0a-aad4-42fcbfcc5adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:36.683684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93610e-38fa-4c0a-aad4-42fcbfcc5adb admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:36.683831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f0643-936a-44b0-9d34-d266ff5c7436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:36.685436 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f0643-936a-44b0-9d34-d266ff5c7436 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:36.685891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f0643-936a-44b0-9d34-d266ff5c7436 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:36.686304 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f0643-936a-44b0-9d34-d266ff5c7436 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:36.687486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f0643-936a-44b0-9d34-d266ff5c7436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:36.690499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f0643-936a-44b0-9d34-d266ff5c7436 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:36.713036 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 821/1624] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:36.714142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93610e-38fa-4c0a-aad4-42fcbfcc5adb admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:36.728969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93610e-38fa-4c0a-aad4-42fcbfcc5adb admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:36.734242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 804/1625] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:36 2022] POST /identity/v3/users => generated 309 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:36.735391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f0643-936a-44b0-9d34-d266ff5c7436 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:36.735519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506bb76-404c-4f06-be49-462acd1f70e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:36.736915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506bb76-404c-4f06-be49-462acd1f70e4 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:36.737271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506bb76-404c-4f06-be49-462acd1f70e4 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:36.737608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506bb76-404c-4f06-be49-462acd1f70e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:36.757260 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f0643-936a-44b0-9d34-d266ff5c7436 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:36.772764 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef24eeb-1ab3-4191-b8ec-df8310c95773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:36.773780 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24eeb-1ab3-4191-b8ec-df8310c95773 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:36.774155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24eeb-1ab3-4191-b8ec-df8310c95773 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:36.774679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24eeb-1ab3-4191-b8ec-df8310c95773 admin admin] PATH_INFO: `/v3/projects/e978e6f3fd7341c59d3b353a82310af4/users/c3546797c9574a9c87e2e7f86ee0d665/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:36.810404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef24eeb-1ab3-4191-b8ec-df8310c95773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e978e6f3fd7341c59d3b353a82310af4, user_id=c3546797c9574a9c87e2e7f86ee0d665, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:36.815558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef24eeb-1ab3-4191-b8ec-df8310c95773 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:36.829411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:36.850711 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 805/1626] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:36 2022] PUT /identity/v3/projects/e978e6f3fd7341c59d3b353a82310af4/users/c3546797c9574a9c87e2e7f86ee0d665/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:36.856062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef24eeb-1ab3-4191-b8ec-df8310c95773 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:36.874301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506bb76-404c-4f06-be49-462acd1f70e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:36.877937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506bb76-404c-4f06-be49-462acd1f70e4 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:36.891622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 822/1627] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:36.892726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506bb76-404c-4f06-be49-462acd1f70e4 service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:36.906999 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506bb76-404c-4f06-be49-462acd1f70e4 service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:36.981741 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef24eeb-1ab3-4191-b8ec-df8310c95773 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:36.995261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc027f5-8302-4cc9-ba8c-6195cdc78e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:36.996895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc027f5-8302-4cc9-ba8c-6195cdc78e39 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:36.997644 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc027f5-8302-4cc9-ba8c-6195cdc78e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:36.998337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc027f5-8302-4cc9-ba8c-6195cdc78e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:37.001311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc027f5-8302-4cc9-ba8c-6195cdc78e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:37.004646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc027f5-8302-4cc9-ba8c-6195cdc78e39 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:37.016063 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:37.051169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 806/1628] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:37.051169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395aa2d-de4a-49b6-8097-562e37ab30ed None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:37.051169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395aa2d-de4a-49b6-8097-562e37ab30ed None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:37.051169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395aa2d-de4a-49b6-8097-562e37ab30ed None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:37.054375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 807/1629] 10.222.0.26 () {54 vars in 912 bytes} [Mon Jul 11 15:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:37.055107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395aa2d-de4a-49b6-8097-562e37ab30ed None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:37.061779 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddd5e3-2ea5-43f4-83de-a188797e2a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:37.062471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddd5e3-2ea5-43f4-83de-a188797e2a3b admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:37.062755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddd5e3-2ea5-43f4-83de-a188797e2a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:37.063206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddd5e3-2ea5-43f4-83de-a188797e2a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:37.064405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddd5e3-2ea5-43f4-83de-a188797e2a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:37.066059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddd5e3-2ea5-43f4-83de-a188797e2a3b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:37.086045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395aa2d-de4a-49b6-8097-562e37ab30ed None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:37.091264 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 823/1630] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:37.092917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55d76b-6de5-4741-8265-dceffb2c6aea None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:37.094641 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55d76b-6de5-4741-8265-dceffb2c6aea None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:37.094641 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55d76b-6de5-4741-8265-dceffb2c6aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:37.098839 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710d3f3-17f9-480a-89ca-0ecb77b14bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:37.100118 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710d3f3-17f9-480a-89ca-0ecb77b14bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:37.100569 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710d3f3-17f9-480a-89ca-0ecb77b14bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:37.100918 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710d3f3-17f9-480a-89ca-0ecb77b14bf4 admin admin] PATH_INFO: `/v3/projects/84541de030db401ab3efad35875fdd40/users/c3032d88e2064d74a4c826d1d6fc46e3/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:37.137066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710d3f3-17f9-480a-89ca-0ecb77b14bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84541de030db401ab3efad35875fdd40, user_id=c3032d88e2064d74a4c826d1d6fc46e3, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:37.143238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710d3f3-17f9-480a-89ca-0ecb77b14bf4 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:37.143944 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-5b55d76b-6de5-4741-8265-dceffb2c6aea None None] MFA Rules not processed for user `fa038a2e30f544aaa609d32e0e1ceaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:37.145377 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5b55d76b-6de5-4741-8265-dceffb2c6aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:37.173310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 808/1631] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:37 2022] PUT /identity/v3/projects/84541de030db401ab3efad35875fdd40/users/c3032d88e2064d74a4c826d1d6fc46e3/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:37.174463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710d3f3-17f9-480a-89ca-0ecb77b14bf4 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:37.325037 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 824/1632] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Jul 11 15:49:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:37.332885 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55d76b-6de5-4741-8265-dceffb2c6aea None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:37.346934 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710d3f3-17f9-480a-89ca-0ecb77b14bf4 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:37.352069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87879934-9ae3-404f-97dd-ac76f057bce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:37.353130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87879934-9ae3-404f-97dd-ac76f057bce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:37.353507 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87879934-9ae3-404f-97dd-ac76f057bce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:37.353967 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87879934-9ae3-404f-97dd-ac76f057bce9 admin admin] PATH_INFO: `/v3/projects/e978e6f3fd7341c59d3b353a82310af4/users/c3546797c9574a9c87e2e7f86ee0d665/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:37.355654 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55d76b-6de5-4741-8265-dceffb2c6aea None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:37.356404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87879934-9ae3-404f-97dd-ac76f057bce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e978e6f3fd7341c59d3b353a82310af4, user_id=c3546797c9574a9c87e2e7f86ee0d665, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:37.359055 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87879934-9ae3-404f-97dd-ac76f057bce9 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:37.367171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac3d0b-6751-45dd-825c-7be3b8721a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:37.369945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac3d0b-6751-45dd-825c-7be3b8721a98 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:37.371790 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac3d0b-6751-45dd-825c-7be3b8721a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:37.372110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac3d0b-6751-45dd-825c-7be3b8721a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:37.372926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac3d0b-6751-45dd-825c-7be3b8721a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:37.375248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 809/1633] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:37 2022] PUT /identity/v3/projects/e978e6f3fd7341c59d3b353a82310af4/users/c3546797c9574a9c87e2e7f86ee0d665/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:37.375248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da242e-6b7b-4135-87e7-f5c80eef7d72 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:37.375527 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da242e-6b7b-4135-87e7-f5c80eef7d72 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:37.375796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da242e-6b7b-4135-87e7-f5c80eef7d72 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:37.377489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 810/1634] 10.222.0.26 () {54 vars in 912 bytes} [Mon Jul 11 15:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:37.378153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da242e-6b7b-4135-87e7-f5c80eef7d72 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:37.378416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac3d0b-6751-45dd-825c-7be3b8721a98 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:37.410482 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 825/1635] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:37.412768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc5d20-70a4-41b2-998f-ac392ad9ca57 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:37.413060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc5d20-70a4-41b2-998f-ac392ad9ca57 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:37.413375 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc5d20-70a4-41b2-998f-ac392ad9ca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:37.447975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-73bc5d20-70a4-41b2-998f-ac392ad9ca57 None None] MFA Rules not processed for user `fa038a2e30f544aaa609d32e0e1ceaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:37.449822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-73bc5d20-70a4-41b2-998f-ac392ad9ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:37.451049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da242e-6b7b-4135-87e7-f5c80eef7d72 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:37.454960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281827e8-2344-4960-ac1d-3d2602a53ff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:37.456394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281827e8-2344-4960-ac1d-3d2602a53ff5 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:37.456394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281827e8-2344-4960-ac1d-3d2602a53ff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:37.456640 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281827e8-2344-4960-ac1d-3d2602a53ff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:37.477483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:37.627668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 826/1636] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Jul 11 15:49:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:37.640909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da251a-ba12-498b-9d3f-137d16a1132d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:37.641286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da251a-ba12-498b-9d3f-137d16a1132d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:37.643434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da251a-ba12-498b-9d3f-137d16a1132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:37.653466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281827e8-2344-4960-ac1d-3d2602a53ff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:37.657019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281827e8-2344-4960-ac1d-3d2602a53ff5 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:37.694576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 811/1637] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:37.697098 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281827e8-2344-4960-ac1d-3d2602a53ff5 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:37.723154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-b5da251a-ba12-498b-9d3f-137d16a1132d None None] MFA Rules not processed for user `c3546797c9574a9c87e2e7f86ee0d665`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:37.724236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b5da251a-ba12-498b-9d3f-137d16a1132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:37.815814 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:37.839907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281827e8-2344-4960-ac1d-3d2602a53ff5 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:37.853511 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8c172-aeab-47b4-a42f-4d7b7f06a364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:37.864098 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8c172-aeab-47b4-a42f-4d7b7f06a364 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:37.864098 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8c172-aeab-47b4-a42f-4d7b7f06a364 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:37.864098 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8c172-aeab-47b4-a42f-4d7b7f06a364 admin admin] PATH_INFO: `/v3/projects/84541de030db401ab3efad35875fdd40/users/c3032d88e2064d74a4c826d1d6fc46e3/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:37.865288 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8c172-aeab-47b4-a42f-4d7b7f06a364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84541de030db401ab3efad35875fdd40, user_id=c3032d88e2064d74a4c826d1d6fc46e3, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:37.872172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 827/1638] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:37.872172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da251a-ba12-498b-9d3f-137d16a1132d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:37.872571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8c172-aeab-47b4-a42f-4d7b7f06a364 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:37.912809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 812/1639] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:37 2022] PUT /identity/v3/projects/84541de030db401ab3efad35875fdd40/users/c3032d88e2064d74a4c826d1d6fc46e3/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:37.912809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8c172-aeab-47b4-a42f-4d7b7f06a364 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:37.916975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da251a-ba12-498b-9d3f-137d16a1132d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:38.010099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b318162-306c-43c7-b892-be2b700f336e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:38.011343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b318162-306c-43c7-b892-be2b700f336e service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:38.011875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b318162-306c-43c7-b892-be2b700f336e service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:38.012429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b318162-306c-43c7-b892-be2b700f336e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:38.023318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8c172-aeab-47b4-a42f-4d7b7f06a364 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:38.028109 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989366a7-5268-4edd-ac03-9467e67524de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:38.029175 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989366a7-5268-4edd-ac03-9467e67524de service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:38.029530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989366a7-5268-4edd-ac03-9467e67524de service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:38.029871 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989366a7-5268-4edd-ac03-9467e67524de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:38.111099 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:38.121102 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b318162-306c-43c7-b892-be2b700f336e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:38.122847 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b318162-306c-43c7-b892-be2b700f336e service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:38.133392 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989366a7-5268-4edd-ac03-9467e67524de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:38.135086 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989366a7-5268-4edd-ac03-9467e67524de service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:38.150988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 828/1640] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:38.152463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d931695-41cf-4d3d-91fc-13dac6ed4b1c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:38.152821 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d931695-41cf-4d3d-91fc-13dac6ed4b1c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:38.153171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d931695-41cf-4d3d-91fc-13dac6ed4b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:38.169438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 813/1641] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:37 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:49:38.208407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3d931695-41cf-4d3d-91fc-13dac6ed4b1c None None] MFA Rules not processed for user `c3032d88e2064d74a4c826d1d6fc46e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:38.208407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3d931695-41cf-4d3d-91fc-13dac6ed4b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:38.387489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 829/1642] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:38 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:38.478886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989366a7-5268-4edd-ac03-9467e67524de service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:38.483567 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d931695-41cf-4d3d-91fc-13dac6ed4b1c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:38.491763 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:38.496622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989366a7-5268-4edd-ac03-9467e67524de service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:38.502052 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448b78f-4219-49e6-a2b4-b68e56f8964c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:38.503237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448b78f-4219-49e6-a2b4-b68e56f8964c service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:38.503580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448b78f-4219-49e6-a2b4-b68e56f8964c service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:38.504555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448b78f-4219-49e6-a2b4-b68e56f8964c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:38.519589 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448b78f-4219-49e6-a2b4-b68e56f8964c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:38.522424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448b78f-4219-49e6-a2b4-b68e56f8964c service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:38.553200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 814/1643] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:38 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:38.623061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d931695-41cf-4d3d-91fc-13dac6ed4b1c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:38.639378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1453d2-5e8e-4f66-9bda-5d7e6980bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:38.640266 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1453d2-5e8e-4f66-9bda-5d7e6980bac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:38.640603 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1453d2-5e8e-4f66-9bda-5d7e6980bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:38.640880 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1453d2-5e8e-4f66-9bda-5d7e6980bac4 admin admin] PATH_INFO: `/v3/users/965e3434001a4b8ab02020e1b9133691` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:38.642745 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1453d2-5e8e-4f66-9bda-5d7e6980bac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=965e3434001a4b8ab02020e1b9133691)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:38.644177 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: WARNING py.warnings [None req-5c1453d2-5e8e-4f66-9bda-5d7e6980bac4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:49:38.644177 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: warnings.warn(msg) Jul 11 15:49:38.644177 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: Jul 11 15:49:38.645315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1453d2-5e8e-4f66-9bda-5d7e6980bac4 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:38.678712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448b78f-4219-49e6-a2b4-b68e56f8964c service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:38.690661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448b78f-4219-49e6-a2b4-b68e56f8964c service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:38.694546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092355d1-7dab-4d2b-9bec-e129d12df7da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:38.695776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092355d1-7dab-4d2b-9bec-e129d12df7da service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:38.696122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092355d1-7dab-4d2b-9bec-e129d12df7da service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:38.696500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092355d1-7dab-4d2b-9bec-e129d12df7da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:38.789210 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092355d1-7dab-4d2b-9bec-e129d12df7da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:38.791266 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092355d1-7dab-4d2b-9bec-e129d12df7da service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:38.823051 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 815/1644] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:38 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:38.825267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863356df-01ea-443b-a825-b9de70268a47 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:38.825476 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863356df-01ea-443b-a825-b9de70268a47 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:38.826015 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863356df-01ea-443b-a825-b9de70268a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:38.855320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-5c1453d2-5e8e-4f66-9bda-5d7e6980bac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965e3434001a4b8ab02020e1b9133691'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:38.901049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-5c1453d2-5e8e-4f66-9bda-5d7e6980bac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965e3434001a4b8ab02020e1b9133691'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:38.906075 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-5c1453d2-5e8e-4f66-9bda-5d7e6980bac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965e3434001a4b8ab02020e1b9133691'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:38.906897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-5c1453d2-5e8e-4f66-9bda-5d7e6980bac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965e3434001a4b8ab02020e1b9133691'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:38.909589 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-863356df-01ea-443b-a825-b9de70268a47 None None] MFA Rules not processed for user `4046223c20754d68af45ce96044fb252`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:38.913985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-863356df-01ea-443b-a825-b9de70268a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:38.929166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-5c1453d2-5e8e-4f66-9bda-5d7e6980bac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965e3434001a4b8ab02020e1b9133691'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:39.012888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 830/1645] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:49:38 2022] DELETE /identity/v3/users/965e3434001a4b8ab02020e1b9133691 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:49:39.018889 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941fb44-0d20-400f-9b03-b003a4bc8537 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:39.019354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941fb44-0d20-400f-9b03-b003a4bc8537 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:39.020557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941fb44-0d20-400f-9b03-b003a4bc8537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:39.064803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-d941fb44-0d20-400f-9b03-b003a4bc8537 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:39.068207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d941fb44-0d20-400f-9b03-b003a4bc8537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:39.106058 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 816/1646] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:39.107227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863356df-01ea-443b-a825-b9de70268a47 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:39.108711 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-863356df-01ea-443b-a825-b9de70268a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:39.137026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863356df-01ea-443b-a825-b9de70268a47 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:39.234983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 831/1647] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:39.267939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941fb44-0d20-400f-9b03-b003a4bc8537 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:39.270238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d941fb44-0d20-400f-9b03-b003a4bc8537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:39.274583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f283333-7ef7-4c17-80f2-233cf5b16fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:39.275233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283333-7ef7-4c17-80f2-233cf5b16fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:39.275515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283333-7ef7-4c17-80f2-233cf5b16fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:39.275794 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283333-7ef7-4c17-80f2-233cf5b16fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:39.276520 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f283333-7ef7-4c17-80f2-233cf5b16fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:39.290513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f283333-7ef7-4c17-80f2-233cf5b16fe4 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:39.302742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:39.353379 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 817/1648] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:39 2022] POST /identity/v3/projects => generated 405 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:49:39.353584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:39.354463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f283333-7ef7-4c17-80f2-233cf5b16fe4 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:39.421454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941fb44-0d20-400f-9b03-b003a4bc8537 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:39.510006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6dc71-5b8c-45f8-b3ce-f80b8354795b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:39.510779 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6dc71-5b8c-45f8-b3ce-f80b8354795b service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:39.511623 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6dc71-5b8c-45f8-b3ce-f80b8354795b service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:39.511623 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6dc71-5b8c-45f8-b3ce-f80b8354795b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:39.530042 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f283333-7ef7-4c17-80f2-233cf5b16fe4 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:39.538614 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4852c1-c7c7-4bf0-963a-c9341b4f6d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:39.539358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4852c1-c7c7-4bf0-963a-c9341b4f6d48 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:39.539644 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4852c1-c7c7-4bf0-963a-c9341b4f6d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:39.539920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4852c1-c7c7-4bf0-963a-c9341b4f6d48 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:39.540712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4852c1-c7c7-4bf0-963a-c9341b4f6d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:39.541997 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6dc71-5b8c-45f8-b3ce-f80b8354795b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:39.545963 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4852c1-c7c7-4bf0-963a-c9341b4f6d48 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:39.546993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6dc71-5b8c-45f8-b3ce-f80b8354795b service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:39.574426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 832/1649] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:39.589240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 818/1650] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:39 2022] POST /identity/v3/users => generated 309 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:39.592355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6dc71-5b8c-45f8-b3ce-f80b8354795b service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:39.629580 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6dc71-5b8c-45f8-b3ce-f80b8354795b service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:39.644521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928be6e-5971-4f95-bc96-49e4daa68e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:39.655673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928be6e-5971-4f95-bc96-49e4daa68e25 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:39.658277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928be6e-5971-4f95-bc96-49e4daa68e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:39.659273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928be6e-5971-4f95-bc96-49e4daa68e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:39.662620 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928be6e-5971-4f95-bc96-49e4daa68e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:39.670134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928be6e-5971-4f95-bc96-49e4daa68e25 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:39.688697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 833/1651] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:39.692604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4852c1-c7c7-4bf0-963a-c9341b4f6d48 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:39.732939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4852c1-c7c7-4bf0-963a-c9341b4f6d48 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:39.753376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd95390-7073-46b3-a817-63a741644a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:39.755849 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95390-7073-46b3-a817-63a741644a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:39.756324 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95390-7073-46b3-a817-63a741644a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:39.756758 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95390-7073-46b3-a817-63a741644a78 admin admin] PATH_INFO: `/v3/projects/a5cd266f8e3f4e3bb515805513478eba/users/b092f76bf0124a8eb6ed13091bcc287a/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:39.779509 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928be6e-5971-4f95-bc96-49e4daa68e25 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:39.780887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1928be6e-5971-4f95-bc96-49e4daa68e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:39.789584 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd95390-7073-46b3-a817-63a741644a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5cd266f8e3f4e3bb515805513478eba, user_id=b092f76bf0124a8eb6ed13091bcc287a, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:39.793366 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd95390-7073-46b3-a817-63a741644a78 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:39.793901 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928be6e-5971-4f95-bc96-49e4daa68e25 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:39.800890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f79989-e184-48d9-8815-38d1303d4a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:39.802149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79989-e184-48d9-8815-38d1303d4a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:39.802314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79989-e184-48d9-8815-38d1303d4a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:39.802729 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79989-e184-48d9-8815-38d1303d4a6d admin admin] PATH_INFO: `/v3/users/a81c7ea0cff54779b29d6ec2dfeba926` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:39.804355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f79989-e184-48d9-8815-38d1303d4a6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a81c7ea0cff54779b29d6ec2dfeba926)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:39.806598 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f79989-e184-48d9-8815-38d1303d4a6d admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:39.828947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 819/1652] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:39 2022] PUT /identity/v3/projects/a5cd266f8e3f4e3bb515805513478eba/users/b092f76bf0124a8eb6ed13091bcc287a/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:49:39.833490 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd95390-7073-46b3-a817-63a741644a78 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:39.923263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-41f79989-e184-48d9-8815-38d1303d4a6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a81c7ea0cff54779b29d6ec2dfeba926'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:39.935988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-41f79989-e184-48d9-8815-38d1303d4a6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a81c7ea0cff54779b29d6ec2dfeba926'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:39.937149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-41f79989-e184-48d9-8815-38d1303d4a6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a81c7ea0cff54779b29d6ec2dfeba926'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:39.938650 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-41f79989-e184-48d9-8815-38d1303d4a6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a81c7ea0cff54779b29d6ec2dfeba926'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:39.960425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-41f79989-e184-48d9-8815-38d1303d4a6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a81c7ea0cff54779b29d6ec2dfeba926'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:39.964557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd95390-7073-46b3-a817-63a741644a78 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:39.972811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15274562-71ea-4959-ab3f-e9d4349416e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:39.973612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15274562-71ea-4959-ab3f-e9d4349416e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:39.974278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15274562-71ea-4959-ab3f-e9d4349416e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:39.974654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15274562-71ea-4959-ab3f-e9d4349416e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:39.975527 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15274562-71ea-4959-ab3f-e9d4349416e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:39.977493 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15274562-71ea-4959-ab3f-e9d4349416e6 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:39.991875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 834/1653] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:49:39 2022] DELETE /identity/v3/users/a81c7ea0cff54779b29d6ec2dfeba926 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:49:39.993700 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18793efd-4285-4713-9b02-cc9eb18a772a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:39.994156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18793efd-4285-4713-9b02-cc9eb18a772a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:39.994613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18793efd-4285-4713-9b02-cc9eb18a772a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:39.999646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 820/1654] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:40.001989 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15274562-71ea-4959-ab3f-e9d4349416e6 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:40.003888 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-15274562-71ea-4959-ab3f-e9d4349416e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:40.020028 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-18793efd-4285-4713-9b02-cc9eb18a772a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:40.021957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-18793efd-4285-4713-9b02-cc9eb18a772a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:40.031495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15274562-71ea-4959-ab3f-e9d4349416e6 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:40.087807 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:40.113977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 835/1655] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:40.126939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:40.149986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a72d25-fca5-4a03-bc93-2015b923fc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:40.151432 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a72d25-fca5-4a03-bc93-2015b923fc19 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:40.151805 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a72d25-fca5-4a03-bc93-2015b923fc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:40.152174 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a72d25-fca5-4a03-bc93-2015b923fc19 admin admin] PATH_INFO: `/v3/projects/a5cd266f8e3f4e3bb515805513478eba/users/b092f76bf0124a8eb6ed13091bcc287a/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:40.154460 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a72d25-fca5-4a03-bc93-2015b923fc19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5cd266f8e3f4e3bb515805513478eba, user_id=b092f76bf0124a8eb6ed13091bcc287a, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:40.157899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a72d25-fca5-4a03-bc93-2015b923fc19 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:40.182305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 821/1656] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:40 2022] PUT /identity/v3/projects/a5cd266f8e3f4e3bb515805513478eba/users/b092f76bf0124a8eb6ed13091bcc287a/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:40.187092 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18793efd-4285-4713-9b02-cc9eb18a772a None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:40.188873 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-18793efd-4285-4713-9b02-cc9eb18a772a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:40.359470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18793efd-4285-4713-9b02-cc9eb18a772a None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:40.434197 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4a97f-818e-49c1-af2f-59adcabb6158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:40.434983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4a97f-818e-49c1-af2f-59adcabb6158 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:40.435243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4a97f-818e-49c1-af2f-59adcabb6158 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:40.435533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4a97f-818e-49c1-af2f-59adcabb6158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:40.530470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4a97f-818e-49c1-af2f-59adcabb6158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:40.532179 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4a97f-818e-49c1-af2f-59adcabb6158 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:40.546025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 836/1657] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:49:41.588043 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a72d25-fca5-4a03-bc93-2015b923fc19 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:41.590651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a2a72d25-fca5-4a03-bc93-2015b923fc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:41.640202 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a72d25-fca5-4a03-bc93-2015b923fc19 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:41.669462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:41.671056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:41.672867 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:41.674229 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] PATH_INFO: `/v3/projects/a9722fc206784e65880628276076ac7a` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:41.693225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9722fc206784e65880628276076ac7a)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:41.697455 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: WARNING py.warnings [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 15:49:41.697455 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: warnings.warn(msg) Jul 11 15:49:41.697455 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: Jul 11 15:49:41.708696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:41.886087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9722fc206784e65880628276076ac7a', 'request_id': 'req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:41.894627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9722fc206784e65880628276076ac7a', 'request_id': 'req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:41.931277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9722fc206784e65880628276076ac7a', 'request_id': 'req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:41.966958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] The token cache is being invalidate because project a9722fc206784e65880628276076ac7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:49:41.969508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:41.971522 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:41.978140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 822/1658] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:49:41 2022] DELETE /identity/v3/projects/a9722fc206784e65880628276076ac7a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:41.979129 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6a597-49a2-48be-abe7-913b933d1ef9 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:41.979594 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6a597-49a2-48be-abe7-913b933d1ef9 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:41.979688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6a597-49a2-48be-abe7-913b933d1ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:42.046845 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-09c6a597-49a2-48be-abe7-913b933d1ef9 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:42.048406 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-09c6a597-49a2-48be-abe7-913b933d1ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:42.089903 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:42.091673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:42.182380 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:42.220616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 837/1659] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:42.224092 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed85379-0fb5-4b38-8654-420ef0653604 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:42.226385 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed85379-0fb5-4b38-8654-420ef0653604 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:42.226877 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed85379-0fb5-4b38-8654-420ef0653604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:42.273936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb5afd-97a9-4187-b1b9-8a4e4a79362b admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:42.279793 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3ed85379-0fb5-4b38-8654-420ef0653604 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:42.280573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:42.281069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3ed85379-0fb5-4b38-8654-420ef0653604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:42.281459 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:42.282113 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:42.282537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] PATH_INFO: `/v3/projects/87584a54dff444ceaf7ed8b7f735ea64` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:42.283854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87584a54dff444ceaf7ed8b7f735ea64)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:42.285957 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:42.304414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 838/1660] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:42.308955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed85379-0fb5-4b38-8654-420ef0653604 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:42.324859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed85379-0fb5-4b38-8654-420ef0653604 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:42.340144 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaf4b6-c489-46c7-bd9d-dbaa54dfd3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:42.341123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaf4b6-c489-46c7-bd9d-dbaa54dfd3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:42.341762 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaf4b6-c489-46c7-bd9d-dbaa54dfd3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:42.343963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaf4b6-c489-46c7-bd9d-dbaa54dfd3d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:42.345040 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaf4b6-c489-46c7-bd9d-dbaa54dfd3d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:49:42.345500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaf4b6-c489-46c7-bd9d-dbaa54dfd3d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:42.350407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaf4b6-c489-46c7-bd9d-dbaa54dfd3d7 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:42.380948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 839/1661] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:49:42.388392 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaf4b6-c489-46c7-bd9d-dbaa54dfd3d7 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:42.389871 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87584a54dff444ceaf7ed8b7f735ea64', 'request_id': 'req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:42.401848 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87584a54dff444ceaf7ed8b7f735ea64', 'request_id': 'req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:42.406591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaf4b6-c489-46c7-bd9d-dbaa54dfd3d7 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:42.418175 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87584a54dff444ceaf7ed8b7f735ea64', 'request_id': 'req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:42.424369 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:42.444143 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] The token cache is being invalidate because project 87584a54dff444ceaf7ed8b7f735ea64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:49:42.444480 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:42.445587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:42.450851 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 823/1662] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:49:42 2022] DELETE /identity/v3/projects/87584a54dff444ceaf7ed8b7f735ea64 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:42.455353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:42.456929 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:42.575581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26ebd4-11db-4e4c-b8ce-ecec349ccae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:42.576276 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ebd4-11db-4e4c-b8ce-ecec349ccae8 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:42.576587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ebd4-11db-4e4c-b8ce-ecec349ccae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:42.576865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ebd4-11db-4e4c-b8ce-ecec349ccae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:42.577583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26ebd4-11db-4e4c-b8ce-ecec349ccae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:42.585875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26ebd4-11db-4e4c-b8ce-ecec349ccae8 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:42.642748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bbe2b-4993-41ff-9c7d-45f9e2ba7c66 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:42.651977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 840/1663] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:42 2022] POST /identity/v3/projects => generated 381 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:42.656553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26ebd4-11db-4e4c-b8ce-ecec349ccae8 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:42.662854 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4b26ebd4-11db-4e4c-b8ce-ecec349ccae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:42.663183 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80481c32-5da4-4b72-a7f1-6e73736ab742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:42.664223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80481c32-5da4-4b72-a7f1-6e73736ab742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:42.664540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80481c32-5da4-4b72-a7f1-6e73736ab742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:42.664820 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80481c32-5da4-4b72-a7f1-6e73736ab742 admin admin] PATH_INFO: `/v3/users/c3032d88e2064d74a4c826d1d6fc46e3` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:42.666307 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80481c32-5da4-4b72-a7f1-6e73736ab742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3032d88e2064d74a4c826d1d6fc46e3)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:42.671808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80481c32-5da4-4b72-a7f1-6e73736ab742 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:42.780958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-80481c32-5da4-4b72-a7f1-6e73736ab742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3032d88e2064d74a4c826d1d6fc46e3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:42.799549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-80481c32-5da4-4b72-a7f1-6e73736ab742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3032d88e2064d74a4c826d1d6fc46e3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:42.803247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-80481c32-5da4-4b72-a7f1-6e73736ab742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3032d88e2064d74a4c826d1d6fc46e3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:42.804913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-80481c32-5da4-4b72-a7f1-6e73736ab742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3032d88e2064d74a4c826d1d6fc46e3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:42.827399 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-80481c32-5da4-4b72-a7f1-6e73736ab742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3032d88e2064d74a4c826d1d6fc46e3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:42.830684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26ebd4-11db-4e4c-b8ce-ecec349ccae8 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:42.847555 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ce538-2cf0-41cd-96e0-994241605e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:42.848423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ce538-2cf0-41cd-96e0-994241605e26 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:42.849095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ce538-2cf0-41cd-96e0-994241605e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:42.849485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ce538-2cf0-41cd-96e0-994241605e26 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:42.853836 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ce538-2cf0-41cd-96e0-994241605e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:42.856245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ce538-2cf0-41cd-96e0-994241605e26 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:42.857934 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 824/1664] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:49:42 2022] DELETE /identity/v3/users/c3032d88e2064d74a4c826d1d6fc46e3 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:42.942710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 841/1665] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:42 2022] POST /identity/v3/users => generated 291 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:42.944422 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80481c32-5da4-4b72-a7f1-6e73736ab742 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:42.946366 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-80481c32-5da4-4b72-a7f1-6e73736ab742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:43.096322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80481c32-5da4-4b72-a7f1-6e73736ab742 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:43.115587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095a587-6a07-4367-a1db-b2f8039c3bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:43.116283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095a587-6a07-4367-a1db-b2f8039c3bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:43.116622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095a587-6a07-4367-a1db-b2f8039c3bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:43.116893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095a587-6a07-4367-a1db-b2f8039c3bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:43.117841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095a587-6a07-4367-a1db-b2f8039c3bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:43.119530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095a587-6a07-4367-a1db-b2f8039c3bc7 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:43.156203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 825/1666] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:43.157698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ce538-2cf0-41cd-96e0-994241605e26 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:43.184907 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ce538-2cf0-41cd-96e0-994241605e26 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:43.201362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9c1b9-566e-4983-b1e2-9f2ad151bd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:43.202229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9c1b9-566e-4983-b1e2-9f2ad151bd95 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:43.202613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9c1b9-566e-4983-b1e2-9f2ad151bd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:43.203011 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9c1b9-566e-4983-b1e2-9f2ad151bd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:43.204401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9c1b9-566e-4983-b1e2-9f2ad151bd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:43.205940 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9c1b9-566e-4983-b1e2-9f2ad151bd95 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:43.240924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 842/1667] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:43.242247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095a587-6a07-4367-a1db-b2f8039c3bc7 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:43.263271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095a587-6a07-4367-a1db-b2f8039c3bc7 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:43.283467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86c038-b470-41b3-99d0-2743962b7c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:43.284342 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86c038-b470-41b3-99d0-2743962b7c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:43.284593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86c038-b470-41b3-99d0-2743962b7c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:43.284867 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86c038-b470-41b3-99d0-2743962b7c8b admin admin] PATH_INFO: `/v3/projects/b5f0620cf3b449c39210c7762b51c9a4/users/8d66eb56493c4fbfbbe8fe3a84c092e3/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:43.310301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:43.323709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86c038-b470-41b3-99d0-2743962b7c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f0620cf3b449c39210c7762b51c9a4, user_id=8d66eb56493c4fbfbbe8fe3a84c092e3, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:43.326519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86c038-b470-41b3-99d0-2743962b7c8b admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:43.362360 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 826/1668] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:43 2022] PUT /identity/v3/projects/b5f0620cf3b449c39210c7762b51c9a4/users/8d66eb56493c4fbfbbe8fe3a84c092e3/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:43.378405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4553b-a782-4c0c-b6a2-2ed7e72d05fb None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:43.379152 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4553b-a782-4c0c-b6a2-2ed7e72d05fb None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:43.379438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4553b-a782-4c0c-b6a2-2ed7e72d05fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:43.457586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-17b4553b-a782-4c0c-b6a2-2ed7e72d05fb None None] MFA Rules not processed for user `8d66eb56493c4fbfbbe8fe3a84c092e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:43.458927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-17b4553b-a782-4c0c-b6a2-2ed7e72d05fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:43.543307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:43.675540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86c038-b470-41b3-99d0-2743962b7c8b admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:43.678525 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 843/1669] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:43.822083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86c038-b470-41b3-99d0-2743962b7c8b admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:43.828557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462628f-0106-420d-ab56-474506c77f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:43.830058 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462628f-0106-420d-ab56-474506c77f45 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:43.830598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462628f-0106-420d-ab56-474506c77f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:43.831469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462628f-0106-420d-ab56-474506c77f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:43.832035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462628f-0106-420d-ab56-474506c77f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:43.834251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462628f-0106-420d-ab56-474506c77f45 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:43.886534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 827/1670] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:43 2022] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:43.889484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4553b-a782-4c0c-b6a2-2ed7e72d05fb None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:43.909940 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4553b-a782-4c0c-b6a2-2ed7e72d05fb None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:44.129413 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871261e-1157-4d88-87e7-b663ea1ee178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:44.130142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871261e-1157-4d88-87e7-b663ea1ee178 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:44.130427 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871261e-1157-4d88-87e7-b663ea1ee178 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:44.130811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871261e-1157-4d88-87e7-b663ea1ee178 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:44.131663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871261e-1157-4d88-87e7-b663ea1ee178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:44.138936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871261e-1157-4d88-87e7-b663ea1ee178 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:44.196662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 844/1671] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:43 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:44.200955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462628f-0106-420d-ab56-474506c77f45 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:44.217684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462628f-0106-420d-ab56-474506c77f45 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:44.231137 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a9e5e-cabb-4671-9366-dfff1781fe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:44.241147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a9e5e-cabb-4671-9366-dfff1781fe8d admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:44.241620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a9e5e-cabb-4671-9366-dfff1781fe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:44.242821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a9e5e-cabb-4671-9366-dfff1781fe8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:44.243743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a9e5e-cabb-4671-9366-dfff1781fe8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:44.246401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a9e5e-cabb-4671-9366-dfff1781fe8d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:44.279209 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 828/1672] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:44.283104 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871261e-1157-4d88-87e7-b663ea1ee178 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:44.291198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a9e5e-cabb-4671-9366-dfff1781fe8d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:44.294809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7d6a9e5e-cabb-4671-9366-dfff1781fe8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:44.300075 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871261e-1157-4d88-87e7-b663ea1ee178 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:44.325027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae3ea2-26ab-47dc-808f-1ed774492387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:44.326122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae3ea2-26ab-47dc-808f-1ed774492387 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:44.326406 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae3ea2-26ab-47dc-808f-1ed774492387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:44.332021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae3ea2-26ab-47dc-808f-1ed774492387 admin admin] PATH_INFO: `/v3/projects/a03c03cbb3fd4b1aa8abe478407a2edf/users/83cd7f16811b40adafc27dff53c3bd73/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:44.342976 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a9e5e-cabb-4671-9366-dfff1781fe8d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:44.368506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae3ea2-26ab-47dc-808f-1ed774492387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03c03cbb3fd4b1aa8abe478407a2edf, user_id=83cd7f16811b40adafc27dff53c3bd73, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:44.372910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae3ea2-26ab-47dc-808f-1ed774492387 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:44.375088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2ee89-a63e-4c17-a091-d9baec94f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:44.377467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2ee89-a63e-4c17-a091-d9baec94f806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:44.377753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2ee89-a63e-4c17-a091-d9baec94f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:44.378024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2ee89-a63e-4c17-a091-d9baec94f806 admin admin] PATH_INFO: `/v3/users/c7e6ab4867c64d03938da958d02f653c` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:44.380972 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2ee89-a63e-4c17-a091-d9baec94f806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e6ab4867c64d03938da958d02f653c)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:44.383124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2ee89-a63e-4c17-a091-d9baec94f806 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:44.407599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 845/1673] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:44 2022] PUT /identity/v3/projects/a03c03cbb3fd4b1aa8abe478407a2edf/users/83cd7f16811b40adafc27dff53c3bd73/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:44.413437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae3ea2-26ab-47dc-808f-1ed774492387 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:44.499368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0ff2ee89-a63e-4c17-a091-d9baec94f806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e6ab4867c64d03938da958d02f653c'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:44.518967 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0ff2ee89-a63e-4c17-a091-d9baec94f806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e6ab4867c64d03938da958d02f653c'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:44.521104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0ff2ee89-a63e-4c17-a091-d9baec94f806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e6ab4867c64d03938da958d02f653c'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:44.521746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0ff2ee89-a63e-4c17-a091-d9baec94f806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e6ab4867c64d03938da958d02f653c'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:44.538118 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0ff2ee89-a63e-4c17-a091-d9baec94f806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e6ab4867c64d03938da958d02f653c'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:44.575424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 829/1674] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:49:44 2022] DELETE /identity/v3/users/c7e6ab4867c64d03938da958d02f653c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:44.580816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c44fdf-3f0f-4218-a973-44e0837d9060 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:44.581118 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c44fdf-3f0f-4218-a973-44e0837d9060 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:44.581390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c44fdf-3f0f-4218-a973-44e0837d9060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:44.611914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae3ea2-26ab-47dc-808f-1ed774492387 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:44.622468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-a6c44fdf-3f0f-4218-a973-44e0837d9060 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:44.627091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a6c44fdf-3f0f-4218-a973-44e0837d9060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:44.705868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:44.739256 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:44.765177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 830/1675] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:44.776327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b1afd-6aab-45ed-8ba4-daa4cc92fabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:44.777212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b1afd-6aab-45ed-8ba4-daa4cc92fabe admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:44.777599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b1afd-6aab-45ed-8ba4-daa4cc92fabe admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:44.782486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b1afd-6aab-45ed-8ba4-daa4cc92fabe admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:44.783514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b1afd-6aab-45ed-8ba4-daa4cc92fabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:44.785337 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b1afd-6aab-45ed-8ba4-daa4cc92fabe admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:44.807720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c44fdf-3f0f-4218-a973-44e0837d9060 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:44.809039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 846/1676] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:44.809283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a6c44fdf-3f0f-4218-a973-44e0837d9060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:44.819401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b1afd-6aab-45ed-8ba4-daa4cc92fabe admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:44.822015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-064b1afd-6aab-45ed-8ba4-daa4cc92fabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:44.835369 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c44fdf-3f0f-4218-a973-44e0837d9060 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:44.847163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5583f7-6360-4f0f-8587-37a21e0d66b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:44.849461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5583f7-6360-4f0f-8587-37a21e0d66b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:44.849847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5583f7-6360-4f0f-8587-37a21e0d66b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:44.850230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5583f7-6360-4f0f-8587-37a21e0d66b8 admin admin] PATH_INFO: `/v3/projects/a03c03cbb3fd4b1aa8abe478407a2edf/users/83cd7f16811b40adafc27dff53c3bd73/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:44.854663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5583f7-6360-4f0f-8587-37a21e0d66b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03c03cbb3fd4b1aa8abe478407a2edf, user_id=83cd7f16811b40adafc27dff53c3bd73, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:44.858665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5583f7-6360-4f0f-8587-37a21e0d66b8 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:44.905604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 831/1677] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:44 2022] PUT /identity/v3/projects/a03c03cbb3fd4b1aa8abe478407a2edf/users/83cd7f16811b40adafc27dff53c3bd73/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:49:44.907163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408ee58-b7d8-4516-8bda-debcb85c3543 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:44.908731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408ee58-b7d8-4516-8bda-debcb85c3543 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:44.908862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408ee58-b7d8-4516-8bda-debcb85c3543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:44.995714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-1408ee58-b7d8-4516-8bda-debcb85c3543 None None] MFA Rules not processed for user `83cd7f16811b40adafc27dff53c3bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:44.996982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1408ee58-b7d8-4516-8bda-debcb85c3543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:45.006945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b1afd-6aab-45ed-8ba4-daa4cc92fabe admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:45.140723 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85280ac-937c-4e6a-b549-5f3b14ca3516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:45.141923 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85280ac-937c-4e6a-b549-5f3b14ca3516 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:45.142349 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85280ac-937c-4e6a-b549-5f3b14ca3516 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:45.142762 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85280ac-937c-4e6a-b549-5f3b14ca3516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:45.210100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 832/1678] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:45.219289 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408ee58-b7d8-4516-8bda-debcb85c3543 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:45.223097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1408ee58-b7d8-4516-8bda-debcb85c3543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:45.382557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85280ac-937c-4e6a-b549-5f3b14ca3516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:45.382557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85280ac-937c-4e6a-b549-5f3b14ca3516 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:45.395064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408ee58-b7d8-4516-8bda-debcb85c3543 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:45.410108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:45.410374 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 847/1679] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:49:45.412715 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:45.413208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:45.413315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4da59-857a-4735-b3c8-4b58fbac9dd4 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:45.413507 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] PATH_INFO: `/v3/projects/84541de030db401ab3efad35875fdd40` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:45.414597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4da59-857a-4735-b3c8-4b58fbac9dd4 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:45.415054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4da59-857a-4735-b3c8-4b58fbac9dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:45.415320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=84541de030db401ab3efad35875fdd40)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:45.417814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:45.496909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-d5d4da59-857a-4735-b3c8-4b58fbac9dd4 None None] MFA Rules not processed for user `b092f76bf0124a8eb6ed13091bcc287a`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:45.503233 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d5d4da59-857a-4735-b3c8-4b58fbac9dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:45.593346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:45.595649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84541de030db401ab3efad35875fdd40', 'request_id': 'req-1acf0046-3519-487b-b11d-37e910c592ad'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:45.620279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84541de030db401ab3efad35875fdd40', 'request_id': 'req-1acf0046-3519-487b-b11d-37e910c592ad'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:45.623099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:45.653030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84541de030db401ab3efad35875fdd40', 'request_id': 'req-1acf0046-3519-487b-b11d-37e910c592ad'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:45.689543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] The token cache is being invalidate because project 84541de030db401ab3efad35875fdd40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:49:45.690103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:45.691835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:45.697410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 833/1680] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:49:45 2022] DELETE /identity/v3/projects/84541de030db401ab3efad35875fdd40 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:45.698535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:45.703497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:45.719997 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 848/1681] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:45 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:45.721733 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3443cd-e2e9-4f44-a967-39fe49cb45a0 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:45.722103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3443cd-e2e9-4f44-a967-39fe49cb45a0 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:45.722648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3443cd-e2e9-4f44-a967-39fe49cb45a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:45.765344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-2b3443cd-e2e9-4f44-a967-39fe49cb45a0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:45.766826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2b3443cd-e2e9-4f44-a967-39fe49cb45a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:45.854254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf0046-3519-487b-b11d-37e910c592ad admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:45.859172 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03683b9c-9f4d-4730-a1f5-bbcf52f0fb96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:45.860189 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683b9c-9f4d-4730-a1f5-bbcf52f0fb96 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:45.860782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683b9c-9f4d-4730-a1f5-bbcf52f0fb96 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:45.861315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683b9c-9f4d-4730-a1f5-bbcf52f0fb96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:45.867618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-03683b9c-9f4d-4730-a1f5-bbcf52f0fb96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:45.937517 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 849/1682] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:45.941171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22ba1f-56a0-4b54-8346-80dc540d6899 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:45.941464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22ba1f-56a0-4b54-8346-80dc540d6899 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:45.941741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22ba1f-56a0-4b54-8346-80dc540d6899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:45.981431 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-5e22ba1f-56a0-4b54-8346-80dc540d6899 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:45.986344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5e22ba1f-56a0-4b54-8346-80dc540d6899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:46.010503 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 850/1683] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:49:46.012236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22ba1f-56a0-4b54-8346-80dc540d6899 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:46.027855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22ba1f-56a0-4b54-8346-80dc540d6899 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:46.029338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03683b9c-9f4d-4730-a1f5-bbcf52f0fb96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:46.033144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03683b9c-9f4d-4730-a1f5-bbcf52f0fb96 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:46.041979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359447db-d386-4c23-aa7f-b5adc0512d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:46.042688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359447db-d386-4c23-aa7f-b5adc0512d83 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:46.043052 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359447db-d386-4c23-aa7f-b5adc0512d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:46.043326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359447db-d386-4c23-aa7f-b5adc0512d83 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:46.044241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359447db-d386-4c23-aa7f-b5adc0512d83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:49:46.044726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359447db-d386-4c23-aa7f-b5adc0512d83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:46.049300 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359447db-d386-4c23-aa7f-b5adc0512d83 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:46.059525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 834/1684] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:46.077419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 851/1685] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:49:46.078965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03683b9c-9f4d-4730-a1f5-bbcf52f0fb96 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:46.097473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03683b9c-9f4d-4730-a1f5-bbcf52f0fb96 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:46.113047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab3d8a-5acc-4bbd-8b49-d92de9c11040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:46.113849 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3d8a-5acc-4bbd-8b49-d92de9c11040 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:46.114247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3d8a-5acc-4bbd-8b49-d92de9c11040 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:46.114630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3d8a-5acc-4bbd-8b49-d92de9c11040 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:46.115588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab3d8a-5acc-4bbd-8b49-d92de9c11040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:46.120443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab3d8a-5acc-4bbd-8b49-d92de9c11040 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:46.189637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 835/1686] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:46 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:46.192272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359447db-d386-4c23-aa7f-b5adc0512d83 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:46.212133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359447db-d386-4c23-aa7f-b5adc0512d83 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:46.227095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab3d8a-5acc-4bbd-8b49-d92de9c11040 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:46.318043 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab3d8a-5acc-4bbd-8b49-d92de9c11040 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:46.327580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3688667-9e25-4b5b-b98c-96eba032512e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:46.328947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3688667-9e25-4b5b-b98c-96eba032512e service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:46.329473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3688667-9e25-4b5b-b98c-96eba032512e service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:46.329926 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3688667-9e25-4b5b-b98c-96eba032512e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:46.334153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-c3688667-9e25-4b5b-b98c-96eba032512e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:46.350966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297e3fb-9ff9-4ea0-997d-59728af5d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:46.351657 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297e3fb-9ff9-4ea0-997d-59728af5d74e admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:46.351936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297e3fb-9ff9-4ea0-997d-59728af5d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:46.352216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297e3fb-9ff9-4ea0-997d-59728af5d74e admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:46.352978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297e3fb-9ff9-4ea0-997d-59728af5d74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:46.358127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297e3fb-9ff9-4ea0-997d-59728af5d74e admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:46.365828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:46.406459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 852/1687] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:46 2022] POST /identity/v3/users => generated 284 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:46.409840 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297e3fb-9ff9-4ea0-997d-59728af5d74e admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:46.432863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297e3fb-9ff9-4ea0-997d-59728af5d74e admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:46.447771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f06d1e-6b6c-49c3-96ab-0899bf9c91f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:46.448866 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f06d1e-6b6c-49c3-96ab-0899bf9c91f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:46.449278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f06d1e-6b6c-49c3-96ab-0899bf9c91f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:46.449674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f06d1e-6b6c-49c3-96ab-0899bf9c91f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:46.450557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f06d1e-6b6c-49c3-96ab-0899bf9c91f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:46.452560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f06d1e-6b6c-49c3-96ab-0899bf9c91f2 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:46.458242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3688667-9e25-4b5b-b98c-96eba032512e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:46.459283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3688667-9e25-4b5b-b98c-96eba032512e service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:46.474024 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 853/1688] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:49:46.478660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f06d1e-6b6c-49c3-96ab-0899bf9c91f2 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:46.483588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 836/1689] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:46.490507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f06d1e-6b6c-49c3-96ab-0899bf9c91f2 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:46.498173 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4827325-e2e7-412b-98eb-7b379b1d76ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:46.499672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4827325-e2e7-412b-98eb-7b379b1d76ab admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:46.499953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4827325-e2e7-412b-98eb-7b379b1d76ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:46.500321 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4827325-e2e7-412b-98eb-7b379b1d76ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:46.501149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4827325-e2e7-412b-98eb-7b379b1d76ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:46.503388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4827325-e2e7-412b-98eb-7b379b1d76ab admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:46.518997 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 854/1690] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:46.523134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3688667-9e25-4b5b-b98c-96eba032512e service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:46.538636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3688667-9e25-4b5b-b98c-96eba032512e service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:46.545426 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c702d4c-eeea-432b-8f06-742a32ff0459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:46.546907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c702d4c-eeea-432b-8f06-742a32ff0459 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:46.547024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c702d4c-eeea-432b-8f06-742a32ff0459 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:46.547523 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c702d4c-eeea-432b-8f06-742a32ff0459 admin admin] PATH_INFO: `/v3/projects/ce90efef945e4e299262f44cb508f051/users/d2991d150b1f4c95a66e2edf261c797d/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:46.578776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c702d4c-eeea-432b-8f06-742a32ff0459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce90efef945e4e299262f44cb508f051, user_id=d2991d150b1f4c95a66e2edf261c797d, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:46.582027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c702d4c-eeea-432b-8f06-742a32ff0459 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:46.624046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 837/1691] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:46 2022] PUT /identity/v3/projects/ce90efef945e4e299262f44cb508f051/users/d2991d150b1f4c95a66e2edf261c797d/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:49:46.635411 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5528b6-e5a6-481d-9876-17efabb8e671 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:46.635990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5528b6-e5a6-481d-9876-17efabb8e671 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:46.636357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5528b6-e5a6-481d-9876-17efabb8e671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:46.740759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-fb5528b6-e5a6-481d-9876-17efabb8e671 None None] MFA Rules not processed for user `d2991d150b1f4c95a66e2edf261c797d`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:46.745527 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-fb5528b6-e5a6-481d-9876-17efabb8e671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:46.758973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:46.990406 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 855/1692] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:46.994848 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c702d4c-eeea-432b-8f06-742a32ff0459 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:47.095763 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c702d4c-eeea-432b-8f06-742a32ff0459 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:47.106030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cda667-01f6-4e46-8669-11656d549426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:47.107001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cda667-01f6-4e46-8669-11656d549426 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:47.107410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cda667-01f6-4e46-8669-11656d549426 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:47.107799 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cda667-01f6-4e46-8669-11656d549426 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:47.108910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cda667-01f6-4e46-8669-11656d549426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:47.111840 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cda667-01f6-4e46-8669-11656d549426 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:47.166845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 838/1693] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:46 2022] POST /identity/v3/projects => generated 367 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:47.174142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5528b6-e5a6-481d-9876-17efabb8e671 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:47.221732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5528b6-e5a6-481d-9876-17efabb8e671 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:47.375265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445f592-6f8e-4572-a9fc-617506d6a7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:47.375995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f592-6f8e-4572-a9fc-617506d6a7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:47.376432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f592-6f8e-4572-a9fc-617506d6a7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:47.376729 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f592-6f8e-4572-a9fc-617506d6a7e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:47.377426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445f592-6f8e-4572-a9fc-617506d6a7e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:47.379398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445f592-6f8e-4572-a9fc-617506d6a7e4 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:47.411913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cda667-01f6-4e46-8669-11656d549426 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:47.414876 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a5cda667-01f6-4e46-8669-11656d549426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:47.433233 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 856/1694] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:47 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:47.436789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445f592-6f8e-4572-a9fc-617506d6a7e4 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:47.440773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cda667-01f6-4e46-8669-11656d549426 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:47.459207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:47.463251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:47.464443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:47.465612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] PATH_INFO: `/v3/projects/a2a9ec729f214ddca015f734732db211` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:47.469494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445f592-6f8e-4572-a9fc-617506d6a7e4 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:47.470492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a9ec729f214ddca015f734732db211)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:47.474282 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:47.489102 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b8c06-778e-4ee7-9013-a351afc80020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:47.489859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8c06-778e-4ee7-9013-a351afc80020 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:47.491882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8c06-778e-4ee7-9013-a351afc80020 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:47.492199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8c06-778e-4ee7-9013-a351afc80020 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:47.495545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b8c06-778e-4ee7-9013-a351afc80020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:47.502452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b8c06-778e-4ee7-9013-a351afc80020 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:47.544902 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 857/1695] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:47.555059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b8c06-778e-4ee7-9013-a351afc80020 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:47.587018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b8c06-778e-4ee7-9013-a351afc80020 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:47.609446 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437dddf9-e82e-4b1d-99d0-bf4c606824f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:47.610855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dddf9-e82e-4b1d-99d0-bf4c606824f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:47.611138 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dddf9-e82e-4b1d-99d0-bf4c606824f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:47.613551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dddf9-e82e-4b1d-99d0-bf4c606824f7 admin admin] PATH_INFO: `/v3/projects/634f9282ea7045ba90523f73f26ed6be/users/abf96c53640b4497bcaad5b19da20e6d/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:47.643719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a9ec729f214ddca015f734732db211', 'request_id': 'req-94679f4f-497f-42d8-86d3-570ab41bbe13'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:47.664640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437dddf9-e82e-4b1d-99d0-bf4c606824f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634f9282ea7045ba90523f73f26ed6be, user_id=abf96c53640b4497bcaad5b19da20e6d, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:47.665709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a9ec729f214ddca015f734732db211', 'request_id': 'req-94679f4f-497f-42d8-86d3-570ab41bbe13'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:47.674341 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437dddf9-e82e-4b1d-99d0-bf4c606824f7 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:47.689433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a9ec729f214ddca015f734732db211', 'request_id': 'req-94679f4f-497f-42d8-86d3-570ab41bbe13'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:47.712082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 858/1696] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:47 2022] PUT /identity/v3/projects/634f9282ea7045ba90523f73f26ed6be/users/abf96c53640b4497bcaad5b19da20e6d/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:47.713274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437dddf9-e82e-4b1d-99d0-bf4c606824f7 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:47.720689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] The token cache is being invalidate because project a2a9ec729f214ddca015f734732db211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:49:47.721157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:47.722189 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:47.729194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 839/1697] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:49:47 2022] DELETE /identity/v3/projects/a2a9ec729f214ddca015f734732db211 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:47.731623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:47.734471 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:47.751589 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:47.831198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437dddf9-e82e-4b1d-99d0-bf4c606824f7 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:47.846393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d37940-39a4-422e-bc04-05a643f1e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:47.846393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d37940-39a4-422e-bc04-05a643f1e4cf admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:47.846393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d37940-39a4-422e-bc04-05a643f1e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:47.846393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d37940-39a4-422e-bc04-05a643f1e4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:47.846830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d37940-39a4-422e-bc04-05a643f1e4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:47.848172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d37940-39a4-422e-bc04-05a643f1e4cf admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:47.852495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:47.865421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 859/1698] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:47.870121 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d37940-39a4-422e-bc04-05a643f1e4cf admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:47.872711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-72d37940-39a4-422e-bc04-05a643f1e4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:47.891720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d37940-39a4-422e-bc04-05a643f1e4cf admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:47.897279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd80ec-d1b3-43d9-915e-06f30634babc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:47.899006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd80ec-d1b3-43d9-915e-06f30634babc admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:47.899292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd80ec-d1b3-43d9-915e-06f30634babc admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:47.899709 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd80ec-d1b3-43d9-915e-06f30634babc admin admin] PATH_INFO: `/v3/projects/634f9282ea7045ba90523f73f26ed6be/users/abf96c53640b4497bcaad5b19da20e6d/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:47.901569 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94679f4f-497f-42d8-86d3-570ab41bbe13 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:47.901988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd80ec-d1b3-43d9-915e-06f30634babc admin admin] RBAC: Authorizing `identity:create_grant(project_id=634f9282ea7045ba90523f73f26ed6be, user_id=abf96c53640b4497bcaad5b19da20e6d, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:47.905141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd80ec-d1b3-43d9-915e-06f30634babc admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:47.910014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7a89f-aba6-4d2c-9b8f-8e10873023fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:47.911686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7a89f-aba6-4d2c-9b8f-8e10873023fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:47.912255 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7a89f-aba6-4d2c-9b8f-8e10873023fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:47.912561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7a89f-aba6-4d2c-9b8f-8e10873023fc admin admin] PATH_INFO: `/v3/users/c3546797c9574a9c87e2e7f86ee0d665` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:47.914263 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7a89f-aba6-4d2c-9b8f-8e10873023fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3546797c9574a9c87e2e7f86ee0d665)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:47.917999 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7a89f-aba6-4d2c-9b8f-8e10873023fc admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:47.927249 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 860/1699] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:47 2022] PUT /identity/v3/projects/634f9282ea7045ba90523f73f26ed6be/users/abf96c53640b4497bcaad5b19da20e6d/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:47.937936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e4fef-f51b-4f24-ba4e-702876336c3c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:47.938240 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e4fef-f51b-4f24-ba4e-702876336c3c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:47.938525 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e4fef-f51b-4f24-ba4e-702876336c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:47.995409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-576e4fef-f51b-4f24-ba4e-702876336c3c None None] MFA Rules not processed for user `abf96c53640b4497bcaad5b19da20e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:47.998042 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-576e4fef-f51b-4f24-ba4e-702876336c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:48.060477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-dfc7a89f-aba6-4d2c-9b8f-8e10873023fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3546797c9574a9c87e2e7f86ee0d665'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:48.073502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-dfc7a89f-aba6-4d2c-9b8f-8e10873023fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3546797c9574a9c87e2e7f86ee0d665'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:48.074394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-dfc7a89f-aba6-4d2c-9b8f-8e10873023fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3546797c9574a9c87e2e7f86ee0d665'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:48.076267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-dfc7a89f-aba6-4d2c-9b8f-8e10873023fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3546797c9574a9c87e2e7f86ee0d665'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:48.117158 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-dfc7a89f-aba6-4d2c-9b8f-8e10873023fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3546797c9574a9c87e2e7f86ee0d665'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:48.229914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 840/1700] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:49:47 2022] DELETE /identity/v3/users/c3546797c9574a9c87e2e7f86ee0d665 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:48.263716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 861/1701] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:48.279197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7a89f-aba6-4d2c-9b8f-8e10873023fc admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:48.280933 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-dfc7a89f-aba6-4d2c-9b8f-8e10873023fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:48.454142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7a89f-aba6-4d2c-9b8f-8e10873023fc admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:48.471231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefd77c-9ab2-444c-85c8-0c26f19421b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:48.471908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefd77c-9ab2-444c-85c8-0c26f19421b5 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:48.472457 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefd77c-9ab2-444c-85c8-0c26f19421b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:48.472734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefd77c-9ab2-444c-85c8-0c26f19421b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:48.507731 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b086d8-dff4-4568-a5fa-d254ff72fa24 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:48.508337 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b086d8-dff4-4568-a5fa-d254ff72fa24 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:48.508337 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b086d8-dff4-4568-a5fa-d254ff72fa24 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:48.509947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 862/1702] 10.222.0.26 () {54 vars in 921 bytes} [Mon Jul 11 15:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:48.542082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec149d9-be87-4782-a6e4-d09f1a76d711 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:48.542426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec149d9-be87-4782-a6e4-d09f1a76d711 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:48.542638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec149d9-be87-4782-a6e4-d09f1a76d711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:48.555886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:48.607590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-cec149d9-be87-4782-a6e4-d09f1a76d711 None None] MFA Rules not processed for user `dbb5484ecb194023aa8415cb8b52ca5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:48.610713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-cec149d9-be87-4782-a6e4-d09f1a76d711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:48.627870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefd77c-9ab2-444c-85c8-0c26f19421b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:48.635252 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefd77c-9ab2-444c-85c8-0c26f19421b5 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:48.693463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 841/1703] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:48.822740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefd77c-9ab2-444c-85c8-0c26f19421b5 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:48.824301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-daefd77c-9ab2-444c-85c8-0c26f19421b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:48.873010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 863/1704] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Jul 11 15:49:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 11 15:49:48.891915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec149d9-be87-4782-a6e4-d09f1a76d711 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:48.917649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec149d9-be87-4782-a6e4-d09f1a76d711 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:48.941532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59be96-c63a-4fd0-a5bd-df6eb9d85975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:48.942467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59be96-c63a-4fd0-a5bd-df6eb9d85975 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:48.942827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59be96-c63a-4fd0-a5bd-df6eb9d85975 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:48.943178 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59be96-c63a-4fd0-a5bd-df6eb9d85975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:48.949601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7b59be96-c63a-4fd0-a5bd-df6eb9d85975 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:49.146664 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefd77c-9ab2-444c-85c8-0c26f19421b5 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:49.152688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59be96-c63a-4fd0-a5bd-df6eb9d85975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:49.157383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59be96-c63a-4fd0-a5bd-df6eb9d85975 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:49.159746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e766bda-ee50-414e-a3ea-54cd2735029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:49.162405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e766bda-ee50-414e-a3ea-54cd2735029d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:49.162529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e766bda-ee50-414e-a3ea-54cd2735029d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:49.168033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e766bda-ee50-414e-a3ea-54cd2735029d admin admin] PATH_INFO: `/v3/users/0cb58263f8d64508852375306d31ba91` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:49.170235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e766bda-ee50-414e-a3ea-54cd2735029d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb58263f8d64508852375306d31ba91)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:49.173145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e766bda-ee50-414e-a3ea-54cd2735029d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:49.200118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 864/1705] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:49.201861 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e28db-c487-46cd-9984-b16e2dfb077c None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:49.202046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e28db-c487-46cd-9984-b16e2dfb077c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:49.202327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e28db-c487-46cd-9984-b16e2dfb077c None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:49.217201 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 865/1706] 10.222.0.26 () {54 vars in 960 bytes} [Mon Jul 11 15:49:49 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:49.220532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aed46-d903-4cb6-b8de-c3eb08596980 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:49.221126 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aed46-d903-4cb6-b8de-c3eb08596980 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:49.221607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aed46-d903-4cb6-b8de-c3eb08596980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:49.246250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:49.272138 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-ce2aed46-d903-4cb6-b8de-c3eb08596980 None None] MFA Rules not processed for user `dbb5484ecb194023aa8415cb8b52ca5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:49.282307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ce2aed46-d903-4cb6-b8de-c3eb08596980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:49.296090 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 866/1707] 10.222.0.26 () {58 vars in 1057 bytes} [Mon Jul 11 15:49:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:49.297829 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190adf7-b409-4b12-801d-ba594111effd None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:49.298279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190adf7-b409-4b12-801d-ba594111effd None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:49.299061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190adf7-b409-4b12-801d-ba594111effd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:49.336490 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7e766bda-ee50-414e-a3ea-54cd2735029d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb58263f8d64508852375306d31ba91'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:49.355226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-f190adf7-b409-4b12-801d-ba594111effd None None] MFA Rules not processed for user `052b95d2857c4e728a8008d00fc34780`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:49.356494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f190adf7-b409-4b12-801d-ba594111effd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:49.359385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7e766bda-ee50-414e-a3ea-54cd2735029d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb58263f8d64508852375306d31ba91'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:49.360420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7e766bda-ee50-414e-a3ea-54cd2735029d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb58263f8d64508852375306d31ba91'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:49.361545 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7e766bda-ee50-414e-a3ea-54cd2735029d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb58263f8d64508852375306d31ba91'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:49.380039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7e766bda-ee50-414e-a3ea-54cd2735029d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb58263f8d64508852375306d31ba91'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:49.418073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 842/1708] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:49:48 2022] DELETE /identity/v3/users/0cb58263f8d64508852375306d31ba91 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:49.421091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e766bda-ee50-414e-a3ea-54cd2735029d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:49.422890 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7e766bda-ee50-414e-a3ea-54cd2735029d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:49.505588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 867/1709] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:49.506953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ceceb-b1a0-4c0d-85fc-03c4cd6eff92 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:49.507242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ceceb-b1a0-4c0d-85fc-03c4cd6eff92 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:49.507523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ceceb-b1a0-4c0d-85fc-03c4cd6eff92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:49.557199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-140ceceb-b1a0-4c0d-85fc-03c4cd6eff92 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:49.562573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-140ceceb-b1a0-4c0d-85fc-03c4cd6eff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:49.642210 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:49.727687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e766bda-ee50-414e-a3ea-54cd2735029d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:49.747125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0dc60-b51f-4599-b932-6174347d93c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:49.748751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0dc60-b51f-4599-b932-6174347d93c4 service placement] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:49.749307 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0dc60-b51f-4599-b932-6174347d93c4 service placement] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:49.749484 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0dc60-b51f-4599-b932-6174347d93c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:49.760127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3af0dc60-b51f-4599-b932-6174347d93c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:49.783765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 868/1710] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:49.787612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ceceb-b1a0-4c0d-85fc-03c4cd6eff92 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:49.790462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-140ceceb-b1a0-4c0d-85fc-03c4cd6eff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:49.791905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0dc60-b51f-4599-b932-6174347d93c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:49.793977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0dc60-b51f-4599-b932-6174347d93c4 service placement] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:49.813443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 843/1711] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:49.835136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0dc60-b51f-4599-b932-6174347d93c4 service placement] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:49.838242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3af0dc60-b51f-4599-b932-6174347d93c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:50.038217 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ceceb-b1a0-4c0d-85fc-03c4cd6eff92 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:50.059117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce944e-8e0b-41d7-bf2d-bc2a5538b743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:50.059437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0dc60-b51f-4599-b932-6174347d93c4 service placement] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:50.060123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce944e-8e0b-41d7-bf2d-bc2a5538b743 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:50.060631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce944e-8e0b-41d7-bf2d-bc2a5538b743 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:50.061047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce944e-8e0b-41d7-bf2d-bc2a5538b743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:50.068993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc9054-b789-41c6-86cc-5f13242268b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:50.071818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc9054-b789-41c6-86cc-5f13242268b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:50.072213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc9054-b789-41c6-86cc-5f13242268b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:50.072613 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc9054-b789-41c6-86cc-5f13242268b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:50.094210 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:50.104738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc9054-b789-41c6-86cc-5f13242268b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:50.110281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc9054-b789-41c6-86cc-5f13242268b7 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:50.137177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 844/1712] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:50.154709 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce944e-8e0b-41d7-bf2d-bc2a5538b743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:50.157894 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce944e-8e0b-41d7-bf2d-bc2a5538b743 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:50.174088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 869/1713] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:51.098008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc9054-b789-41c6-86cc-5f13242268b7 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:51.100234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-89cc9054-b789-41c6-86cc-5f13242268b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:51.120080 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc9054-b789-41c6-86cc-5f13242268b7 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:51.139199 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3adec-c62a-4833-b1e1-5a19baefdf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:51.140371 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3adec-c62a-4833-b1e1-5a19baefdf84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:51.140760 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3adec-c62a-4833-b1e1-5a19baefdf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:51.141074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3adec-c62a-4833-b1e1-5a19baefdf84 admin admin] PATH_INFO: `/v3/projects/e978e6f3fd7341c59d3b353a82310af4` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:51.143827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3adec-c62a-4833-b1e1-5a19baefdf84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e978e6f3fd7341c59d3b353a82310af4)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:51.145936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3adec-c62a-4833-b1e1-5a19baefdf84 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:51.193289 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce944e-8e0b-41d7-bf2d-bc2a5538b743 service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:51.195583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f1ce944e-8e0b-41d7-bf2d-bc2a5538b743 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:51.220876 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce944e-8e0b-41d7-bf2d-bc2a5538b743 service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:51.235608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b50ea-71c5-401c-a810-ccc065a7112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:51.238530 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b50ea-71c5-401c-a810-ccc065a7112a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:51.239096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b50ea-71c5-401c-a810-ccc065a7112a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:51.240391 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b50ea-71c5-401c-a810-ccc065a7112a admin admin] PATH_INFO: `/v3/projects/83cc4ffd462346bca1d62ba43dfd980e` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:51.251162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b50ea-71c5-401c-a810-ccc065a7112a admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cc4ffd462346bca1d62ba43dfd980e)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:51.259575 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b50ea-71c5-401c-a810-ccc065a7112a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:51.296854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7df3adec-c62a-4833-b1e1-5a19baefdf84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e978e6f3fd7341c59d3b353a82310af4', 'request_id': 'req-7df3adec-c62a-4833-b1e1-5a19baefdf84'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:51.317295 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7df3adec-c62a-4833-b1e1-5a19baefdf84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e978e6f3fd7341c59d3b353a82310af4', 'request_id': 'req-7df3adec-c62a-4833-b1e1-5a19baefdf84'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:51.341612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7df3adec-c62a-4833-b1e1-5a19baefdf84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e978e6f3fd7341c59d3b353a82310af4', 'request_id': 'req-7df3adec-c62a-4833-b1e1-5a19baefdf84'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:51.391622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7df3adec-c62a-4833-b1e1-5a19baefdf84 admin admin] The token cache is being invalidate because project e978e6f3fd7341c59d3b353a82310af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:49:51.394319 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7df3adec-c62a-4833-b1e1-5a19baefdf84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:51.396056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7df3adec-c62a-4833-b1e1-5a19baefdf84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:51.411529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 845/1714] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:49:51 2022] DELETE /identity/v3/projects/e978e6f3fd7341c59d3b353a82310af4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:51.413598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ca49d-74f7-440a-8baf-7161f84e0b78 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:51.413894 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ca49d-74f7-440a-8baf-7161f84e0b78 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:51.414177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ca49d-74f7-440a-8baf-7161f84e0b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:51.451182 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6f0b50ea-71c5-401c-a810-ccc065a7112a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cc4ffd462346bca1d62ba43dfd980e', 'request_id': 'req-6f0b50ea-71c5-401c-a810-ccc065a7112a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:51.460552 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6f0b50ea-71c5-401c-a810-ccc065a7112a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cc4ffd462346bca1d62ba43dfd980e', 'request_id': 'req-6f0b50ea-71c5-401c-a810-ccc065a7112a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:51.489670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6f0b50ea-71c5-401c-a810-ccc065a7112a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cc4ffd462346bca1d62ba43dfd980e', 'request_id': 'req-6f0b50ea-71c5-401c-a810-ccc065a7112a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:51.497743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-440ca49d-74f7-440a-8baf-7161f84e0b78 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:51.502240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-440ca49d-74f7-440a-8baf-7161f84e0b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:51.515072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6f0b50ea-71c5-401c-a810-ccc065a7112a admin admin] The token cache is being invalidate because project 83cc4ffd462346bca1d62ba43dfd980e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:49:51.517928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6f0b50ea-71c5-401c-a810-ccc065a7112a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:51.518939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6f0b50ea-71c5-401c-a810-ccc065a7112a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:51.523804 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 870/1715] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:49:51 2022] DELETE /identity/v3/projects/83cc4ffd462346bca1d62ba43dfd980e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:51.525575 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a9ca-3cef-450e-b188-b3867f28228c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:51.525933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a9ca-3cef-450e-b188-b3867f28228c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:51.526216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a9ca-3cef-450e-b188-b3867f28228c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:51.614250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3107a9ca-3cef-450e-b188-b3867f28228c None None] MFA Rules not processed for user `c0e395655fb14e3b92ed88eb3ea231db`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:51.615585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3107a9ca-3cef-450e-b188-b3867f28228c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:51.642642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 846/1716] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:49:51.644598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900fec4-5737-46ed-96c8-07325ba045a5 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:51.644944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900fec4-5737-46ed-96c8-07325ba045a5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:51.645227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900fec4-5737-46ed-96c8-07325ba045a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:51.665588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:51.679070 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-5900fec4-5737-46ed-96c8-07325ba045a5 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:51.681181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5900fec4-5737-46ed-96c8-07325ba045a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:51.697779 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 847/1717] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:51.705852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f013c0b-f601-42c3-87c8-a3f4c988e96c None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:51.706246 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f013c0b-f601-42c3-87c8-a3f4c988e96c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:51.706620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f013c0b-f601-42c3-87c8-a3f4c988e96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:51.739005 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-6f013c0b-f601-42c3-87c8-a3f4c988e96c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:51.740610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6f013c0b-f601-42c3-87c8-a3f4c988e96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:51.753222 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 848/1718] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:51.758852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d40f4d-c1f4-475b-af58-a2e49c734dc5 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:51.759382 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 871/1719] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:51.769466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a9ca-3cef-450e-b188-b3867f28228c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:51.770969 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d40f4d-c1f4-475b-af58-a2e49c734dc5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:51.771904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d40f4d-c1f4-475b-af58-a2e49c734dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:51.796537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a9ca-3cef-450e-b188-b3867f28228c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:51.806553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f22053-0f5a-4211-9363-ec5c933b1ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:51.808818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f22053-0f5a-4211-9363-ec5c933b1ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:51.809307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f22053-0f5a-4211-9363-ec5c933b1ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:51.810085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f22053-0f5a-4211-9363-ec5c933b1ce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:51.811053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f22053-0f5a-4211-9363-ec5c933b1ce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:49:51.811610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f22053-0f5a-4211-9363-ec5c933b1ce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:51.814345 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f22053-0f5a-4211-9363-ec5c933b1ce5 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:51.827600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-37d40f4d-c1f4-475b-af58-a2e49c734dc5 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:51.831000 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-37d40f4d-c1f4-475b-af58-a2e49c734dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:51.835471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 872/1720] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:49:51.837685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce68b05-cb32-47ef-89a5-e8d67b44ac43 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:51.837685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce68b05-cb32-47ef-89a5-e8d67b44ac43 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:51.837964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce68b05-cb32-47ef-89a5-e8d67b44ac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:51.857302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 849/1721] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:51.862233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d40f4d-c1f4-475b-af58-a2e49c734dc5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:51.868820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-cce68b05-cb32-47ef-89a5-e8d67b44ac43 None None] MFA Rules not processed for user `c0e395655fb14e3b92ed88eb3ea231db`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:51.870312 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-cce68b05-cb32-47ef-89a5-e8d67b44ac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:51.880487 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d40f4d-c1f4-475b-af58-a2e49c734dc5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:51.888426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 873/1722] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:51.889604 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce68b05-cb32-47ef-89a5-e8d67b44ac43 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:51.907574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fdda8-77c8-4eeb-92a0-cd6ce5a8513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:51.908403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fdda8-77c8-4eeb-92a0-cd6ce5a8513a admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:51.908762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fdda8-77c8-4eeb-92a0-cd6ce5a8513a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:51.909110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fdda8-77c8-4eeb-92a0-cd6ce5a8513a admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:51.914067 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fdda8-77c8-4eeb-92a0-cd6ce5a8513a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:51.919123 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fdda8-77c8-4eeb-92a0-cd6ce5a8513a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:51.930353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce68b05-cb32-47ef-89a5-e8d67b44ac43 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:51.936541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0378d6f-8be7-4930-8d27-c1d6708f6be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:51.939287 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0378d6f-8be7-4930-8d27-c1d6708f6be0 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:51.939822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0378d6f-8be7-4930-8d27-c1d6708f6be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:51.940259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0378d6f-8be7-4930-8d27-c1d6708f6be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:51.941224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0378d6f-8be7-4930-8d27-c1d6708f6be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:49:51.941888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0378d6f-8be7-4930-8d27-c1d6708f6be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:51.943837 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0378d6f-8be7-4930-8d27-c1d6708f6be0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:51.968274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 874/1723] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:49:51.969169 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0378d6f-8be7-4930-8d27-c1d6708f6be0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:51.970226 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 850/1724] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:51 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:51.972955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fdda8-77c8-4eeb-92a0-cd6ce5a8513a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:51.979284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e0378d6f-8be7-4930-8d27-c1d6708f6be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:51.987750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:52.119206 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fdda8-77c8-4eeb-92a0-cd6ce5a8513a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:52.133084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0378d6f-8be7-4930-8d27-c1d6708f6be0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:52.135101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4693a-08af-4b50-b44b-f11ffeae68c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:52.135807 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4693a-08af-4b50-b44b-f11ffeae68c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:52.137003 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4693a-08af-4b50-b44b-f11ffeae68c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:52.137290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4693a-08af-4b50-b44b-f11ffeae68c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:52.139186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4693a-08af-4b50-b44b-f11ffeae68c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:52.143872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4693a-08af-4b50-b44b-f11ffeae68c2 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:52.222524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 851/1725] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:51 2022] POST /identity/v3/projects => generated 371 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:52.222524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4693a-08af-4b50-b44b-f11ffeae68c2 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:52.295752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64b07b-dfdd-4a8e-869e-d0c8e554380e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:52.298784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64b07b-dfdd-4a8e-869e-d0c8e554380e service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:52.299029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64b07b-dfdd-4a8e-869e-d0c8e554380e service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:52.299306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64b07b-dfdd-4a8e-869e-d0c8e554380e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:52.452157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4693a-08af-4b50-b44b-f11ffeae68c2 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:52.462717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1f41c-b373-49ee-bbc0-d041daa112d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:52.463415 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1f41c-b373-49ee-bbc0-d041daa112d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:52.463698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1f41c-b373-49ee-bbc0-d041daa112d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:52.463974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1f41c-b373-49ee-bbc0-d041daa112d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:52.468038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1f41c-b373-49ee-bbc0-d041daa112d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:52.470405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64b07b-dfdd-4a8e-869e-d0c8e554380e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:52.472002 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1f41c-b373-49ee-bbc0-d041daa112d9 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:52.472488 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64b07b-dfdd-4a8e-869e-d0c8e554380e service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:52.485516 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 875/1726] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:52.486960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333beeed-f28b-451c-81ae-aebd629f7ee2 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:52.487531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333beeed-f28b-451c-81ae-aebd629f7ee2 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:52.488020 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333beeed-f28b-451c-81ae-aebd629f7ee2 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:52.496883 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 876/1727] 10.222.0.26 () {54 vars in 921 bytes} [Mon Jul 11 15:49:52 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:52.498059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333beeed-f28b-451c-81ae-aebd629f7ee2 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:52.511079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 852/1728] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:52 2022] POST /identity/v3/users => generated 287 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:52.513670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1f41c-b373-49ee-bbc0-d041daa112d9 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:52.515879 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333beeed-f28b-451c-81ae-aebd629f7ee2 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:52.517651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-51d1f41c-b373-49ee-bbc0-d041daa112d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:52.520966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11901406-88da-494a-a40f-8869bd131451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:52.521764 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11901406-88da-494a-a40f-8869bd131451 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:52.522152 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11901406-88da-494a-a40f-8869bd131451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:52.522558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11901406-88da-494a-a40f-8869bd131451 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:52.523462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11901406-88da-494a-a40f-8869bd131451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:52.525735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11901406-88da-494a-a40f-8869bd131451 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:52.546666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1f41c-b373-49ee-bbc0-d041daa112d9 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:52.554511 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 877/1729] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:52 2022] POST /identity/v3/users => generated 286 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:52.561449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8512e3c-eca4-47c4-8c07-d309edd31443 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:52.561931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8512e3c-eca4-47c4-8c07-d309edd31443 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:52.562394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8512e3c-eca4-47c4-8c07-d309edd31443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:52.566027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2859029-0e25-4480-b8a2-c3e7b61135e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:52.566954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2859029-0e25-4480-b8a2-c3e7b61135e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:52.567232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2859029-0e25-4480-b8a2-c3e7b61135e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:52.567500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2859029-0e25-4480-b8a2-c3e7b61135e3 admin admin] PATH_INFO: `/v3/users/4046223c20754d68af45ce96044fb252` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:52.569717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2859029-0e25-4480-b8a2-c3e7b61135e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4046223c20754d68af45ce96044fb252)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:52.571710 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2859029-0e25-4480-b8a2-c3e7b61135e3 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:52.624811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-b8512e3c-eca4-47c4-8c07-d309edd31443 None None] MFA Rules not processed for user `9d44f1f434534cc0b373943d48d672df`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:52.626890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b8512e3c-eca4-47c4-8c07-d309edd31443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:52.645057 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:52.655525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:52.677246 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b2859029-0e25-4480-b8a2-c3e7b61135e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4046223c20754d68af45ce96044fb252'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:52.697593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b2859029-0e25-4480-b8a2-c3e7b61135e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4046223c20754d68af45ce96044fb252'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:52.699713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b2859029-0e25-4480-b8a2-c3e7b61135e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4046223c20754d68af45ce96044fb252'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:52.703097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b2859029-0e25-4480-b8a2-c3e7b61135e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4046223c20754d68af45ce96044fb252'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:52.722984 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b2859029-0e25-4480-b8a2-c3e7b61135e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4046223c20754d68af45ce96044fb252'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:52.810261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 878/1730] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:52.814200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b914f-0431-45d4-bff6-0a32ec511c01 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:52.819469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 853/1731] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:49:52 2022] DELETE /identity/v3/users/4046223c20754d68af45ce96044fb252 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:52.822550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2859029-0e25-4480-b8a2-c3e7b61135e3 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:52.826998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b2859029-0e25-4480-b8a2-c3e7b61135e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:52.829772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b914f-0431-45d4-bff6-0a32ec511c01 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:52.830005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b914f-0431-45d4-bff6-0a32ec511c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:52.880967 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-252b914f-0431-45d4-bff6-0a32ec511c01 None None] MFA Rules not processed for user `dbb5484ecb194023aa8415cb8b52ca5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:52.889187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-252b914f-0431-45d4-bff6-0a32ec511c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:53.057788 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2859029-0e25-4480-b8a2-c3e7b61135e3 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:53.082723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a2dc6-6afe-4b20-8c09-0f40c0b8982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:53.084844 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a2dc6-6afe-4b20-8c09-0f40c0b8982c admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:53.088544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a2dc6-6afe-4b20-8c09-0f40c0b8982c admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:53.088964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a2dc6-6afe-4b20-8c09-0f40c0b8982c admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:53.094888 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a2dc6-6afe-4b20-8c09-0f40c0b8982c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:53.099618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a2dc6-6afe-4b20-8c09-0f40c0b8982c admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:53.113287 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 879/1732] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Jul 11 15:49:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:53.118316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b914f-0431-45d4-bff6-0a32ec511c01 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:53.120324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-252b914f-0431-45d4-bff6-0a32ec511c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:53.137558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 854/1733] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:53.140525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1ffbb-69de-4726-80ef-63537749e009 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:53.144472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1ffbb-69de-4726-80ef-63537749e009 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:53.145006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1ffbb-69de-4726-80ef-63537749e009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:53.159572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b914f-0431-45d4-bff6-0a32ec511c01 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:53.176585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a41e49-e9da-44fb-9cb1-032c8e40d39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:53.177415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a41e49-e9da-44fb-9cb1-032c8e40d39b admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:53.177807 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a41e49-e9da-44fb-9cb1-032c8e40d39b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:53.178191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a41e49-e9da-44fb-9cb1-032c8e40d39b admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:53.180581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a41e49-e9da-44fb-9cb1-032c8e40d39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:53.182408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a41e49-e9da-44fb-9cb1-032c8e40d39b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:53.196187 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-8fc1ffbb-69de-4726-80ef-63537749e009 None None] MFA Rules not processed for user `9d44f1f434534cc0b373943d48d672df`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:53.197628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8fc1ffbb-69de-4726-80ef-63537749e009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:53.216132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 880/1734] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:53.216132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a41e49-e9da-44fb-9cb1-032c8e40d39b admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:53.244629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a41e49-e9da-44fb-9cb1-032c8e40d39b admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:53.262642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719579df-0632-4d22-bfd6-7169d99f76f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:53.263563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719579df-0632-4d22-bfd6-7169d99f76f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:53.266864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719579df-0632-4d22-bfd6-7169d99f76f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:53.267502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719579df-0632-4d22-bfd6-7169d99f76f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:53.268298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719579df-0632-4d22-bfd6-7169d99f76f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:53.273827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719579df-0632-4d22-bfd6-7169d99f76f1 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:53.314092 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 881/1735] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:53.314627 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719579df-0632-4d22-bfd6-7169d99f76f1 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:53.317631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-719579df-0632-4d22-bfd6-7169d99f76f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:53.355194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 855/1736] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:53.355194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1ffbb-69de-4726-80ef-63537749e009 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:53.355450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719579df-0632-4d22-bfd6-7169d99f76f1 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:53.366030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0cb6d-0dbc-4fc4-93b2-98c6458933ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:53.366847 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0cb6d-0dbc-4fc4-93b2-98c6458933ab service placement] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:53.367424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0cb6d-0dbc-4fc4-93b2-98c6458933ab service placement] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:53.369481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0cb6d-0dbc-4fc4-93b2-98c6458933ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:53.392747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1ffbb-69de-4726-80ef-63537749e009 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:53.400907 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0cb6d-0dbc-4fc4-93b2-98c6458933ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:53.403292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0cb6d-0dbc-4fc4-93b2-98c6458933ab service placement] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:53.409075 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911fb12-b1c3-49be-807b-8e0388c6f8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:53.409926 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911fb12-b1c3-49be-807b-8e0388c6f8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:53.410353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911fb12-b1c3-49be-807b-8e0388c6f8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:53.410734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911fb12-b1c3-49be-807b-8e0388c6f8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:53.411756 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911fb12-b1c3-49be-807b-8e0388c6f8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:53.413543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911fb12-b1c3-49be-807b-8e0388c6f8c0 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:53.444271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 882/1737] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:53.445293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0cb6d-0dbc-4fc4-93b2-98c6458933ab service placement] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:53.447105 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 856/1738] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:53.448511 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911fb12-b1c3-49be-807b-8e0388c6f8c0 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:53.458983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e911fb12-b1c3-49be-807b-8e0388c6f8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:53.472558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0cb6d-0dbc-4fc4-93b2-98c6458933ab service placement] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:53.482088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f2f34-eb25-498f-a9c5-592aba29ea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:53.484268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f2f34-eb25-498f-a9c5-592aba29ea86 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:53.485586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f2f34-eb25-498f-a9c5-592aba29ea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:53.486764 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f2f34-eb25-498f-a9c5-592aba29ea86 admin admin] PATH_INFO: `/v3/projects/5b1b44429aba4581b9391acf6ddd569c/users/43835ac1f8c441fabee97b778c6da1f3/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:53.510750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f2f34-eb25-498f-a9c5-592aba29ea86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1b44429aba4581b9391acf6ddd569c, user_id=43835ac1f8c441fabee97b778c6da1f3, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:53.513885 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f2f34-eb25-498f-a9c5-592aba29ea86 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:53.541739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 883/1739] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:53 2022] PUT /identity/v3/projects/5b1b44429aba4581b9391acf6ddd569c/users/43835ac1f8c441fabee97b778c6da1f3/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:53.554796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f2f34-eb25-498f-a9c5-592aba29ea86 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:53.576876 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:53.712821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911fb12-b1c3-49be-807b-8e0388c6f8c0 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:53.773800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:53.812638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f2f34-eb25-498f-a9c5-592aba29ea86 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:53.817815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8264e00-8e8a-476f-8563-d0b60232c96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:53.818843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8264e00-8e8a-476f-8563-d0b60232c96b admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:53.819123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8264e00-8e8a-476f-8563-d0b60232c96b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:53.819397 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8264e00-8e8a-476f-8563-d0b60232c96b admin admin] PATH_INFO: `/v3/projects/7e8f045dbf4e4f8a94db9e14af8b4812/users/75bbe584451748bd8e2db06b1dab7a52/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:53.843508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8264e00-8e8a-476f-8563-d0b60232c96b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8f045dbf4e4f8a94db9e14af8b4812, user_id=75bbe584451748bd8e2db06b1dab7a52, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:53.851674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8264e00-8e8a-476f-8563-d0b60232c96b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:53.887064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 884/1740] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:53 2022] PUT /identity/v3/projects/7e8f045dbf4e4f8a94db9e14af8b4812/users/75bbe584451748bd8e2db06b1dab7a52/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:53.889494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63490132-7530-4b5a-b955-5ba0e66820dc None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:53.889958 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63490132-7530-4b5a-b955-5ba0e66820dc None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:53.890380 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63490132-7530-4b5a-b955-5ba0e66820dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:53.914551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5fca9-665a-4989-89b0-91eefa3d9d49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:53.915341 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5fca9-665a-4989-89b0-91eefa3d9d49 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:53.916149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5fca9-665a-4989-89b0-91eefa3d9d49 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:53.916602 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5fca9-665a-4989-89b0-91eefa3d9d49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:53.925828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-63490132-7530-4b5a-b955-5ba0e66820dc None None] MFA Rules not processed for user `43835ac1f8c441fabee97b778c6da1f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:53.927237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-63490132-7530-4b5a-b955-5ba0e66820dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:54.080848 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5fca9-665a-4989-89b0-91eefa3d9d49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:54.082497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5fca9-665a-4989-89b0-91eefa3d9d49 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:54.116728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 857/1741] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:54.117132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 885/1742] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:54.117999 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63490132-7530-4b5a-b955-5ba0e66820dc None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:54.121782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795a5df-48ad-492b-a0bb-4c428dd0bde6 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:54.122254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795a5df-48ad-492b-a0bb-4c428dd0bde6 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:54.122427 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-63490132-7530-4b5a-b955-5ba0e66820dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:54.122821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795a5df-48ad-492b-a0bb-4c428dd0bde6 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:54.126677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 858/1743] 10.222.0.26 () {54 vars in 912 bytes} [Mon Jul 11 15:49:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:54.129313 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a399e53-8037-4211-9be1-9a4e6d2467da None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:54.133534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a399e53-8037-4211-9be1-9a4e6d2467da None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:54.136767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a399e53-8037-4211-9be1-9a4e6d2467da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:54.233327 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-4a399e53-8037-4211-9be1-9a4e6d2467da None None] MFA Rules not processed for user `75bbe584451748bd8e2db06b1dab7a52`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:54.234594 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4a399e53-8037-4211-9be1-9a4e6d2467da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:54.342017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63490132-7530-4b5a-b955-5ba0e66820dc None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:54.360816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:54.361974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:54.362488 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:54.362951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] PATH_INFO: `/v3/projects/fc255e84b25a44f58a5d9ce955ce4bce` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:54.364436 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc255e84b25a44f58a5d9ce955ce4bce)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:54.366818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:54.477317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 859/1744] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:54.478460 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c063f-5e73-4a1a-8b73-11a42fe5a884 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:54.478760 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c063f-5e73-4a1a-8b73-11a42fe5a884 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:54.479020 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c063f-5e73-4a1a-8b73-11a42fe5a884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:54.488316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc255e84b25a44f58a5d9ce955ce4bce', 'request_id': 'req-9e7e5c16-8279-426c-b037-625dae003871'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:54.508207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc255e84b25a44f58a5d9ce955ce4bce', 'request_id': 'req-9e7e5c16-8279-426c-b037-625dae003871'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:54.511498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:54.525267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc255e84b25a44f58a5d9ce955ce4bce', 'request_id': 'req-9e7e5c16-8279-426c-b037-625dae003871'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:54.531461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:54.562817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] The token cache is being invalidate because project fc255e84b25a44f58a5d9ce955ce4bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:49:54.563249 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:54.565455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:54.571513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 886/1745] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:49:54 2022] DELETE /identity/v3/projects/fc255e84b25a44f58a5d9ce955ce4bce => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:54.571513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:54.574134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:54.577339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-545c063f-5e73-4a1a-8b73-11a42fe5a884 None None] MFA Rules not processed for user `44a4d0441d4a423884d7adef45e2641f`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:54.578831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-545c063f-5e73-4a1a-8b73-11a42fe5a884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:54.705918 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 860/1746] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Jul 11 15:49:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:54.705918 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c063f-5e73-4a1a-8b73-11a42fe5a884 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:54.707381 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-545c063f-5e73-4a1a-8b73-11a42fe5a884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:54.708793 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e5c16-8279-426c-b037-625dae003871 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:54.713323 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c44e6c-17fe-49e8-85ca-8b46896684be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:54.714139 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c44e6c-17fe-49e8-85ca-8b46896684be service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:54.714511 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c44e6c-17fe-49e8-85ca-8b46896684be service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:54.721797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c44e6c-17fe-49e8-85ca-8b46896684be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:54.724759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-37c44e6c-17fe-49e8-85ca-8b46896684be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:54.855776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c063f-5e73-4a1a-8b73-11a42fe5a884 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:54.879011 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595276fb-2ab2-4846-9b52-8e5fdd748510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:54.880640 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595276fb-2ab2-4846-9b52-8e5fdd748510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:54.880919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595276fb-2ab2-4846-9b52-8e5fdd748510 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:54.881191 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595276fb-2ab2-4846-9b52-8e5fdd748510 admin admin] PATH_INFO: `/v3/users/d2991d150b1f4c95a66e2edf261c797d` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:54.882919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595276fb-2ab2-4846-9b52-8e5fdd748510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2991d150b1f4c95a66e2edf261c797d)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:54.885090 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595276fb-2ab2-4846-9b52-8e5fdd748510 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:54.892815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c44e6c-17fe-49e8-85ca-8b46896684be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:54.894288 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c44e6c-17fe-49e8-85ca-8b46896684be service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:54.935386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 887/1747] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:54.935386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c44e6c-17fe-49e8-85ca-8b46896684be service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:54.939588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-37c44e6c-17fe-49e8-85ca-8b46896684be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:54.965438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c44e6c-17fe-49e8-85ca-8b46896684be service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:54.982913 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4c56f-e46d-404f-9da6-df712539f6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:54.983806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4c56f-e46d-404f-9da6-df712539f6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:54.984083 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4c56f-e46d-404f-9da6-df712539f6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:54.985373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4c56f-e46d-404f-9da6-df712539f6a6 admin admin] PATH_INFO: `/v3/users/b092f76bf0124a8eb6ed13091bcc287a` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:54.986444 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4c56f-e46d-404f-9da6-df712539f6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b092f76bf0124a8eb6ed13091bcc287a)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:54.988480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4c56f-e46d-404f-9da6-df712539f6a6 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:54.995954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-595276fb-2ab2-4846-9b52-8e5fdd748510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2991d150b1f4c95a66e2edf261c797d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.009850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-595276fb-2ab2-4846-9b52-8e5fdd748510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2991d150b1f4c95a66e2edf261c797d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.011985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-595276fb-2ab2-4846-9b52-8e5fdd748510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2991d150b1f4c95a66e2edf261c797d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.012977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-595276fb-2ab2-4846-9b52-8e5fdd748510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2991d150b1f4c95a66e2edf261c797d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.033022 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-595276fb-2ab2-4846-9b52-8e5fdd748510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2991d150b1f4c95a66e2edf261c797d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.073895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 861/1748] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:49:54 2022] DELETE /identity/v3/users/d2991d150b1f4c95a66e2edf261c797d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:55.073895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595276fb-2ab2-4846-9b52-8e5fdd748510 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:55.074865 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-595276fb-2ab2-4846-9b52-8e5fdd748510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.116458 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-01e4c56f-e46d-404f-9da6-df712539f6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b092f76bf0124a8eb6ed13091bcc287a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.134796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-01e4c56f-e46d-404f-9da6-df712539f6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b092f76bf0124a8eb6ed13091bcc287a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.135945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-01e4c56f-e46d-404f-9da6-df712539f6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b092f76bf0124a8eb6ed13091bcc287a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.138235 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-01e4c56f-e46d-404f-9da6-df712539f6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b092f76bf0124a8eb6ed13091bcc287a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.154652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-01e4c56f-e46d-404f-9da6-df712539f6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b092f76bf0124a8eb6ed13091bcc287a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.159792 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:55.201639 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 888/1749] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:49:54 2022] DELETE /identity/v3/users/b092f76bf0124a8eb6ed13091bcc287a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:55.210888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007fb0e-afdc-4c4d-898e-e35448edf1c9 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.210888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007fb0e-afdc-4c4d-898e-e35448edf1c9 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.210888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007fb0e-afdc-4c4d-898e-e35448edf1c9 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.214383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 889/1750] 10.222.0.26 () {54 vars in 912 bytes} [Mon Jul 11 15:49:55 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:49:55.215326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007fb0e-afdc-4c4d-898e-e35448edf1c9 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:55.220955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8007fb0e-afdc-4c4d-898e-e35448edf1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.254843 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595276fb-2ab2-4846-9b52-8e5fdd748510 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:55.272637 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:55.343577 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73688b5-89dc-44df-b653-7d3c6d4b99c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:55.344405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73688b5-89dc-44df-b653-7d3c6d4b99c5 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.344868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73688b5-89dc-44df-b653-7d3c6d4b99c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.345143 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73688b5-89dc-44df-b653-7d3c6d4b99c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.347927 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-c73688b5-89dc-44df-b653-7d3c6d4b99c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.367269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007fb0e-afdc-4c4d-898e-e35448edf1c9 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:55.367744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73688b5-89dc-44df-b653-7d3c6d4b99c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:55.368704 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73688b5-89dc-44df-b653-7d3c6d4b99c5 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:55.379709 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be90cc-0dc3-42c7-979b-eb83aa09c340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:55.381197 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be90cc-0dc3-42c7-979b-eb83aa09c340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.381556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be90cc-0dc3-42c7-979b-eb83aa09c340 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.382033 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be90cc-0dc3-42c7-979b-eb83aa09c340 admin admin] PATH_INFO: `/v3/users/43835ac1f8c441fabee97b778c6da1f3` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.383524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be90cc-0dc3-42c7-979b-eb83aa09c340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43835ac1f8c441fabee97b778c6da1f3)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:55.385728 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be90cc-0dc3-42c7-979b-eb83aa09c340 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:55.388180 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 862/1751] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:55.389513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399f368-2552-41d0-b26d-330280443f53 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.397449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399f368-2552-41d0-b26d-330280443f53 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.397744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399f368-2552-41d0-b26d-330280443f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.436227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-5399f368-2552-41d0-b26d-330280443f53 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:55.437581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5399f368-2552-41d0-b26d-330280443f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.458538 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 863/1752] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:55.464795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207872c0-037a-4615-8318-58ae2584dc4a None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.465089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207872c0-037a-4615-8318-58ae2584dc4a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.465366 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207872c0-037a-4615-8318-58ae2584dc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.496653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-207872c0-037a-4615-8318-58ae2584dc4a None None] MFA Rules not processed for user `44a4d0441d4a423884d7adef45e2641f`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:55.497886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-207872c0-037a-4615-8318-58ae2584dc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.506058 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 864/1753] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Jul 11 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:55.506901 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207872c0-037a-4615-8318-58ae2584dc4a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:55.509443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-207872c0-037a-4615-8318-58ae2584dc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.509740 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-59be90cc-0dc3-42c7-979b-eb83aa09c340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43835ac1f8c441fabee97b778c6da1f3'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.521085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207872c0-037a-4615-8318-58ae2584dc4a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:55.526346 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-59be90cc-0dc3-42c7-979b-eb83aa09c340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43835ac1f8c441fabee97b778c6da1f3'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.527439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-59be90cc-0dc3-42c7-979b-eb83aa09c340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43835ac1f8c441fabee97b778c6da1f3'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.528980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-59be90cc-0dc3-42c7-979b-eb83aa09c340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43835ac1f8c441fabee97b778c6da1f3'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.531830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d475e-4e9f-48e3-9f22-0d74b11e463c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:55.534067 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d475e-4e9f-48e3-9f22-0d74b11e463c service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.534350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d475e-4e9f-48e3-9f22-0d74b11e463c service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.534624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d475e-4e9f-48e3-9f22-0d74b11e463c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.546698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-59be90cc-0dc3-42c7-979b-eb83aa09c340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43835ac1f8c441fabee97b778c6da1f3'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:55.549372 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-312d475e-4e9f-48e3-9f22-0d74b11e463c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.589142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d475e-4e9f-48e3-9f22-0d74b11e463c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:55.592955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d475e-4e9f-48e3-9f22-0d74b11e463c service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:55.600075 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 890/1754] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:49:55 2022] DELETE /identity/v3/users/43835ac1f8c441fabee97b778c6da1f3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:55.600966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be90cc-0dc3-42c7-979b-eb83aa09c340 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:55.609840 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-59be90cc-0dc3-42c7-979b-eb83aa09c340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.625646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 865/1755] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:55.627019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89c8b1-6bb7-41d5-bc65-d07dfe1373ff None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.627407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89c8b1-6bb7-41d5-bc65-d07dfe1373ff None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.627563 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89c8b1-6bb7-41d5-bc65-d07dfe1373ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.679794 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-4e89c8b1-6bb7-41d5-bc65-d07dfe1373ff None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:55.682976 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4e89c8b1-6bb7-41d5-bc65-d07dfe1373ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.758671 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be90cc-0dc3-42c7-979b-eb83aa09c340 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:55.764942 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b0456-a6de-4387-a9dc-9509130ed4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:55.766033 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0456-a6de-4387-a9dc-9509130ed4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.766466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0456-a6de-4387-a9dc-9509130ed4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.767017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0456-a6de-4387-a9dc-9509130ed4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.769878 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-983b0456-a6de-4387-a9dc-9509130ed4f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.784932 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b0456-a6de-4387-a9dc-9509130ed4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:55.787718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b0456-a6de-4387-a9dc-9509130ed4f5 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:55.799869 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 891/1756] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:55.801612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e46a04-98b1-440e-b637-7066b2b220fc None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.801719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 866/1757] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:55.802194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e46a04-98b1-440e-b637-7066b2b220fc None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.802695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e46a04-98b1-440e-b637-7066b2b220fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.802819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89c8b1-6bb7-41d5-bc65-d07dfe1373ff None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:55.808404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4e89c8b1-6bb7-41d5-bc65-d07dfe1373ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.826441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-33e46a04-98b1-440e-b637-7066b2b220fc None None] MFA Rules not processed for user `052b95d2857c4e728a8008d00fc34780`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:55.828745 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-33e46a04-98b1-440e-b637-7066b2b220fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:55.831920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89c8b1-6bb7-41d5-bc65-d07dfe1373ff None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:55.843203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:55.844321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:55.844758 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:55.845181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51 admin admin] PATH_INFO: `/v3/projects/a5cd266f8e3f4e3bb515805513478eba` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:55.849577 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5cd266f8e3f4e3bb515805513478eba)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:55.885404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:56.027592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:56.039742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5cd266f8e3f4e3bb515805513478eba', 'request_id': 'req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:56.041602 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:56.064075 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5cd266f8e3f4e3bb515805513478eba', 'request_id': 'req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:56.100131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5cd266f8e3f4e3bb515805513478eba', 'request_id': 'req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:56.118186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 892/1758] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:56.120496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e46a04-98b1-440e-b637-7066b2b220fc None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:56.123100 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-33e46a04-98b1-440e-b637-7066b2b220fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:56.127535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51 admin admin] The token cache is being invalidate because project a5cd266f8e3f4e3bb515805513478eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:49:56.127771 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:56.130020 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d4cbcd35-eda2-4f92-a949-f2ab06a5ac51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:56.137596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 867/1759] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:49:55 2022] DELETE /identity/v3/projects/a5cd266f8e3f4e3bb515805513478eba => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:56.141264 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04e21-d7f9-41a3-b6e4-e76ae10d1f5f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:56.141564 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04e21-d7f9-41a3-b6e4-e76ae10d1f5f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:56.141977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04e21-d7f9-41a3-b6e4-e76ae10d1f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:56.175780 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e46a04-98b1-440e-b637-7066b2b220fc None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:56.196968 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-53b04e21-d7f9-41a3-b6e4-e76ae10d1f5f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:56.198911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-53b04e21-d7f9-41a3-b6e4-e76ae10d1f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:56.302425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a446f9-ed88-4c5c-9ce0-729e61e45258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:56.303285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a446f9-ed88-4c5c-9ce0-729e61e45258 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:56.303570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a446f9-ed88-4c5c-9ce0-729e61e45258 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:56.304072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a446f9-ed88-4c5c-9ce0-729e61e45258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:56.307684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-75a446f9-ed88-4c5c-9ce0-729e61e45258 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:56.342097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 868/1760] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:56.350065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7759fc-7fe6-4fd7-b8fc-20b48cc10902 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:56.350333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7759fc-7fe6-4fd7-b8fc-20b48cc10902 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:56.350606 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7759fc-7fe6-4fd7-b8fc-20b48cc10902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:56.386374 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-5e7759fc-7fe6-4fd7-b8fc-20b48cc10902 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:56.387586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5e7759fc-7fe6-4fd7-b8fc-20b48cc10902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:56.408077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 869/1761] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:49:56.412507 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7759fc-7fe6-4fd7-b8fc-20b48cc10902 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:56.416284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a446f9-ed88-4c5c-9ce0-729e61e45258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:56.419846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a446f9-ed88-4c5c-9ce0-729e61e45258 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:56.432272 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7759fc-7fe6-4fd7-b8fc-20b48cc10902 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:56.444223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d7263-b1b1-4772-894d-1798936a3285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:56.447201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d7263-b1b1-4772-894d-1798936a3285 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:56.447942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d7263-b1b1-4772-894d-1798936a3285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:56.448489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d7263-b1b1-4772-894d-1798936a3285 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:56.450749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 893/1762] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:56.451853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d7263-b1b1-4772-894d-1798936a3285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:49:56.452419 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d7263-b1b1-4772-894d-1798936a3285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:56.455140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d7263-b1b1-4772-894d-1798936a3285 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:56.476732 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 870/1763] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:49:56.479772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a446f9-ed88-4c5c-9ce0-729e61e45258 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:56.501265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a446f9-ed88-4c5c-9ce0-729e61e45258 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:56.507339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d8228-a840-4ca1-b248-fd9e58e40624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:56.508457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d8228-a840-4ca1-b248-fd9e58e40624 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:56.508943 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d8228-a840-4ca1-b248-fd9e58e40624 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:56.509414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d8228-a840-4ca1-b248-fd9e58e40624 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:56.510576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d8228-a840-4ca1-b248-fd9e58e40624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:56.513694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d8228-a840-4ca1-b248-fd9e58e40624 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:56.581107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 894/1764] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:56 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:49:56.582558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d7263-b1b1-4772-894d-1798936a3285 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:56.601659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d7263-b1b1-4772-894d-1798936a3285 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:56.638502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d8228-a840-4ca1-b248-fd9e58e40624 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:56.640199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-664d8228-a840-4ca1-b248-fd9e58e40624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:56.796586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88038170-cd19-449c-baf4-5d2a4e773a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:56.801854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88038170-cd19-449c-baf4-5d2a4e773a9c admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:56.802142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88038170-cd19-449c-baf4-5d2a4e773a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:56.802424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88038170-cd19-449c-baf4-5d2a4e773a9c admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:56.803166 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88038170-cd19-449c-baf4-5d2a4e773a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:56.805181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88038170-cd19-449c-baf4-5d2a4e773a9c admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:56.816503 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d8228-a840-4ca1-b248-fd9e58e40624 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:56.858736 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:56.860360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:56.860654 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:56.860931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] PATH_INFO: `/v3/projects/ce90efef945e4e299262f44cb508f051` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:56.872366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce90efef945e4e299262f44cb508f051)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:56.873840 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:56.879033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 871/1765] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:56 2022] POST /identity/v3/users => generated 294 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:56.879033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88038170-cd19-449c-baf4-5d2a4e773a9c admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:56.884529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-88038170-cd19-449c-baf4-5d2a4e773a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:56.937985 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:57.009289 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce90efef945e4e299262f44cb508f051', 'request_id': 'req-f6c8ef79-53fa-4e24-b783-37ddd9f95342'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.017233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:57.034823 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce90efef945e4e299262f44cb508f051', 'request_id': 'req-f6c8ef79-53fa-4e24-b783-37ddd9f95342'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.059242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce90efef945e4e299262f44cb508f051', 'request_id': 'req-f6c8ef79-53fa-4e24-b783-37ddd9f95342'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.088093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88038170-cd19-449c-baf4-5d2a4e773a9c admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:57.091025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] The token cache is being invalidate because project ce90efef945e4e299262f44cb508f051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:49:57.091322 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.092403 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.098550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 895/1766] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:49:56 2022] DELETE /identity/v3/projects/ce90efef945e4e299262f44cb508f051 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:57.099567 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:57.102170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:57.251640 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588ecb1-b45f-4f99-b96a-e9d5fade98af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:57.252340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588ecb1-b45f-4f99-b96a-e9d5fade98af service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:57.252620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588ecb1-b45f-4f99-b96a-e9d5fade98af service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:57.252895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588ecb1-b45f-4f99-b96a-e9d5fade98af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:57.255735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5588ecb1-b45f-4f99-b96a-e9d5fade98af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:57.257692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8ef79-53fa-4e24-b783-37ddd9f95342 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:57.262944 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce31abd-a39d-4ffe-bbb4-8aa10afe0217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:57.263956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce31abd-a39d-4ffe-bbb4-8aa10afe0217 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:57.265055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce31abd-a39d-4ffe-bbb4-8aa10afe0217 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:57.265245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce31abd-a39d-4ffe-bbb4-8aa10afe0217 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:57.266162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce31abd-a39d-4ffe-bbb4-8aa10afe0217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:57.268026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce31abd-a39d-4ffe-bbb4-8aa10afe0217 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:57.300056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 896/1767] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:57.303421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce31abd-a39d-4ffe-bbb4-8aa10afe0217 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:57.308871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5ce31abd-a39d-4ffe-bbb4-8aa10afe0217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:57.420074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588ecb1-b45f-4f99-b96a-e9d5fade98af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:57.421755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588ecb1-b45f-4f99-b96a-e9d5fade98af service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:57.454359 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 872/1768] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:57.456036 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588ecb1-b45f-4f99-b96a-e9d5fade98af service nova] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:57.458349 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce31abd-a39d-4ffe-bbb4-8aa10afe0217 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:57.460039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5588ecb1-b45f-4f99-b96a-e9d5fade98af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:57.465915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd620d04-edb2-48e1-a9a2-a0a42740ec05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:57.467080 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd620d04-edb2-48e1-a9a2-a0a42740ec05 service placement] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:57.467732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd620d04-edb2-48e1-a9a2-a0a42740ec05 service placement] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:57.468180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd620d04-edb2-48e1-a9a2-a0a42740ec05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:57.471412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-dd620d04-edb2-48e1-a9a2-a0a42740ec05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:57.490922 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd620d04-edb2-48e1-a9a2-a0a42740ec05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:57.492911 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd620d04-edb2-48e1-a9a2-a0a42740ec05 service placement] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:57.493622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588ecb1-b45f-4f99-b96a-e9d5fade98af service nova] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:57.504492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:57.505698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:57.507069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:57.508656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] PATH_INFO: `/v3/projects/5b1b44429aba4581b9391acf6ddd569c` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:57.511347 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1b44429aba4581b9391acf6ddd569c)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:57.517669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:57.524250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 897/1769] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:57.531331 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd620d04-edb2-48e1-a9a2-a0a42740ec05 service placement] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:57.536355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-dd620d04-edb2-48e1-a9a2-a0a42740ec05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:57.570374 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd620d04-edb2-48e1-a9a2-a0a42740ec05 service placement] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:57.578469 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56e39a-f33f-4a23-a0b3-c96e6567e7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:57.580786 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56e39a-f33f-4a23-a0b3-c96e6567e7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:57.582536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56e39a-f33f-4a23-a0b3-c96e6567e7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:57.583006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56e39a-f33f-4a23-a0b3-c96e6567e7f8 admin admin] PATH_INFO: `/v3/users/abf96c53640b4497bcaad5b19da20e6d` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:57.586572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56e39a-f33f-4a23-a0b3-c96e6567e7f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf96c53640b4497bcaad5b19da20e6d)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:57.589595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56e39a-f33f-4a23-a0b3-c96e6567e7f8 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:57.633151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1b44429aba4581b9391acf6ddd569c', 'request_id': 'req-d7a44035-ff91-4f15-8080-8dd38db3c5fe'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.643546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:57.646088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1b44429aba4581b9391acf6ddd569c', 'request_id': 'req-d7a44035-ff91-4f15-8080-8dd38db3c5fe'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.660958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1b44429aba4581b9391acf6ddd569c', 'request_id': 'req-d7a44035-ff91-4f15-8080-8dd38db3c5fe'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.697286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ba56e39a-f33f-4a23-a0b3-c96e6567e7f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf96c53640b4497bcaad5b19da20e6d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.698062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] The token cache is being invalidate because project 5b1b44429aba4581b9391acf6ddd569c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:49:57.699302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.702139 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.707491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 873/1770] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:49:57 2022] DELETE /identity/v3/projects/5b1b44429aba4581b9391acf6ddd569c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:57.709833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:57.713969 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:57.715031 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ba56e39a-f33f-4a23-a0b3-c96e6567e7f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf96c53640b4497bcaad5b19da20e6d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.716018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ba56e39a-f33f-4a23-a0b3-c96e6567e7f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf96c53640b4497bcaad5b19da20e6d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.716989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ba56e39a-f33f-4a23-a0b3-c96e6567e7f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf96c53640b4497bcaad5b19da20e6d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.730348 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ba56e39a-f33f-4a23-a0b3-c96e6567e7f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf96c53640b4497bcaad5b19da20e6d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:57.731266 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:57.771980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 898/1771] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:49:57 2022] DELETE /identity/v3/users/abf96c53640b4497bcaad5b19da20e6d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:57.774183 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56e39a-f33f-4a23-a0b3-c96e6567e7f8 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:57.801716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ba56e39a-f33f-4a23-a0b3-c96e6567e7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:57.831365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a44035-ff91-4f15-8080-8dd38db3c5fe admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:57.932765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a273d3-2d74-4f93-9a81-1d2463b0ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:57.933491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a273d3-2d74-4f93-9a81-1d2463b0ff40 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:57.933773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a273d3-2d74-4f93-9a81-1d2463b0ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:57.934080 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a273d3-2d74-4f93-9a81-1d2463b0ff40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:57.934998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a273d3-2d74-4f93-9a81-1d2463b0ff40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:57.936711 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a273d3-2d74-4f93-9a81-1d2463b0ff40 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:57.958717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 874/1772] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:49:57.958717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a273d3-2d74-4f93-9a81-1d2463b0ff40 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:57.959666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-17a273d3-2d74-4f93-9a81-1d2463b0ff40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:57.976741 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a273d3-2d74-4f93-9a81-1d2463b0ff40 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:57.986662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbe631-0017-4c4e-aff6-4dc7d3c85960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:57.987838 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe631-0017-4c4e-aff6-4dc7d3c85960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:57.988339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe631-0017-4c4e-aff6-4dc7d3c85960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:57.988830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe631-0017-4c4e-aff6-4dc7d3c85960 admin admin] PATH_INFO: `/v3/users/8d66eb56493c4fbfbbe8fe3a84c092e3` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:57.990544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbe631-0017-4c4e-aff6-4dc7d3c85960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d66eb56493c4fbfbbe8fe3a84c092e3)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:58.001514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbe631-0017-4c4e-aff6-4dc7d3c85960 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:58.139392 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b5bbe631-0017-4c4e-aff6-4dc7d3c85960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d66eb56493c4fbfbbe8fe3a84c092e3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:58.158286 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b5bbe631-0017-4c4e-aff6-4dc7d3c85960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d66eb56493c4fbfbbe8fe3a84c092e3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:58.159886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b5bbe631-0017-4c4e-aff6-4dc7d3c85960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d66eb56493c4fbfbbe8fe3a84c092e3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:58.161507 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b5bbe631-0017-4c4e-aff6-4dc7d3c85960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d66eb56493c4fbfbbe8fe3a84c092e3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:58.179425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b5bbe631-0017-4c4e-aff6-4dc7d3c85960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d66eb56493c4fbfbbe8fe3a84c092e3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:58.191452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56e39a-f33f-4a23-a0b3-c96e6567e7f8 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:58.237511 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e753a-4f8b-4618-ba52-26fb290043c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:58.238375 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e753a-4f8b-4618-ba52-26fb290043c0 service placement] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:58.238664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e753a-4f8b-4618-ba52-26fb290043c0 service placement] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:58.238942 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e753a-4f8b-4618-ba52-26fb290043c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:58.240887 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 875/1773] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:49:57 2022] DELETE /identity/v3/users/8d66eb56493c4fbfbbe8fe3a84c092e3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:58.243996 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ec8e753a-4f8b-4618-ba52-26fb290043c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:58.244132 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338014af-3a8b-4810-885b-e0c2b8b81980 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:58.244132 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338014af-3a8b-4810-885b-e0c2b8b81980 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:58.244132 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338014af-3a8b-4810-885b-e0c2b8b81980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:58.286805 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-338014af-3a8b-4810-885b-e0c2b8b81980 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:58.286990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e753a-4f8b-4618-ba52-26fb290043c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:58.288514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e753a-4f8b-4618-ba52-26fb290043c0 service placement] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:58.294131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-338014af-3a8b-4810-885b-e0c2b8b81980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:58.314708 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 899/1774] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:58.315586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e753a-4f8b-4618-ba52-26fb290043c0 service placement] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:58.320469 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ec8e753a-4f8b-4618-ba52-26fb290043c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:58.349652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e753a-4f8b-4618-ba52-26fb290043c0 service placement] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:58.365803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:58.494677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 876/1775] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:58.498311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801198a9-ffd6-49e1-ad7e-031fb51d6f76 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:58.498605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801198a9-ffd6-49e1-ad7e-031fb51d6f76 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:58.498883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801198a9-ffd6-49e1-ad7e-031fb51d6f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:58.515692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5eb30-b175-4bc6-8cd0-56113706afd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:58.516687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5eb30-b175-4bc6-8cd0-56113706afd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:58.516969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5eb30-b175-4bc6-8cd0-56113706afd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:58.517406 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5eb30-b175-4bc6-8cd0-56113706afd6 admin admin] PATH_INFO: `/v3/projects/a3b424cb9922448184bdb0b07e33ddba/users/b2172057859443e6b42fbb110c623916/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:58.539095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-801198a9-ffd6-49e1-ad7e-031fb51d6f76 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:58.540496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-801198a9-ffd6-49e1-ad7e-031fb51d6f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:58.562578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 877/1776] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:58.573184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c73bae-29a4-4980-afb4-ff436c44eb8f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:58.573184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c73bae-29a4-4980-afb4-ff436c44eb8f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:58.573456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c73bae-29a4-4980-afb4-ff436c44eb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:58.577676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5eb30-b175-4bc6-8cd0-56113706afd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b424cb9922448184bdb0b07e33ddba, user_id=b2172057859443e6b42fbb110c623916, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:58.592588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5eb30-b175-4bc6-8cd0-56113706afd6 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:58.652127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 900/1777] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:49:58 2022] PUT /identity/v3/projects/a3b424cb9922448184bdb0b07e33ddba/users/b2172057859443e6b42fbb110c623916/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:58.652127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5eb30-b175-4bc6-8cd0-56113706afd6 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:58.652957 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-69c73bae-29a4-4980-afb4-ff436c44eb8f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:58.652957 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-69c73bae-29a4-4980-afb4-ff436c44eb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:58.653116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6dd5eb30-b175-4bc6-8cd0-56113706afd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:58.695561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:58.821419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5eb30-b175-4bc6-8cd0-56113706afd6 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:58.831838 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 878/1778] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:58.833063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c73bae-29a4-4980-afb4-ff436c44eb8f None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:58.835376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-69c73bae-29a4-4980-afb4-ff436c44eb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:58.844244 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998064dd-0982-489a-8eb5-b7cf747ed3a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:58.846338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998064dd-0982-489a-8eb5-b7cf747ed3a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:58.847230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998064dd-0982-489a-8eb5-b7cf747ed3a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:58.847704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998064dd-0982-489a-8eb5-b7cf747ed3a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:58.865400 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c73bae-29a4-4980-afb4-ff436c44eb8f None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:58.866442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998064dd-0982-489a-8eb5-b7cf747ed3a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:58.868959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998064dd-0982-489a-8eb5-b7cf747ed3a9 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:58.887114 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:58.888489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:58.889372 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:58.889669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] PATH_INFO: `/v3/projects/634f9282ea7045ba90523f73f26ed6be` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:58.891726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=634f9282ea7045ba90523f73f26ed6be)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:58.894291 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:58.903215 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 901/1779] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:49:58.908054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666acaa9-e111-4ced-8c23-db5ffcac18f2 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:58.909791 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666acaa9-e111-4ced-8c23-db5ffcac18f2 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:58.910140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666acaa9-e111-4ced-8c23-db5ffcac18f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:59.010456 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-666acaa9-e111-4ced-8c23-db5ffcac18f2 None None] MFA Rules not processed for user `b2172057859443e6b42fbb110c623916`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:59.011800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-666acaa9-e111-4ced-8c23-db5ffcac18f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:59.043574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634f9282ea7045ba90523f73f26ed6be', 'request_id': 'req-3cadc176-fe53-40de-8864-088fe4577e41'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:59.059798 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634f9282ea7045ba90523f73f26ed6be', 'request_id': 'req-3cadc176-fe53-40de-8864-088fe4577e41'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:59.079666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634f9282ea7045ba90523f73f26ed6be', 'request_id': 'req-3cadc176-fe53-40de-8864-088fe4577e41'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:59.105100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] The token cache is being invalidate because project 634f9282ea7045ba90523f73f26ed6be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:49:59.105469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:59.108044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:49:59.115535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 879/1780] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:49:58 2022] DELETE /identity/v3/projects/634f9282ea7045ba90523f73f26ed6be => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:49:59.117103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:59.120390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:59.187472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 902/1781] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:59.189584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86785760-9ba1-45c0-ab00-14e25ed4dfbf None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:59.193433 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86785760-9ba1-45c0-ab00-14e25ed4dfbf None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:59.193797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86785760-9ba1-45c0-ab00-14e25ed4dfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:59.234634 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-86785760-9ba1-45c0-ab00-14e25ed4dfbf None None] MFA Rules not processed for user `9d44f1f434534cc0b373943d48d672df`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:59.241707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-86785760-9ba1-45c0-ab00-14e25ed4dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:59.305385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:59.368711 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadc176-fe53-40de-8864-088fe4577e41 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:59.381038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f299567-c077-4ade-abe4-4dcb15125b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:59.381915 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f299567-c077-4ade-abe4-4dcb15125b7c admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:59.384519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f299567-c077-4ade-abe4-4dcb15125b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:59.384519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f299567-c077-4ade-abe4-4dcb15125b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:59.386671 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f299567-c077-4ade-abe4-4dcb15125b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:49:59.387230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f299567-c077-4ade-abe4-4dcb15125b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:59.391735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f299567-c077-4ade-abe4-4dcb15125b7c admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:59.459612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 880/1782] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:49:59.472336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b553cb2-73ec-4d0e-bdde-43d47a089184 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:59.472679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b553cb2-73ec-4d0e-bdde-43d47a089184 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:59.475348 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b553cb2-73ec-4d0e-bdde-43d47a089184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:59.497068 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 903/1783] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:59.497442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86785760-9ba1-45c0-ab00-14e25ed4dfbf None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:59.518091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-86785760-9ba1-45c0-ab00-14e25ed4dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:59.542406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-6b553cb2-73ec-4d0e-bdde-43d47a089184 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:59.544332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6b553cb2-73ec-4d0e-bdde-43d47a089184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:59.589431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 881/1784] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:59.590744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b553cb2-73ec-4d0e-bdde-43d47a089184 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:59.592250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86785760-9ba1-45c0-ab00-14e25ed4dfbf None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:59.614137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c768e18-de45-41c8-881a-55e8a750dc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:59.615022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c768e18-de45-41c8-881a-55e8a750dc82 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:59.615311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c768e18-de45-41c8-881a-55e8a750dc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:59.615691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c768e18-de45-41c8-881a-55e8a750dc82 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:59.616532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c768e18-de45-41c8-881a-55e8a750dc82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:59.619095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c768e18-de45-41c8-881a-55e8a750dc82 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:59.627782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b553cb2-73ec-4d0e-bdde-43d47a089184 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:59.647474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d44f6-3644-4a2e-b03a-783550073e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:59.648571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d44f6-3644-4a2e-b03a-783550073e04 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:59.649050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d44f6-3644-4a2e-b03a-783550073e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:59.649511 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d44f6-3644-4a2e-b03a-783550073e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:59.651256 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d44f6-3644-4a2e-b03a-783550073e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:59.659722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d44f6-3644-4a2e-b03a-783550073e04 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:59.676512 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 904/1785] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:59 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:59.678201 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28558a-4ba4-4f77-9275-65492318ac01 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:59.681850 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28558a-4ba4-4f77-9275-65492318ac01 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:59.688481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28558a-4ba4-4f77-9275-65492318ac01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:59.721423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-dd28558a-4ba4-4f77-9275-65492318ac01 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:49:59.733969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-dd28558a-4ba4-4f77-9275-65492318ac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:59.741249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 882/1786] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:49:59 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:59.742729 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d44f6-3644-4a2e-b03a-783550073e04 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:59.798616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:49:59.877747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 905/1787] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:49:59.878620 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28558a-4ba4-4f77-9275-65492318ac01 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:59.884834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-dd28558a-4ba4-4f77-9275-65492318ac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:49:59.901116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d44f6-3644-4a2e-b03a-783550073e04 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:59.909202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28558a-4ba4-4f77-9275-65492318ac01 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:59.919737 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:59.920454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cb5d7-e133-4f19-b262-466438a1ee40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:59.920889 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:59.921085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:59.921191 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cb5d7-e133-4f19-b262-466438a1ee40 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:59.921355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] PATH_INFO: `/v3/projects/b5f0620cf3b449c39210c7762b51c9a4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:59.922125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cb5d7-e133-4f19-b262-466438a1ee40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:59.922411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cb5d7-e133-4f19-b262-466438a1ee40 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:59.923106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cb5d7-e133-4f19-b262-466438a1ee40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:59.926937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cb5d7-e133-4f19-b262-466438a1ee40 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:59.927953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f0620cf3b449c39210c7762b51c9a4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:59.930074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:49:59.963829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 883/1788] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:59 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:49:59.965566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cb5d7-e133-4f19-b262-466438a1ee40 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:49:59.979512 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cb5d7-e133-4f19-b262-466438a1ee40 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:49:59.992483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9472a9d-45b8-4dda-90ca-e7c7de329d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:49:59.993407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9472a9d-45b8-4dda-90ca-e7c7de329d22 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:49:59.993662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9472a9d-45b8-4dda-90ca-e7c7de329d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:49:59.993939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9472a9d-45b8-4dda-90ca-e7c7de329d22 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:49:59.994823 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9472a9d-45b8-4dda-90ca-e7c7de329d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:49:59.996965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9472a9d-45b8-4dda-90ca-e7c7de329d22 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:00.053568 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f0620cf3b449c39210c7762b51c9a4', 'request_id': 'req-4b5ed823-b1ce-4260-a203-21e82ccad039'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:00.060773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 884/1789] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:49:59 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:00.062283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9472a9d-45b8-4dda-90ca-e7c7de329d22 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:00.088407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f0620cf3b449c39210c7762b51c9a4', 'request_id': 'req-4b5ed823-b1ce-4260-a203-21e82ccad039'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:00.093392 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9472a9d-45b8-4dda-90ca-e7c7de329d22 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:00.110793 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f0620cf3b449c39210c7762b51c9a4', 'request_id': 'req-4b5ed823-b1ce-4260-a203-21e82ccad039'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:00.139213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] The token cache is being invalidate because project b5f0620cf3b449c39210c7762b51c9a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:00.139510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:00.140629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:00.142981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 906/1790] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:49:59 2022] DELETE /identity/v3/projects/b5f0620cf3b449c39210c7762b51c9a4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:00.144550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:00.146745 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:00.232645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3b0fa-c078-4bd1-b831-2aa0aed274f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:00.233777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3b0fa-c078-4bd1-b831-2aa0aed274f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:00.234264 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3b0fa-c078-4bd1-b831-2aa0aed274f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:00.234714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3b0fa-c078-4bd1-b831-2aa0aed274f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:00.235796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3b0fa-c078-4bd1-b831-2aa0aed274f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:00.236281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3b0fa-c078-4bd1-b831-2aa0aed274f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:00.238986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3b0fa-c078-4bd1-b831-2aa0aed274f6 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:00.267768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 885/1791] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:00.268641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3b0fa-c078-4bd1-b831-2aa0aed274f6 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:00.270328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7fa3b0fa-c078-4bd1-b831-2aa0aed274f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:00.289864 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3b0fa-c078-4bd1-b831-2aa0aed274f6 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:00.298640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ed823-b1ce-4260-a203-21e82ccad039 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:00.300625 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea317f-6160-44ea-8325-04d1890e0285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:00.301523 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea317f-6160-44ea-8325-04d1890e0285 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:00.302002 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea317f-6160-44ea-8325-04d1890e0285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:00.302454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea317f-6160-44ea-8325-04d1890e0285 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:00.303615 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea317f-6160-44ea-8325-04d1890e0285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:00.304060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7357b23-a005-48c7-9101-bac12d18f410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:00.304828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7357b23-a005-48c7-9101-bac12d18f410 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:00.305111 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7357b23-a005-48c7-9101-bac12d18f410 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:00.305421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7357b23-a005-48c7-9101-bac12d18f410 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:00.306171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7357b23-a005-48c7-9101-bac12d18f410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:00.306506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea317f-6160-44ea-8325-04d1890e0285 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:00.308128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7357b23-a005-48c7-9101-bac12d18f410 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:00.320352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:00.323986 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 907/1792] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:00.323986 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7357b23-a005-48c7-9101-bac12d18f410 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:00.324428 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f7357b23-a005-48c7-9101-bac12d18f410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:00.334695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 886/1793] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:00.338596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea317f-6160-44ea-8325-04d1890e0285 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:00.345379 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-c4ea317f-6160-44ea-8325-04d1890e0285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:00.351548 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7357b23-a005-48c7-9101-bac12d18f410 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:00.365927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dff20-74f1-4555-8875-9bb8ec6754b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:00.366841 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dff20-74f1-4555-8875-9bb8ec6754b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:00.367123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dff20-74f1-4555-8875-9bb8ec6754b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:00.367401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dff20-74f1-4555-8875-9bb8ec6754b0 admin admin] PATH_INFO: `/v3/users/83cd7f16811b40adafc27dff53c3bd73` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:00.368842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dff20-74f1-4555-8875-9bb8ec6754b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83cd7f16811b40adafc27dff53c3bd73)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:00.370912 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dff20-74f1-4555-8875-9bb8ec6754b0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:00.375421 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea317f-6160-44ea-8325-04d1890e0285 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:00.386860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99b606-1161-4541-9204-68e55524c57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:00.387547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99b606-1161-4541-9204-68e55524c57f admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:00.387890 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99b606-1161-4541-9204-68e55524c57f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:00.388218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99b606-1161-4541-9204-68e55524c57f admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:00.388959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99b606-1161-4541-9204-68e55524c57f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:00.391533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99b606-1161-4541-9204-68e55524c57f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:00.455305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 887/1794] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:00 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:00.456643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99b606-1161-4541-9204-68e55524c57f admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:00.476400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:00.482753 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d81dff20-74f1-4555-8875-9bb8ec6754b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83cd7f16811b40adafc27dff53c3bd73'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:00.512253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d81dff20-74f1-4555-8875-9bb8ec6754b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83cd7f16811b40adafc27dff53c3bd73'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:00.513625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d81dff20-74f1-4555-8875-9bb8ec6754b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83cd7f16811b40adafc27dff53c3bd73'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:00.514610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d81dff20-74f1-4555-8875-9bb8ec6754b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83cd7f16811b40adafc27dff53c3bd73'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:00.525856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d81dff20-74f1-4555-8875-9bb8ec6754b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83cd7f16811b40adafc27dff53c3bd73'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:00.559596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 908/1795] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:00 2022] DELETE /identity/v3/users/83cd7f16811b40adafc27dff53c3bd73 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:00.560835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dff20-74f1-4555-8875-9bb8ec6754b0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:00.563342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d81dff20-74f1-4555-8875-9bb8ec6754b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:00.635550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99b606-1161-4541-9204-68e55524c57f admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:00.658113 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dff20-74f1-4555-8875-9bb8ec6754b0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:00.675141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefe265-3ec9-4789-8025-c01830879614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:00.680472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefe265-3ec9-4789-8025-c01830879614 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:00.680915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefe265-3ec9-4789-8025-c01830879614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:00.681201 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefe265-3ec9-4789-8025-c01830879614 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:00.683007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefe265-3ec9-4789-8025-c01830879614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:00.685121 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefe265-3ec9-4789-8025-c01830879614 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:00.714879 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 909/1796] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:00.717804 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefe265-3ec9-4789-8025-c01830879614 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:00.724235 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6fefe265-3ec9-4789-8025-c01830879614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:00.766664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefe265-3ec9-4789-8025-c01830879614 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:00.779331 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a19f8c-787b-41ae-b5d1-21a2e4909bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:00.782792 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a19f8c-787b-41ae-b5d1-21a2e4909bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:00.783803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a19f8c-787b-41ae-b5d1-21a2e4909bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:00.784111 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a19f8c-787b-41ae-b5d1-21a2e4909bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:00.785254 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a19f8c-787b-41ae-b5d1-21a2e4909bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:00.792430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7b579-fcc6-495d-89e0-6449b3ed269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:00.793658 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7b579-fcc6-495d-89e0-6449b3ed269e admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:00.794125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7b579-fcc6-495d-89e0-6449b3ed269e admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:00.794504 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7b579-fcc6-495d-89e0-6449b3ed269e admin admin] PATH_INFO: `/v3/projects/bcb4d3e99110493bb1148e41baf9b1e4/users/981638b22a1840b9adbd125f8e6d66d4/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:00.794896 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a19f8c-787b-41ae-b5d1-21a2e4909bc0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:00.828538 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7b579-fcc6-495d-89e0-6449b3ed269e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb4d3e99110493bb1148e41baf9b1e4, user_id=981638b22a1840b9adbd125f8e6d66d4, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:00.831860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7b579-fcc6-495d-89e0-6449b3ed269e admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:00.847642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 910/1797] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:00 2022] POST /identity/v3/users => generated 284 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:00.848670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a19f8c-787b-41ae-b5d1-21a2e4909bc0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:00.850741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-18a19f8c-787b-41ae-b5d1-21a2e4909bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:00.868459 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 888/1798] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:00 2022] PUT /identity/v3/projects/bcb4d3e99110493bb1148e41baf9b1e4/users/981638b22a1840b9adbd125f8e6d66d4/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:00.869741 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7b579-fcc6-495d-89e0-6449b3ed269e admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:00.887652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a19f8c-787b-41ae-b5d1-21a2e4909bc0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:01.000891 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1dc68-8d67-41e8-8993-16a99d425ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:01.001818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1dc68-8d67-41e8-8993-16a99d425ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:01.002231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1dc68-8d67-41e8-8993-16a99d425ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:01.002548 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1dc68-8d67-41e8-8993-16a99d425ca2 admin admin] PATH_INFO: `/v3/users/75bbe584451748bd8e2db06b1dab7a52` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:01.016809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1dc68-8d67-41e8-8993-16a99d425ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75bbe584451748bd8e2db06b1dab7a52)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:01.024510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1dc68-8d67-41e8-8993-16a99d425ca2 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:01.040540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7b579-fcc6-495d-89e0-6449b3ed269e admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:01.054869 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb4911-5c5b-4343-bc0a-17a61aa3c5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:01.055928 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb4911-5c5b-4343-bc0a-17a61aa3c5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:01.056378 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb4911-5c5b-4343-bc0a-17a61aa3c5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:01.056747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb4911-5c5b-4343-bc0a-17a61aa3c5d1 admin admin] PATH_INFO: `/v3/projects/8a69cfb9a7074932af6246fa3746a04b/users/c2ce871916fb4e2b924c3dffd1c6d98a/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:01.088044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:01.092585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb4911-5c5b-4343-bc0a-17a61aa3c5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a69cfb9a7074932af6246fa3746a04b, user_id=c2ce871916fb4e2b924c3dffd1c6d98a, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:01.098343 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb4911-5c5b-4343-bc0a-17a61aa3c5d1 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:01.132437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 889/1799] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:00 2022] PUT /identity/v3/projects/8a69cfb9a7074932af6246fa3746a04b/users/c2ce871916fb4e2b924c3dffd1c6d98a/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:01.133313 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb4911-5c5b-4343-bc0a-17a61aa3c5d1 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:01.133841 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:01.169001 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-90f1dc68-8d67-41e8-8993-16a99d425ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75bbe584451748bd8e2db06b1dab7a52'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:01.180245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-90f1dc68-8d67-41e8-8993-16a99d425ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75bbe584451748bd8e2db06b1dab7a52'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:01.188987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-90f1dc68-8d67-41e8-8993-16a99d425ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75bbe584451748bd8e2db06b1dab7a52'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:01.190132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-90f1dc68-8d67-41e8-8993-16a99d425ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75bbe584451748bd8e2db06b1dab7a52'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:01.213891 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-90f1dc68-8d67-41e8-8993-16a99d425ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75bbe584451748bd8e2db06b1dab7a52'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:01.277440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 911/1800] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:00 2022] DELETE /identity/v3/users/75bbe584451748bd8e2db06b1dab7a52 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:01.283759 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb4911-5c5b-4343-bc0a-17a61aa3c5d1 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:01.284511 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1dc68-8d67-41e8-8993-16a99d425ca2 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:01.285963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-90f1dc68-8d67-41e8-8993-16a99d425ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:01.417978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce7346-edbd-48e6-8edf-73870c5dbdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:01.419551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce7346-edbd-48e6-8edf-73870c5dbdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:01.420515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce7346-edbd-48e6-8edf-73870c5dbdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:01.421201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce7346-edbd-48e6-8edf-73870c5dbdf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:01.422506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce7346-edbd-48e6-8edf-73870c5dbdf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:01.425297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce7346-edbd-48e6-8edf-73870c5dbdf8 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:01.450555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 890/1801] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:01.450555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5bf31-436c-496e-a2b2-6f88c85030f4 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:01.450768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5bf31-436c-496e-a2b2-6f88c85030f4 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:01.451342 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5bf31-436c-496e-a2b2-6f88c85030f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:01.457362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1dc68-8d67-41e8-8993-16a99d425ca2 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:01.470704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc2dad-657a-4ae0-83d7-f67834c0ebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:01.471520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2dad-657a-4ae0-83d7-f67834c0ebb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:01.471828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2dad-657a-4ae0-83d7-f67834c0ebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:01.472187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2dad-657a-4ae0-83d7-f67834c0ebb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:01.472982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc2dad-657a-4ae0-83d7-f67834c0ebb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:01.477277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc2dad-657a-4ae0-83d7-f67834c0ebb2 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:01.497677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-dfb5bf31-436c-496e-a2b2-6f88c85030f4 None None] MFA Rules not processed for user `c2ce871916fb4e2b924c3dffd1c6d98a`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:01.498203 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 912/1802] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:01.501599 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-dfb5bf31-436c-496e-a2b2-6f88c85030f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:01.503619 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979a455-99b8-4841-afa6-04f7665c895a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:01.504128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979a455-99b8-4841-afa6-04f7665c895a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:01.504628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979a455-99b8-4841-afa6-04f7665c895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:01.549752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-7979a455-99b8-4841-afa6-04f7665c895a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:01.553967 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7979a455-99b8-4841-afa6-04f7665c895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:01.585015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 913/1803] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:01.588571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191640f7-c4dd-47fb-b99b-a8cafe325a5c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:01.591789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191640f7-c4dd-47fb-b99b-a8cafe325a5c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:01.592571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191640f7-c4dd-47fb-b99b-a8cafe325a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:01.711224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 891/1804] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:01.712846 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5bf31-436c-496e-a2b2-6f88c85030f4 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:01.714418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-dfb5bf31-436c-496e-a2b2-6f88c85030f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:01.719843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-191640f7-c4dd-47fb-b99b-a8cafe325a5c None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:01.724675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-191640f7-c4dd-47fb-b99b-a8cafe325a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:01.735803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5bf31-436c-496e-a2b2-6f88c85030f4 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:01.741885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc9ad8-d207-4541-be84-945b2f6f2970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:01.742597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc9ad8-d207-4541-be84-945b2f6f2970 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:01.743057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc9ad8-d207-4541-be84-945b2f6f2970 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:01.743920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc9ad8-d207-4541-be84-945b2f6f2970 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:01.744769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc9ad8-d207-4541-be84-945b2f6f2970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:01.747116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc9ad8-d207-4541-be84-945b2f6f2970 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:01.769792 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 892/1805] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:01.769792 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc9ad8-d207-4541-be84-945b2f6f2970 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:01.783873 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc9ad8-d207-4541-be84-945b2f6f2970 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:01.789256 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd2182-e064-466c-9ae1-979001d53a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:01.790232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd2182-e064-466c-9ae1-979001d53a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:01.790516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd2182-e064-466c-9ae1-979001d53a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:01.790800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd2182-e064-466c-9ae1-979001d53a04 admin admin] PATH_INFO: `/v3/projects/bcb4d3e99110493bb1148e41baf9b1e4/users/981638b22a1840b9adbd125f8e6d66d4/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:01.793425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd2182-e064-466c-9ae1-979001d53a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb4d3e99110493bb1148e41baf9b1e4, user_id=981638b22a1840b9adbd125f8e6d66d4, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:01.796583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd2182-e064-466c-9ae1-979001d53a04 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:01.806874 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:01.814364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 893/1806] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:01 2022] PUT /identity/v3/projects/bcb4d3e99110493bb1148e41baf9b1e4/users/981638b22a1840b9adbd125f8e6d66d4/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:01.816341 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd2182-e064-466c-9ae1-979001d53a04 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:01.818380 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9cdd2182-e064-466c-9ae1-979001d53a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:01.924694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 914/1807] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Jul 11 15:50:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:01.925711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191640f7-c4dd-47fb-b99b-a8cafe325a5c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:01.935117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-191640f7-c4dd-47fb-b99b-a8cafe325a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:01.998187 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd2182-e064-466c-9ae1-979001d53a04 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:02.011513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:02.026017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf85b1-7c4f-446e-8f98-0e6c385081e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:02.026653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf85b1-7c4f-446e-8f98-0e6c385081e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:02.027055 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf85b1-7c4f-446e-8f98-0e6c385081e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:02.027982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf85b1-7c4f-446e-8f98-0e6c385081e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:02.133919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf85b1-7c4f-446e-8f98-0e6c385081e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:02.135136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf85b1-7c4f-446e-8f98-0e6c385081e5 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:02.159796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191640f7-c4dd-47fb-b99b-a8cafe325a5c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:02.175445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 894/1808] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:02.177241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf85b1-7c4f-446e-8f98-0e6c385081e5 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:02.202764 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf85b1-7c4f-446e-8f98-0e6c385081e5 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:02.222491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804b934-f271-48a0-9525-4ee27820f5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:02.225932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804b934-f271-48a0-9525-4ee27820f5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:02.228259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804b934-f271-48a0-9525-4ee27820f5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:02.228816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804b934-f271-48a0-9525-4ee27820f5cf admin admin] PATH_INFO: `/v3/projects/f0bb10440bbb415dba89fc241f4417ae/users/b4f06b61bf5a4999a6f73346c09b8627/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:02.250241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804b934-f271-48a0-9525-4ee27820f5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0bb10440bbb415dba89fc241f4417ae, user_id=b4f06b61bf5a4999a6f73346c09b8627, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:02.254967 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804b934-f271-48a0-9525-4ee27820f5cf admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:02.277334 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 895/1809] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:02 2022] PUT /identity/v3/projects/f0bb10440bbb415dba89fc241f4417ae/users/b4f06b61bf5a4999a6f73346c09b8627/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:02.279447 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee088d-9dfc-4fa4-a099-35aa55f2e07c None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:02.279746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee088d-9dfc-4fa4-a099-35aa55f2e07c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:02.280030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee088d-9dfc-4fa4-a099-35aa55f2e07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:02.310028 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9774d-45b6-4ddc-acb2-dbe5b1b860d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be29cfa76174b44b99ddaf3d293ead1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:02.311074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9774d-45b6-4ddc-acb2-dbe5b1b860d0 service glance] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:02.311579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9774d-45b6-4ddc-acb2-dbe5b1b860d0 service glance] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:02.312191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9774d-45b6-4ddc-acb2-dbe5b1b860d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:02.353207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-4eee088d-9dfc-4fa4-a099-35aa55f2e07c None None] MFA Rules not processed for user `981638b22a1840b9adbd125f8e6d66d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:02.354835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4eee088d-9dfc-4fa4-a099-35aa55f2e07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:02.468309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9774d-45b6-4ddc-acb2-dbe5b1b860d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:02.472995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9774d-45b6-4ddc-acb2-dbe5b1b860d0 service glance] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:02.513574 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 915/1810] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:02.519520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9774d-45b6-4ddc-acb2-dbe5b1b860d0 service glance] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:02.521888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8eb9774d-45b6-4ddc-acb2-dbe5b1b860d0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:02.532395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 896/1811] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:02.533883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee088d-9dfc-4fa4-a099-35aa55f2e07c None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:02.540046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4eee088d-9dfc-4fa4-a099-35aa55f2e07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:02.553602 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9774d-45b6-4ddc-acb2-dbe5b1b860d0 service glance] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:02.595709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:02.694572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae77562-64c1-46bc-b031-2fb7c9765833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:02.695953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae77562-64c1-46bc-b031-2fb7c9765833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:02.699082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae77562-64c1-46bc-b031-2fb7c9765833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:02.700106 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae77562-64c1-46bc-b031-2fb7c9765833 admin admin] PATH_INFO: `/v3/projects/a03c03cbb3fd4b1aa8abe478407a2edf` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:02.712162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae77562-64c1-46bc-b031-2fb7c9765833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a03c03cbb3fd4b1aa8abe478407a2edf)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:02.715245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae77562-64c1-46bc-b031-2fb7c9765833 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:02.742380 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:02.821028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee088d-9dfc-4fa4-a099-35aa55f2e07c None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:02.830059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-aae77562-64c1-46bc-b031-2fb7c9765833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03c03cbb3fd4b1aa8abe478407a2edf', 'request_id': 'req-aae77562-64c1-46bc-b031-2fb7c9765833'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:02.848990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-aae77562-64c1-46bc-b031-2fb7c9765833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03c03cbb3fd4b1aa8abe478407a2edf', 'request_id': 'req-aae77562-64c1-46bc-b031-2fb7c9765833'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:02.855939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-aae77562-64c1-46bc-b031-2fb7c9765833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03c03cbb3fd4b1aa8abe478407a2edf', 'request_id': 'req-aae77562-64c1-46bc-b031-2fb7c9765833'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:02.881240 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-aae77562-64c1-46bc-b031-2fb7c9765833 admin admin] The token cache is being invalidate because project a03c03cbb3fd4b1aa8abe478407a2edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:02.881454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-aae77562-64c1-46bc-b031-2fb7c9765833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:02.883198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-aae77562-64c1-46bc-b031-2fb7c9765833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:02.889532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 916/1812] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:02 2022] DELETE /identity/v3/projects/a03c03cbb3fd4b1aa8abe478407a2edf => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:02.891088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d5870-0836-45e8-b817-cd98486e1e05 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:02.891386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d5870-0836-45e8-b817-cd98486e1e05 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:02.891743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d5870-0836-45e8-b817-cd98486e1e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:02.973286 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-646d5870-0836-45e8-b817-cd98486e1e05 None None] MFA Rules not processed for user `b4f06b61bf5a4999a6f73346c09b8627`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:02.975423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-646d5870-0836-45e8-b817-cd98486e1e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:03.007279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f95f6-8f67-4965-8dd9-1aab4b5b8774 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:03.007945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f95f6-8f67-4965-8dd9-1aab4b5b8774 service swift] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:03.008225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f95f6-8f67-4965-8dd9-1aab4b5b8774 service swift] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:03.008527 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f95f6-8f67-4965-8dd9-1aab4b5b8774 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:03.014644 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-aa0f95f6-8f67-4965-8dd9-1aab4b5b8774 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:03.130047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 917/1813] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:03.131368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d5870-0836-45e8-b817-cd98486e1e05 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:03.135164 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-646d5870-0836-45e8-b817-cd98486e1e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:03.159002 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f95f6-8f67-4965-8dd9-1aab4b5b8774 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:03.160684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f95f6-8f67-4965-8dd9-1aab4b5b8774 service swift] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:03.175823 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 897/1814] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 15:50:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:50:03.177444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dab05-673d-492d-9425-eb77a1cde7f1 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:03.177787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dab05-673d-492d-9425-eb77a1cde7f1 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:03.177787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dab05-673d-492d-9425-eb77a1cde7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:03.205402 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-496dab05-673d-492d-9425-eb77a1cde7f1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:03.207379 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-496dab05-673d-492d-9425-eb77a1cde7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:03.248000 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:03.305850 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d5870-0836-45e8-b817-cd98486e1e05 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:03.322285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aacb5d-d19f-4d43-929c-882ca224f5af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:03.322285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aacb5d-d19f-4d43-929c-882ca224f5af service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:03.322285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aacb5d-d19f-4d43-929c-882ca224f5af service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:03.322285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aacb5d-d19f-4d43-929c-882ca224f5af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:03.325807 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 898/1815] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:03.328432 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dab05-673d-492d-9425-eb77a1cde7f1 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:03.328716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-26aacb5d-d19f-4d43-929c-882ca224f5af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:03.330288 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-496dab05-673d-492d-9425-eb77a1cde7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:03.350526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dab05-673d-492d-9425-eb77a1cde7f1 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:03.357654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ff945-8ec3-43d9-876f-13fe98060544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:03.358763 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ff945-8ec3-43d9-876f-13fe98060544 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:03.359296 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ff945-8ec3-43d9-876f-13fe98060544 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:03.359765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ff945-8ec3-43d9-876f-13fe98060544 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:03.360725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ff945-8ec3-43d9-876f-13fe98060544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:03.363025 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ff945-8ec3-43d9-876f-13fe98060544 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:03.439853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 899/1816] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:03 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:03.445519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df962d62-07e6-41b6-89b5-21e52582b807 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:03.446082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df962d62-07e6-41b6-89b5-21e52582b807 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:03.446878 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df962d62-07e6-41b6-89b5-21e52582b807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:03.477458 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:03.513918 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-df962d62-07e6-41b6-89b5-21e52582b807 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:03.522779 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-df962d62-07e6-41b6-89b5-21e52582b807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:03.577303 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aacb5d-d19f-4d43-929c-882ca224f5af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:03.584812 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aacb5d-d19f-4d43-929c-882ca224f5af service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:03.636582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 918/1817] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:03.637668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aacb5d-d19f-4d43-929c-882ca224f5af service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:03.665088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 900/1818] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:03.667164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df962d62-07e6-41b6-89b5-21e52582b807 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:03.675187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aacb5d-d19f-4d43-929c-882ca224f5af service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:03.679863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df962d62-07e6-41b6-89b5-21e52582b807 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:03.687347 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55d323-831a-40b3-856a-f3a45c2fda6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:03.704531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55d323-831a-40b3-856a-f3a45c2fda6b admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:03.705512 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55d323-831a-40b3-856a-f3a45c2fda6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:03.705841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55d323-831a-40b3-856a-f3a45c2fda6b admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:03.707072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5430d-7d5e-444b-94cd-52902e12da7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:03.708545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5430d-7d5e-444b-94cd-52902e12da7a admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:03.710250 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55d323-831a-40b3-856a-f3a45c2fda6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:03.710566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55d323-831a-40b3-856a-f3a45c2fda6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:03.710946 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5430d-7d5e-444b-94cd-52902e12da7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:03.711337 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5430d-7d5e-444b-94cd-52902e12da7a admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:03.713537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5430d-7d5e-444b-94cd-52902e12da7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:03.715717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55d323-831a-40b3-856a-f3a45c2fda6b admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:03.717837 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5430d-7d5e-444b-94cd-52902e12da7a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:03.748906 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 901/1819] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:03.751514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55d323-831a-40b3-856a-f3a45c2fda6b admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:03.754698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ee55d323-831a-40b3-856a-f3a45c2fda6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:03.770934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 919/1820] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:03 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:03.771841 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5430d-7d5e-444b-94cd-52902e12da7a admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:03.783251 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5430d-7d5e-444b-94cd-52902e12da7a admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:03.794107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf723c2-cde9-4cef-a50e-e89bddd60080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:03.794789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf723c2-cde9-4cef-a50e-e89bddd60080 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:03.795069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf723c2-cde9-4cef-a50e-e89bddd60080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:03.795347 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf723c2-cde9-4cef-a50e-e89bddd60080 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:03.796053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf723c2-cde9-4cef-a50e-e89bddd60080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:03.797573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55d323-831a-40b3-856a-f3a45c2fda6b admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:03.799324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf723c2-cde9-4cef-a50e-e89bddd60080 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:03.817891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077525b1-7314-46f9-ab2e-6cffd7284ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:03.820839 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077525b1-7314-46f9-ab2e-6cffd7284ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:03.821218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077525b1-7314-46f9-ab2e-6cffd7284ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:03.821806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077525b1-7314-46f9-ab2e-6cffd7284ad4 admin admin] PATH_INFO: `/v3/users/b2172057859443e6b42fbb110c623916` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:03.823436 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077525b1-7314-46f9-ab2e-6cffd7284ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2172057859443e6b42fbb110c623916)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:03.826882 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077525b1-7314-46f9-ab2e-6cffd7284ad4 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:03.902417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 920/1821] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:03 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:03.903588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf723c2-cde9-4cef-a50e-e89bddd60080 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:03.964234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-077525b1-7314-46f9-ab2e-6cffd7284ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2172057859443e6b42fbb110c623916'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:04.000427 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-077525b1-7314-46f9-ab2e-6cffd7284ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2172057859443e6b42fbb110c623916'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:04.002977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-077525b1-7314-46f9-ab2e-6cffd7284ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2172057859443e6b42fbb110c623916'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:04.006829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-077525b1-7314-46f9-ab2e-6cffd7284ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2172057859443e6b42fbb110c623916'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:04.037664 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-077525b1-7314-46f9-ab2e-6cffd7284ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2172057859443e6b42fbb110c623916'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:04.074808 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf723c2-cde9-4cef-a50e-e89bddd60080 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:04.085208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 902/1822] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:03 2022] DELETE /identity/v3/users/b2172057859443e6b42fbb110c623916 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:04.096141 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077525b1-7314-46f9-ab2e-6cffd7284ad4 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:04.097316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637f72-917b-4728-9415-cd5504f16a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:04.098022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637f72-917b-4728-9415-cd5504f16a3c admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:04.098302 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637f72-917b-4728-9415-cd5504f16a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:04.098908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637f72-917b-4728-9415-cd5504f16a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:04.100169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-077525b1-7314-46f9-ab2e-6cffd7284ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:04.101989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc637f72-917b-4728-9415-cd5504f16a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:04.110929 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc637f72-917b-4728-9415-cd5504f16a3c admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:04.176394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 921/1823] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:04.186554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da10c3-a745-49ab-a143-2488206a0be0 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:04.186881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da10c3-a745-49ab-a143-2488206a0be0 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:04.187117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da10c3-a745-49ab-a143-2488206a0be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:04.203036 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:04.239739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-86da10c3-a745-49ab-a143-2488206a0be0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:04.241218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-86da10c3-a745-49ab-a143-2488206a0be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:04.314108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077525b1-7314-46f9-ab2e-6cffd7284ad4 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:04.320966 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1294eb-cb6a-40ef-a318-5f64df0f98ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:04.331703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1294eb-cb6a-40ef-a318-5f64df0f98ae admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:04.331920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1294eb-cb6a-40ef-a318-5f64df0f98ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:04.332223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1294eb-cb6a-40ef-a318-5f64df0f98ae admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:04.332994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1294eb-cb6a-40ef-a318-5f64df0f98ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:04.337190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1294eb-cb6a-40ef-a318-5f64df0f98ae admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:04.389153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 922/1824] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:04.394787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd1dda-11a5-49c5-a6f2-ed4b3cc962e8 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:04.395079 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd1dda-11a5-49c5-a6f2-ed4b3cc962e8 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:04.395361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd1dda-11a5-49c5-a6f2-ed4b3cc962e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:04.396734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 903/1825] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:04 2022] POST /identity/v3/users => generated 289 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:04.398849 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b550482-9f63-4bf1-b071-67fd23c5a63b None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:04.399770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b550482-9f63-4bf1-b071-67fd23c5a63b None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:04.400452 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b550482-9f63-4bf1-b071-67fd23c5a63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:04.428409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-4cdd1dda-11a5-49c5-a6f2-ed4b3cc962e8 None None] MFA Rules not processed for user `44a4d0441d4a423884d7adef45e2641f`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:04.429769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4cdd1dda-11a5-49c5-a6f2-ed4b3cc962e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:04.472469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-6b550482-9f63-4bf1-b071-67fd23c5a63b None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:04.476946 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6b550482-9f63-4bf1-b071-67fd23c5a63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:04.483719 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:04.537623 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 923/1826] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Jul 11 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:04.538705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd1dda-11a5-49c5-a6f2-ed4b3cc962e8 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:04.540203 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4cdd1dda-11a5-49c5-a6f2-ed4b3cc962e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:04.568835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 904/1827] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Jul 11 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:04.569907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b550482-9f63-4bf1-b071-67fd23c5a63b None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:04.570781 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd1dda-11a5-49c5-a6f2-ed4b3cc962e8 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:04.583978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b550482-9f63-4bf1-b071-67fd23c5a63b None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:04.591930 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fc321-38ed-4afe-b494-f2e29676695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:04.595876 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fc321-38ed-4afe-b494-f2e29676695b admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:04.596265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fc321-38ed-4afe-b494-f2e29676695b admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:04.596606 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fc321-38ed-4afe-b494-f2e29676695b admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:04.597383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fc321-38ed-4afe-b494-f2e29676695b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:04.600865 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fc321-38ed-4afe-b494-f2e29676695b admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:04.612827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2d3da-6f3b-4314-a472-03306c8bdac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:04.614103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2d3da-6f3b-4314-a472-03306c8bdac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:04.614406 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2d3da-6f3b-4314-a472-03306c8bdac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:04.614707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2d3da-6f3b-4314-a472-03306c8bdac0 admin admin] PATH_INFO: `/v3/projects/0b3cafdfbcc94864a133e2f179e57a07/users/1410aec6009f4e8d88641b0a6a73ba9a/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:04.615809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 905/1828] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:04.617104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fc321-38ed-4afe-b494-f2e29676695b admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:04.619553 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-142fc321-38ed-4afe-b494-f2e29676695b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:04.638089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fc321-38ed-4afe-b494-f2e29676695b admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:04.644165 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11669e67-dd24-4f02-93db-91a545a7156f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:04.644988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11669e67-dd24-4f02-93db-91a545a7156f service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:04.645380 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11669e67-dd24-4f02-93db-91a545a7156f service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:04.645754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11669e67-dd24-4f02-93db-91a545a7156f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:04.663386 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11669e67-dd24-4f02-93db-91a545a7156f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:04.665419 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11669e67-dd24-4f02-93db-91a545a7156f service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:04.666593 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2d3da-6f3b-4314-a472-03306c8bdac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3cafdfbcc94864a133e2f179e57a07, user_id=1410aec6009f4e8d88641b0a6a73ba9a, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:04.669649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2d3da-6f3b-4314-a472-03306c8bdac0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:04.678236 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 906/1829] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:04.680498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11669e67-dd24-4f02-93db-91a545a7156f service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:04.685465 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-11669e67-dd24-4f02-93db-91a545a7156f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:04.713460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 924/1830] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:04 2022] PUT /identity/v3/projects/0b3cafdfbcc94864a133e2f179e57a07/users/1410aec6009f4e8d88641b0a6a73ba9a/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:04.714655 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2d3da-6f3b-4314-a472-03306c8bdac0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:04.721204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11669e67-dd24-4f02-93db-91a545a7156f service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:04.722690 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4ec2d3da-6f3b-4314-a472-03306c8bdac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:04.809702 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:04.811808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:04.812708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:04.813673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] PATH_INFO: `/v3/projects/7e8f045dbf4e4f8a94db9e14af8b4812` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:04.815072 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8f045dbf4e4f8a94db9e14af8b4812)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:04.817098 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:04.882546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:04.896338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2d3da-6f3b-4314-a472-03306c8bdac0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:04.966253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8f045dbf4e4f8a94db9e14af8b4812', 'request_id': 'req-84308ed5-4e3b-401f-b16f-84c82c7d1680'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:04.988047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8f045dbf4e4f8a94db9e14af8b4812', 'request_id': 'req-84308ed5-4e3b-401f-b16f-84c82c7d1680'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:05.000663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8f045dbf4e4f8a94db9e14af8b4812', 'request_id': 'req-84308ed5-4e3b-401f-b16f-84c82c7d1680'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:05.033960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] The token cache is being invalidate because project 7e8f045dbf4e4f8a94db9e14af8b4812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:05.034352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:05.039123 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:05.041345 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 907/1831] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:04 2022] DELETE /identity/v3/projects/7e8f045dbf4e4f8a94db9e14af8b4812 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:05.041952 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:05.046396 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:05.058057 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f0104-a728-41b5-98c6-b6946e3021c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:05.059902 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0104-a728-41b5-98c6-b6946e3021c5 service swift] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:05.060463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0104-a728-41b5-98c6-b6946e3021c5 service swift] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:05.061128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0104-a728-41b5-98c6-b6946e3021c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:05.065729 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f17f0104-a728-41b5-98c6-b6946e3021c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:05.141713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f0104-a728-41b5-98c6-b6946e3021c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:05.143979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f0104-a728-41b5-98c6-b6946e3021c5 service swift] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:05.181123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 925/1832] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 15:50:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:50:05.183420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f0104-a728-41b5-98c6-b6946e3021c5 service swift] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:05.193164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84308ed5-4e3b-401f-b16f-84c82c7d1680 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:05.201420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090d5b-ac93-457d-8797-987a954c06c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:05.202168 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090d5b-ac93-457d-8797-987a954c06c4 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:05.202357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090d5b-ac93-457d-8797-987a954c06c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:05.202595 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090d5b-ac93-457d-8797-987a954c06c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:05.209597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-61090d5b-ac93-457d-8797-987a954c06c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:05.211801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f0104-a728-41b5-98c6-b6946e3021c5 service swift] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:05.223330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1398e2-ca98-4bda-92db-103bf2e870e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:05.225177 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1398e2-ca98-4bda-92db-103bf2e870e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:05.226569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1398e2-ca98-4bda-92db-103bf2e870e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:05.227076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1398e2-ca98-4bda-92db-103bf2e870e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:05.237237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61090d5b-ac93-457d-8797-987a954c06c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:05.239461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:05.241528 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61090d5b-ac93-457d-8797-987a954c06c4 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:05.251568 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1398e2-ca98-4bda-92db-103bf2e870e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:05.253543 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1398e2-ca98-4bda-92db-103bf2e870e6 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:05.266638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 908/1833] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:05.267415 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090d5b-ac93-457d-8797-987a954c06c4 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:05.271521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 926/1834] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:05.272822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1398e2-ca98-4bda-92db-103bf2e870e6 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:05.273206 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-61090d5b-ac93-457d-8797-987a954c06c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:05.275000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6e1398e2-ca98-4bda-92db-103bf2e870e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:05.378395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1398e2-ca98-4bda-92db-103bf2e870e6 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:05.393381 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956556ac-8c14-4b35-9070-4bf12df9076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:05.394459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956556ac-8c14-4b35-9070-4bf12df9076b admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:05.395041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956556ac-8c14-4b35-9070-4bf12df9076b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:05.395526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956556ac-8c14-4b35-9070-4bf12df9076b admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:05.396536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956556ac-8c14-4b35-9070-4bf12df9076b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:05.398421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956556ac-8c14-4b35-9070-4bf12df9076b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:05.422253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 927/1835] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:05.425816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9afe-34ee-4382-aede-14f3001b4fad None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:05.426468 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9afe-34ee-4382-aede-14f3001b4fad None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:05.426978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9afe-34ee-4382-aede-14f3001b4fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:05.439701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090d5b-ac93-457d-8797-987a954c06c4 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:05.466852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e445e6-716f-462a-8171-4e3bc4784edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:05.467594 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e445e6-716f-462a-8171-4e3bc4784edd admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:05.467905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e445e6-716f-462a-8171-4e3bc4784edd admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:05.468182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e445e6-716f-462a-8171-4e3bc4784edd admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:05.469049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e445e6-716f-462a-8171-4e3bc4784edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:05.470708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e445e6-716f-462a-8171-4e3bc4784edd admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:05.481166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-466d9afe-34ee-4382-aede-14f3001b4fad None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:05.482430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-466d9afe-34ee-4382-aede-14f3001b4fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:05.495328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 928/1836] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:05.496676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d9afe-34ee-4382-aede-14f3001b4fad None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:05.532870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d9afe-34ee-4382-aede-14f3001b4fad None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:05.534011 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 909/1837] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:05.540933 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a36797-d4e6-4891-8709-5947a57a64b6 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:05.541386 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a36797-d4e6-4891-8709-5947a57a64b6 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:05.541673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a36797-d4e6-4891-8709-5947a57a64b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:05.552133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3936bb-1334-4ad7-a7cf-982c4688d7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:05.554133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3936bb-1334-4ad7-a7cf-982c4688d7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:05.554440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3936bb-1334-4ad7-a7cf-982c4688d7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:05.555224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3936bb-1334-4ad7-a7cf-982c4688d7ba admin admin] PATH_INFO: `/v3/projects/0b3cafdfbcc94864a133e2f179e57a07/users/1410aec6009f4e8d88641b0a6a73ba9a/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:05.559952 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3936bb-1334-4ad7-a7cf-982c4688d7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3cafdfbcc94864a133e2f179e57a07, user_id=1410aec6009f4e8d88641b0a6a73ba9a, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:05.575511 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3936bb-1334-4ad7-a7cf-982c4688d7ba admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:05.620833 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 929/1838] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:05 2022] PUT /identity/v3/projects/0b3cafdfbcc94864a133e2f179e57a07/users/1410aec6009f4e8d88641b0a6a73ba9a/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:05.620833 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3936bb-1334-4ad7-a7cf-982c4688d7ba admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:05.621902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-85a36797-d4e6-4891-8709-5947a57a64b6 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:05.627909 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-85a36797-d4e6-4891-8709-5947a57a64b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:05.785695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:05.838108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3936bb-1334-4ad7-a7cf-982c4688d7ba admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:05.845283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 910/1839] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:05.848259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587439c7-06c5-4cce-aa78-4b389ac5b267 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:05.848871 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587439c7-06c5-4cce-aa78-4b389ac5b267 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:05.849248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587439c7-06c5-4cce-aa78-4b389ac5b267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:05.862928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb3cdb-3967-4ebe-9b4b-b5e3a1123c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:05.864068 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb3cdb-3967-4ebe-9b4b-b5e3a1123c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:05.864547 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb3cdb-3967-4ebe-9b4b-b5e3a1123c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:05.864978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb3cdb-3967-4ebe-9b4b-b5e3a1123c14 admin admin] PATH_INFO: `/v3/projects/1e1af493a16c49e9b48255ffb33a97f6/users/867b83a9c63d41af9bf0ff874bcb567f/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:05.881992 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb3cdb-3967-4ebe-9b4b-b5e3a1123c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1af493a16c49e9b48255ffb33a97f6, user_id=867b83a9c63d41af9bf0ff874bcb567f, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:05.885022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb3cdb-3967-4ebe-9b4b-b5e3a1123c14 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:05.903132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 930/1840] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:05 2022] PUT /identity/v3/projects/1e1af493a16c49e9b48255ffb33a97f6/users/867b83a9c63d41af9bf0ff874bcb567f/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:05.904206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb3cdb-3967-4ebe-9b4b-b5e3a1123c14 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:05.906076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-41eb3cdb-3967-4ebe-9b4b-b5e3a1123c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:05.958664 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-587439c7-06c5-4cce-aa78-4b389ac5b267 None None] MFA Rules not processed for user `1410aec6009f4e8d88641b0a6a73ba9a`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:05.960394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-587439c7-06c5-4cce-aa78-4b389ac5b267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:06.016710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:06.031936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb3cdb-3967-4ebe-9b4b-b5e3a1123c14 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:06.038737 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:06.040256 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:06.040576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:06.040924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812 admin admin] PATH_INFO: `/v3/projects/a3b424cb9922448184bdb0b07e33ddba` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:06.045589 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b424cb9922448184bdb0b07e33ddba)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:06.048163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:06.125578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b424cb9922448184bdb0b07e33ddba', 'request_id': 'req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:06.136978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b424cb9922448184bdb0b07e33ddba', 'request_id': 'req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:06.149604 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b424cb9922448184bdb0b07e33ddba', 'request_id': 'req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:06.176142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 911/1841] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:06.179513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587439c7-06c5-4cce-aa78-4b389ac5b267 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:06.195580 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812 admin admin] The token cache is being invalidate because project a3b424cb9922448184bdb0b07e33ddba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:06.196351 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:06.199248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4c6a5e72-5dd3-4f3b-a4ee-5fc96577d812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:06.206758 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 931/1842] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:05 2022] DELETE /identity/v3/projects/a3b424cb9922448184bdb0b07e33ddba => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:06.211530 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1243f54-9b00-4573-89eb-d25f748f5a3b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:06.213703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1243f54-9b00-4573-89eb-d25f748f5a3b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:06.214670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1243f54-9b00-4573-89eb-d25f748f5a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:06.228464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587439c7-06c5-4cce-aa78-4b389ac5b267 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:06.298821 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-d1243f54-9b00-4573-89eb-d25f748f5a3b None None] MFA Rules not processed for user `867b83a9c63d41af9bf0ff874bcb567f`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:06.300423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d1243f54-9b00-4573-89eb-d25f748f5a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:06.394497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efa127-50e1-4749-9364-bc0040ea9533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:06.397298 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efa127-50e1-4749-9364-bc0040ea9533 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:06.398166 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efa127-50e1-4749-9364-bc0040ea9533 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:06.399084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efa127-50e1-4749-9364-bc0040ea9533 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:06.400900 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efa127-50e1-4749-9364-bc0040ea9533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:06.402701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efa127-50e1-4749-9364-bc0040ea9533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:06.409993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efa127-50e1-4749-9364-bc0040ea9533 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:06.451981 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 912/1843] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:06.455737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efa127-50e1-4749-9364-bc0040ea9533 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:06.461405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a8efa127-50e1-4749-9364-bc0040ea9533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:06.540056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 932/1844] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:06.549457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1243f54-9b00-4573-89eb-d25f748f5a3b None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:06.554272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d1243f54-9b00-4573-89eb-d25f748f5a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:06.600949 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1243f54-9b00-4573-89eb-d25f748f5a3b None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:06.641295 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10420e-d46d-4b8f-a035-19b27c721e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:06.646168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10420e-d46d-4b8f-a035-19b27c721e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:06.649532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10420e-d46d-4b8f-a035-19b27c721e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:06.651096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10420e-d46d-4b8f-a035-19b27c721e21 admin admin] PATH_INFO: `/v3/users/981638b22a1840b9adbd125f8e6d66d4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:06.657038 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10420e-d46d-4b8f-a035-19b27c721e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=981638b22a1840b9adbd125f8e6d66d4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:06.669192 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10420e-d46d-4b8f-a035-19b27c721e21 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:06.732447 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efa127-50e1-4749-9364-bc0040ea9533 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:06.746082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76033375-a6ea-484e-b80d-b57289b65717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:06.750991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76033375-a6ea-484e-b80d-b57289b65717 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:06.751359 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76033375-a6ea-484e-b80d-b57289b65717 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:06.751645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76033375-a6ea-484e-b80d-b57289b65717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:06.757905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-76033375-a6ea-484e-b80d-b57289b65717 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:06.840909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7a10420e-d46d-4b8f-a035-19b27c721e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '981638b22a1840b9adbd125f8e6d66d4'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:06.864166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7a10420e-d46d-4b8f-a035-19b27c721e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '981638b22a1840b9adbd125f8e6d66d4'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:06.864723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:06.865211 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7a10420e-d46d-4b8f-a035-19b27c721e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '981638b22a1840b9adbd125f8e6d66d4'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:06.866607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7a10420e-d46d-4b8f-a035-19b27c721e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '981638b22a1840b9adbd125f8e6d66d4'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:06.883796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7a10420e-d46d-4b8f-a035-19b27c721e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '981638b22a1840b9adbd125f8e6d66d4'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:06.900972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:06.921239 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76033375-a6ea-484e-b80d-b57289b65717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:06.935751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 933/1845] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:06 2022] DELETE /identity/v3/users/981638b22a1840b9adbd125f8e6d66d4 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:06.936992 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10420e-d46d-4b8f-a035-19b27c721e21 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:06.939591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76033375-a6ea-484e-b80d-b57289b65717 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:06.941122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7a10420e-d46d-4b8f-a035-19b27c721e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:06.977567 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 913/1846] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:06.980510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76033375-a6ea-484e-b80d-b57289b65717 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:06.985609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-76033375-a6ea-484e-b80d-b57289b65717 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:07.031241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76033375-a6ea-484e-b80d-b57289b65717 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:07.178851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10420e-d46d-4b8f-a035-19b27c721e21 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:07.202114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eef0d1-987f-40a4-b41b-e343339bc878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:07.202966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef0d1-987f-40a4-b41b-e343339bc878 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:07.203349 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef0d1-987f-40a4-b41b-e343339bc878 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:07.203571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef0d1-987f-40a4-b41b-e343339bc878 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:07.204675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eef0d1-987f-40a4-b41b-e343339bc878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:07.212842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eef0d1-987f-40a4-b41b-e343339bc878 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:07.225084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5d2c8-14b1-4a2e-a9c3-38ee92cdcf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:07.226760 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d2c8-14b1-4a2e-a9c3-38ee92cdcf8d admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:07.227278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d2c8-14b1-4a2e-a9c3-38ee92cdcf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:07.227757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d2c8-14b1-4a2e-a9c3-38ee92cdcf8d admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:07.229367 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5d2c8-14b1-4a2e-a9c3-38ee92cdcf8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:07.232878 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5d2c8-14b1-4a2e-a9c3-38ee92cdcf8d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:07.267658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 934/1847] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:06 2022] POST /identity/v3/projects => generated 367 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:07.272054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eef0d1-987f-40a4-b41b-e343339bc878 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:07.276964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c1eef0d1-987f-40a4-b41b-e343339bc878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:07.281403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 914/1848] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:06 2022] POST /identity/v3/projects => generated 377 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:07.283238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5d2c8-14b1-4a2e-a9c3-38ee92cdcf8d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:07.423127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5d2c8-14b1-4a2e-a9c3-38ee92cdcf8d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:07.429872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748ce90-d1fb-4c27-82cd-6432b5f4b86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:07.430805 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748ce90-d1fb-4c27-82cd-6432b5f4b86a admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:07.431190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748ce90-d1fb-4c27-82cd-6432b5f4b86a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:07.431725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748ce90-d1fb-4c27-82cd-6432b5f4b86a admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:07.432668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748ce90-d1fb-4c27-82cd-6432b5f4b86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:07.435162 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748ce90-d1fb-4c27-82cd-6432b5f4b86a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:07.481954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 915/1849] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:07 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:07.485132 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748ce90-d1fb-4c27-82cd-6432b5f4b86a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:07.488364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eef0d1-987f-40a4-b41b-e343339bc878 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:07.490053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2748ce90-d1fb-4c27-82cd-6432b5f4b86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:07.532239 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748ce90-d1fb-4c27-82cd-6432b5f4b86a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:07.545066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a102a-2af3-46f4-9dec-e0faaf430745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:07.547405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a102a-2af3-46f4-9dec-e0faaf430745 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:07.548471 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a102a-2af3-46f4-9dec-e0faaf430745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:07.548760 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a102a-2af3-46f4-9dec-e0faaf430745 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:07.552079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a102a-2af3-46f4-9dec-e0faaf430745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:07.555145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a102a-2af3-46f4-9dec-e0faaf430745 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:07.615243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55943e6c-d0fc-4274-ad3c-ba2bc5bc655f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:07.615758 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 916/1850] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:07 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:07.616557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55943e6c-d0fc-4274-ad3c-ba2bc5bc655f service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:07.616990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55943e6c-d0fc-4274-ad3c-ba2bc5bc655f service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:07.617278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55943e6c-d0fc-4274-ad3c-ba2bc5bc655f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:07.617868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a102a-2af3-46f4-9dec-e0faaf430745 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:07.619832 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-55943e6c-d0fc-4274-ad3c-ba2bc5bc655f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:07.649802 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a102a-2af3-46f4-9dec-e0faaf430745 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:07.669977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e407236-35ae-4669-b19e-66abfc5639ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:07.673277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e407236-35ae-4669-b19e-66abfc5639ef admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:07.674767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e407236-35ae-4669-b19e-66abfc5639ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:07.675060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e407236-35ae-4669-b19e-66abfc5639ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:07.678191 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e407236-35ae-4669-b19e-66abfc5639ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:07.681409 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e407236-35ae-4669-b19e-66abfc5639ef admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:07.726005 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 917/1851] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:07.726997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e407236-35ae-4669-b19e-66abfc5639ef admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:07.747666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:07.754580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e407236-35ae-4669-b19e-66abfc5639ef admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:07.768413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6554dc6-1806-4733-ba03-32eb010c32d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:07.770316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6554dc6-1806-4733-ba03-32eb010c32d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:07.770611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6554dc6-1806-4733-ba03-32eb010c32d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:07.772338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6554dc6-1806-4733-ba03-32eb010c32d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:07.773240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6554dc6-1806-4733-ba03-32eb010c32d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:07.778755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6554dc6-1806-4733-ba03-32eb010c32d1 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:07.785543 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55943e6c-d0fc-4274-ad3c-ba2bc5bc655f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:07.786370 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:07.787790 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55943e6c-d0fc-4274-ad3c-ba2bc5bc655f service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:07.802802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 935/1852] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:07.804217 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55943e6c-d0fc-4274-ad3c-ba2bc5bc655f service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:07.813479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 918/1853] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:07.813908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6554dc6-1806-4733-ba03-32eb010c32d1 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:07.819054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55943e6c-d0fc-4274-ad3c-ba2bc5bc655f service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:07.829214 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c67a00-7478-42e7-b030-17a47e7252eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:07.830197 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c67a00-7478-42e7-b030-17a47e7252eb admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:07.830856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c67a00-7478-42e7-b030-17a47e7252eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:07.831813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c67a00-7478-42e7-b030-17a47e7252eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:07.833196 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c67a00-7478-42e7-b030-17a47e7252eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:07.835380 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c67a00-7478-42e7-b030-17a47e7252eb admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:07.843092 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6554dc6-1806-4733-ba03-32eb010c32d1 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:07.857133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd64859-e023-4c6b-b4d3-e9e3bdcec7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:07.858050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 936/1854] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:07.858340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd64859-e023-4c6b-b4d3-e9e3bdcec7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:07.858758 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd64859-e023-4c6b-b4d3-e9e3bdcec7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:07.859097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd64859-e023-4c6b-b4d3-e9e3bdcec7a6 admin admin] PATH_INFO: `/v3/projects/827dfa5ee8204c78afb6b64076cab204/users/264c2b9ab4654605a649dae2b17a8174/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:07.861054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c67a00-7478-42e7-b030-17a47e7252eb admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:07.902292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c67a00-7478-42e7-b030-17a47e7252eb admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:07.906021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd64859-e023-4c6b-b4d3-e9e3bdcec7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827dfa5ee8204c78afb6b64076cab204, user_id=264c2b9ab4654605a649dae2b17a8174, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:07.912638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd64859-e023-4c6b-b4d3-e9e3bdcec7a6 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:07.924351 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540f258-08b9-493b-9c88-1d712e04cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:07.926240 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540f258-08b9-493b-9c88-1d712e04cd17 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:07.926647 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540f258-08b9-493b-9c88-1d712e04cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:07.926986 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540f258-08b9-493b-9c88-1d712e04cd17 admin admin] PATH_INFO: `/v3/projects/f97ee51bc3b94253b321d039762e1c52/users/a12e6dd4298a4df5bbc15369d97c51e1/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:07.947125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 919/1855] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:07 2022] PUT /identity/v3/projects/827dfa5ee8204c78afb6b64076cab204/users/264c2b9ab4654605a649dae2b17a8174/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:07.951395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd64859-e023-4c6b-b4d3-e9e3bdcec7a6 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:07.986374 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540f258-08b9-493b-9c88-1d712e04cd17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97ee51bc3b94253b321d039762e1c52, user_id=a12e6dd4298a4df5bbc15369d97c51e1, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:07.989454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540f258-08b9-493b-9c88-1d712e04cd17 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:08.027553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 937/1856] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:07 2022] PUT /identity/v3/projects/f97ee51bc3b94253b321d039762e1c52/users/a12e6dd4298a4df5bbc15369d97c51e1/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:08.040454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d46a2-82f5-4a87-8f63-49ea4e56512d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:08.041027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d46a2-82f5-4a87-8f63-49ea4e56512d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:08.041467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d46a2-82f5-4a87-8f63-49ea4e56512d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:08.083460 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd64859-e023-4c6b-b4d3-e9e3bdcec7a6 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:08.152997 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-375d46a2-82f5-4a87-8f63-49ea4e56512d None None] MFA Rules not processed for user `a12e6dd4298a4df5bbc15369d97c51e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:08.154311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-375d46a2-82f5-4a87-8f63-49ea4e56512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:08.230076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d9bc3-6742-41ea-a771-9b50d63d6778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:08.230784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9bc3-6742-41ea-a771-9b50d63d6778 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:08.231069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9bc3-6742-41ea-a771-9b50d63d6778 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:08.231352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9bc3-6742-41ea-a771-9b50d63d6778 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:08.232113 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d9bc3-6742-41ea-a771-9b50d63d6778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:08.234005 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d9bc3-6742-41ea-a771-9b50d63d6778 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:08.251934 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 920/1857] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:50:08.257351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d9bc3-6742-41ea-a771-9b50d63d6778 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:08.277085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d9bc3-6742-41ea-a771-9b50d63d6778 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:08.284066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06759a8-8e99-4c33-9e21-4d48c544fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:08.287024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06759a8-8e99-4c33-9e21-4d48c544fb94 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:08.288397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06759a8-8e99-4c33-9e21-4d48c544fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:08.292984 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06759a8-8e99-4c33-9e21-4d48c544fb94 admin admin] PATH_INFO: `/v3/projects/827dfa5ee8204c78afb6b64076cab204/users/264c2b9ab4654605a649dae2b17a8174/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:08.298429 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06759a8-8e99-4c33-9e21-4d48c544fb94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827dfa5ee8204c78afb6b64076cab204, user_id=264c2b9ab4654605a649dae2b17a8174, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:08.303316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06759a8-8e99-4c33-9e21-4d48c544fb94 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:08.335635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 921/1858] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:08 2022] PUT /identity/v3/projects/827dfa5ee8204c78afb6b64076cab204/users/264c2b9ab4654605a649dae2b17a8174/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:08.346287 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ec711-252a-4020-b981-56dd12514782 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:08.346647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ec711-252a-4020-b981-56dd12514782 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:08.346939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ec711-252a-4020-b981-56dd12514782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:08.419061 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-f63ec711-252a-4020-b981-56dd12514782 None None] MFA Rules not processed for user `264c2b9ab4654605a649dae2b17a8174`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:08.420155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-f63ec711-252a-4020-b981-56dd12514782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:08.437029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 938/1859] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:08.450353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d46a2-82f5-4a87-8f63-49ea4e56512d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:08.451597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-375d46a2-82f5-4a87-8f63-49ea4e56512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:08.671900 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d46a2-82f5-4a87-8f63-49ea4e56512d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:08.680597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:08.748929 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 922/1860] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:08.769021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a359f-e479-4e11-b1c4-7c9344424308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:08.770271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a359f-e479-4e11-b1c4-7c9344424308 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:08.770750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a359f-e479-4e11-b1c4-7c9344424308 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:08.771181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a359f-e479-4e11-b1c4-7c9344424308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:08.776800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:08.799572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ec711-252a-4020-b981-56dd12514782 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:08.821606 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ec711-252a-4020-b981-56dd12514782 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:08.830428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f0270-e052-4b48-86a2-7802a64d8d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:08.831233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0270-e052-4b48-86a2-7802a64d8d5b service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:08.831650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0270-e052-4b48-86a2-7802a64d8d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:08.831994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0270-e052-4b48-86a2-7802a64d8d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:08.841617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9f8f0270-e052-4b48-86a2-7802a64d8d5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:09.008340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a359f-e479-4e11-b1c4-7c9344424308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:09.009874 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a359f-e479-4e11-b1c4-7c9344424308 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:09.047613 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f0270-e052-4b48-86a2-7802a64d8d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:09.053416 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f0270-e052-4b48-86a2-7802a64d8d5b service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:09.065229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 939/1861] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:09.074348 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 923/1862] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:50:09.263850 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53adea-5952-4652-b711-27651f22a5f6 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:09.264161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53adea-5952-4652-b711-27651f22a5f6 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:09.264732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53adea-5952-4652-b711-27651f22a5f6 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:09.266735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 940/1863] 10.222.0.26 () {54 vars in 921 bytes} [Mon Jul 11 15:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:50:09.374245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74de068-cf88-4329-ac49-2cec66295ed4 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:09.374953 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74de068-cf88-4329-ac49-2cec66295ed4 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:09.374953 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74de068-cf88-4329-ac49-2cec66295ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:09.438450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-b74de068-cf88-4329-ac49-2cec66295ed4 None None] MFA Rules not processed for user `fa038a2e30f544aaa609d32e0e1ceaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:09.443188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b74de068-cf88-4329-ac49-2cec66295ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:09.687520 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 924/1864] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Jul 11 15:50:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:09.803521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53adea-5952-4652-b711-27651f22a5f6 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:09.805817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-bc53adea-5952-4652-b711-27651f22a5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:10.133203 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53adea-5952-4652-b711-27651f22a5f6 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:10.166609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:10.174966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:10.178494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:10.178866 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3 admin admin] PATH_INFO: `/v3/projects/bcb4d3e99110493bb1148e41baf9b1e4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:10.203297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74de068-cf88-4329-ac49-2cec66295ed4 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:10.205097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b74de068-cf88-4329-ac49-2cec66295ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:10.230920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb4d3e99110493bb1148e41baf9b1e4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:10.239722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:10.240276 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74de068-cf88-4329-ac49-2cec66295ed4 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:10.272137 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b758b31-513c-4048-914e-c15bbba961ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:10.273200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b758b31-513c-4048-914e-c15bbba961ee service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:10.273650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b758b31-513c-4048-914e-c15bbba961ee service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:10.274060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b758b31-513c-4048-914e-c15bbba961ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:10.303836 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b758b31-513c-4048-914e-c15bbba961ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:10.306022 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b758b31-513c-4048-914e-c15bbba961ee service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:10.356238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 925/1865] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:50:10.412004 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb4d3e99110493bb1148e41baf9b1e4', 'request_id': 'req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:10.430064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb4d3e99110493bb1148e41baf9b1e4', 'request_id': 'req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:10.444538 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb4d3e99110493bb1148e41baf9b1e4', 'request_id': 'req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:10.492991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3 admin admin] The token cache is being invalidate because project bcb4d3e99110493bb1148e41baf9b1e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:10.493334 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:10.496582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-cc46bfd4-7cb4-4f9e-800c-cc84801997a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:10.502720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 941/1866] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:09 2022] DELETE /identity/v3/projects/bcb4d3e99110493bb1148e41baf9b1e4 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:10.504805 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66d5f1-726e-491f-9e11-7d6ff3e8daa0 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:10.505351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66d5f1-726e-491f-9e11-7d6ff3e8daa0 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:10.505351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66d5f1-726e-491f-9e11-7d6ff3e8daa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:10.555853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-ce66d5f1-726e-491f-9e11-7d6ff3e8daa0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:10.557354 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ce66d5f1-726e-491f-9e11-7d6ff3e8daa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:10.679111 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bed03-d415-4af8-a031-f8cc8a180fbe None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:10.679404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bed03-d415-4af8-a031-f8cc8a180fbe None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:10.679707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bed03-d415-4af8-a031-f8cc8a180fbe None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:10.682899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 942/1867] 10.222.0.26 () {54 vars in 921 bytes} [Mon Jul 11 15:50:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:50:10.710567 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115d383-cc34-40c2-9f80-57195e6822ae None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:10.710903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115d383-cc34-40c2-9f80-57195e6822ae None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:10.711239 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115d383-cc34-40c2-9f80-57195e6822ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:10.733060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 926/1868] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:10.740937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd0254-b8ad-4198-a553-e0f389c6f5f3 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:10.741273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd0254-b8ad-4198-a553-e0f389c6f5f3 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:10.741554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd0254-b8ad-4198-a553-e0f389c6f5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:10.758567 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-7115d383-cc34-40c2-9f80-57195e6822ae None None] MFA Rules not processed for user `fa038a2e30f544aaa609d32e0e1ceaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:10.759892 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7115d383-cc34-40c2-9f80-57195e6822ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:10.767273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:10.780405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-71dd0254-b8ad-4198-a553-e0f389c6f5f3 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:10.785743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-71dd0254-b8ad-4198-a553-e0f389c6f5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:10.807265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 927/1869] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:10.808423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd0254-b8ad-4198-a553-e0f389c6f5f3 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:10.826150 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd0254-b8ad-4198-a553-e0f389c6f5f3 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:10.844438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762db51-2ca7-41a5-b576-615eb391c5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:10.845148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762db51-2ca7-41a5-b576-615eb391c5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:10.845433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762db51-2ca7-41a5-b576-615eb391c5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:10.845761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762db51-2ca7-41a5-b576-615eb391c5d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:10.846670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762db51-2ca7-41a5-b576-615eb391c5d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:10.847082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762db51-2ca7-41a5-b576-615eb391c5d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:10.849045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762db51-2ca7-41a5-b576-615eb391c5d2 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:10.894717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:10.913627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 928/1870] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:10.936335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762db51-2ca7-41a5-b576-615eb391c5d2 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:10.971667 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762db51-2ca7-41a5-b576-615eb391c5d2 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:10.985791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc50743-03de-4088-b8f4-ed26c590e3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:10.994112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc50743-03de-4088-b8f4-ed26c590e3eb admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:10.996853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc50743-03de-4088-b8f4-ed26c590e3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:10.997339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc50743-03de-4088-b8f4-ed26c590e3eb admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:10.998338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc50743-03de-4088-b8f4-ed26c590e3eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:11.010999 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc50743-03de-4088-b8f4-ed26c590e3eb admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:11.011225 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 943/1871] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Jul 11 15:50:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:11.054443 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115d383-cc34-40c2-9f80-57195e6822ae None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:11.057302 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7115d383-cc34-40c2-9f80-57195e6822ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:11.092221 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 929/1872] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:10 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:11.096839 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc50743-03de-4088-b8f4-ed26c590e3eb admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:11.101873 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115d383-cc34-40c2-9f80-57195e6822ae None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:11.269565 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ef2fa-7866-4581-8dfd-e3848fbad731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:11.270237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ef2fa-7866-4581-8dfd-e3848fbad731 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:11.270525 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ef2fa-7866-4581-8dfd-e3848fbad731 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:11.271003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ef2fa-7866-4581-8dfd-e3848fbad731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:11.296871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ef2fa-7866-4581-8dfd-e3848fbad731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:11.298726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ef2fa-7866-4581-8dfd-e3848fbad731 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:11.325081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc50743-03de-4088-b8f4-ed26c590e3eb admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:11.337963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 944/1873] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:50:11.345168 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1a1cb-508f-498e-b03d-875440d8442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:11.345919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1a1cb-508f-498e-b03d-875440d8442f admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:11.346269 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1a1cb-508f-498e-b03d-875440d8442f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:11.346533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1a1cb-508f-498e-b03d-875440d8442f admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:11.347351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1a1cb-508f-498e-b03d-875440d8442f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:11.349567 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1a1cb-508f-498e-b03d-875440d8442f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:11.437233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 930/1874] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:11 2022] POST /identity/v3/users => generated 294 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:50:11.441124 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ef2fa-7866-4581-8dfd-e3848fbad731 service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:11.467598 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ef2fa-7866-4581-8dfd-e3848fbad731 service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:11.495753 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0b8e0-e0db-4efc-9273-c0299b2e71fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:11.498614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0b8e0-e0db-4efc-9273-c0299b2e71fa admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:11.502360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0b8e0-e0db-4efc-9273-c0299b2e71fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:11.504037 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0b8e0-e0db-4efc-9273-c0299b2e71fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:11.505927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0b8e0-e0db-4efc-9273-c0299b2e71fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:11.511097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0b8e0-e0db-4efc-9273-c0299b2e71fa admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:11.540432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 945/1875] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:11.544461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1a1cb-508f-498e-b03d-875440d8442f admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:11.572864 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1a1cb-508f-498e-b03d-875440d8442f admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:11.587250 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b2c39-e74d-4050-b16f-8813ba7fade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:11.588425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2c39-e74d-4050-b16f-8813ba7fade3 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:11.588911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2c39-e74d-4050-b16f-8813ba7fade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:11.589632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2c39-e74d-4050-b16f-8813ba7fade3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:11.590799 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b2c39-e74d-4050-b16f-8813ba7fade3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:11.593316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b2c39-e74d-4050-b16f-8813ba7fade3 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:11.629181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0b8e0-e0db-4efc-9273-c0299b2e71fa admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:11.630394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 931/1876] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:11.644915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0b8e0-e0db-4efc-9273-c0299b2e71fa admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:11.664035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afff7ed-6b4b-4774-94ad-351f40266dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:11.666577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afff7ed-6b4b-4774-94ad-351f40266dec admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:11.667091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afff7ed-6b4b-4774-94ad-351f40266dec admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:11.667863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afff7ed-6b4b-4774-94ad-351f40266dec admin admin] PATH_INFO: `/v3/projects/812fe0b47bb64c69b0114992b7d0e84c/users/573fa58b0a3f495fa0dc1b352eedc1ad/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:11.694478 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afff7ed-6b4b-4774-94ad-351f40266dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=812fe0b47bb64c69b0114992b7d0e84c, user_id=573fa58b0a3f495fa0dc1b352eedc1ad, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:11.700258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afff7ed-6b4b-4774-94ad-351f40266dec admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:11.772884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 946/1877] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:11 2022] PUT /identity/v3/projects/812fe0b47bb64c69b0114992b7d0e84c/users/573fa58b0a3f495fa0dc1b352eedc1ad/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:11.786136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c64811-c3ea-4d23-8fb4-e0a86f3a0b74 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:11.786430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c64811-c3ea-4d23-8fb4-e0a86f3a0b74 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:11.786723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c64811-c3ea-4d23-8fb4-e0a86f3a0b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:11.881394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-b8c64811-c3ea-4d23-8fb4-e0a86f3a0b74 None None] MFA Rules not processed for user `573fa58b0a3f495fa0dc1b352eedc1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:11.881394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b8c64811-c3ea-4d23-8fb4-e0a86f3a0b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:12.084141 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 932/1878] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:12.089022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afff7ed-6b4b-4774-94ad-351f40266dec admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:12.263909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afff7ed-6b4b-4774-94ad-351f40266dec admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:12.282983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ab6fd-29bb-4f2c-bc26-0e4747e19dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:12.283437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab6fd-29bb-4f2c-bc26-0e4747e19dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:12.283758 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab6fd-29bb-4f2c-bc26-0e4747e19dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:12.284121 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab6fd-29bb-4f2c-bc26-0e4747e19dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:12.285160 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ab6fd-29bb-4f2c-bc26-0e4747e19dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:12.286819 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ab6fd-29bb-4f2c-bc26-0e4747e19dc4 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:12.347280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 947/1879] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:12 2022] POST /identity/v3/projects => generated 385 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:12.348968 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c64811-c3ea-4d23-8fb4-e0a86f3a0b74 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:12.373035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c64811-c3ea-4d23-8fb4-e0a86f3a0b74 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:12.438576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:12.506883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593955f-c49d-4280-9a03-0df501dc6eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:12.508016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593955f-c49d-4280-9a03-0df501dc6eff admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:12.508612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593955f-c49d-4280-9a03-0df501dc6eff admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:12.509148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593955f-c49d-4280-9a03-0df501dc6eff admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:12.510167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593955f-c49d-4280-9a03-0df501dc6eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:12.512587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593955f-c49d-4280-9a03-0df501dc6eff admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:12.553954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 933/1880] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:12 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:12.557652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ab6fd-29bb-4f2c-bc26-0e4747e19dc4 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:12.564697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:12.573677 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ab6fd-29bb-4f2c-bc26-0e4747e19dc4 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:12.580956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6a4fc-e669-41b4-ad92-749d10ce241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:12.581892 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6a4fc-e669-41b4-ad92-749d10ce241a admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:12.582247 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6a4fc-e669-41b4-ad92-749d10ce241a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:12.582595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6a4fc-e669-41b4-ad92-749d10ce241a admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:12.583466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6a4fc-e669-41b4-ad92-749d10ce241a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:12.585502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6a4fc-e669-41b4-ad92-749d10ce241a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:12.601758 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 948/1881] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:12.602536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593955f-c49d-4280-9a03-0df501dc6eff admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:12.614336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593955f-c49d-4280-9a03-0df501dc6eff admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:12.639385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e79d98-732c-4aef-b0f1-4e185f9efde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:12.640363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e79d98-732c-4aef-b0f1-4e185f9efde2 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:12.641436 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e79d98-732c-4aef-b0f1-4e185f9efde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:12.641436 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e79d98-732c-4aef-b0f1-4e185f9efde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:12.652583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e79d98-732c-4aef-b0f1-4e185f9efde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:12.676199 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e79d98-732c-4aef-b0f1-4e185f9efde2 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:12.721954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 934/1882] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:50:12.732608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6a4fc-e669-41b4-ad92-749d10ce241a admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:12.749002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6a4fc-e669-41b4-ad92-749d10ce241a admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:12.756032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abb6a0-b893-4fe4-9d5a-a19b498a1ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:12.757413 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb6a0-b893-4fe4-9d5a-a19b498a1ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:12.757926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb6a0-b893-4fe4-9d5a-a19b498a1ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:12.758413 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb6a0-b893-4fe4-9d5a-a19b498a1ca0 admin admin] PATH_INFO: `/v3/projects/1eaf635984764976b86e7c16900e5525/users/0f4ee2b7fe2f4af0bfcb0a3b373399a9/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:12.776480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abb6a0-b893-4fe4-9d5a-a19b498a1ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eaf635984764976b86e7c16900e5525, user_id=0f4ee2b7fe2f4af0bfcb0a3b373399a9, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:12.781691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abb6a0-b893-4fe4-9d5a-a19b498a1ca0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:12.811144 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 949/1883] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:12 2022] PUT /identity/v3/projects/1eaf635984764976b86e7c16900e5525/users/0f4ee2b7fe2f4af0bfcb0a3b373399a9/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:12.828603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f969c4-9bf7-42d3-81bc-cb39fd5f9eb5 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:12.829194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f969c4-9bf7-42d3-81bc-cb39fd5f9eb5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:12.829401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f969c4-9bf7-42d3-81bc-cb39fd5f9eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:12.874018 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-19f969c4-9bf7-42d3-81bc-cb39fd5f9eb5 None None] MFA Rules not processed for user `0f4ee2b7fe2f4af0bfcb0a3b373399a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:12.875908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-19f969c4-9bf7-42d3-81bc-cb39fd5f9eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:12.950438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 935/1884] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:12.955137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abb6a0-b893-4fe4-9d5a-a19b498a1ca0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:13.022114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abb6a0-b893-4fe4-9d5a-a19b498a1ca0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:13.027980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef8107-2565-4d37-be33-6e2bffe2802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:13.028826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef8107-2565-4d37-be33-6e2bffe2802b admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:13.029197 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef8107-2565-4d37-be33-6e2bffe2802b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:13.029498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef8107-2565-4d37-be33-6e2bffe2802b admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:13.030195 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef8107-2565-4d37-be33-6e2bffe2802b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:13.032336 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef8107-2565-4d37-be33-6e2bffe2802b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:13.059314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 950/1885] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:12 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:13.063430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f969c4-9bf7-42d3-81bc-cb39fd5f9eb5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:13.074554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f969c4-9bf7-42d3-81bc-cb39fd5f9eb5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:13.134583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b2462-0515-4802-b002-00ef7bbc23a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:13.135298 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2462-0515-4802-b002-00ef7bbc23a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:13.135581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2462-0515-4802-b002-00ef7bbc23a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:13.135857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2462-0515-4802-b002-00ef7bbc23a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:13.136598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b2462-0515-4802-b002-00ef7bbc23a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:13.138530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b2462-0515-4802-b002-00ef7bbc23a9 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:13.164267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 936/1886] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:13 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:13.165518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef8107-2565-4d37-be33-6e2bffe2802b admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:13.177554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef8107-2565-4d37-be33-6e2bffe2802b admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:13.183820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb920fc6-adba-4e8f-8506-fe0d660b15b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:13.184815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb920fc6-adba-4e8f-8506-fe0d660b15b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:13.185309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb920fc6-adba-4e8f-8506-fe0d660b15b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:13.185666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb920fc6-adba-4e8f-8506-fe0d660b15b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:13.186675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb920fc6-adba-4e8f-8506-fe0d660b15b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:13.188819 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb920fc6-adba-4e8f-8506-fe0d660b15b0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:13.201430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 951/1887] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:13.206173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b2462-0515-4802-b002-00ef7bbc23a9 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:13.219439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b2462-0515-4802-b002-00ef7bbc23a9 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:13.224158 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c82d9-9770-4e88-af2d-f25db92f60d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:13.225155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c82d9-9770-4e88-af2d-f25db92f60d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:13.225495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c82d9-9770-4e88-af2d-f25db92f60d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:13.225774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c82d9-9770-4e88-af2d-f25db92f60d2 admin admin] PATH_INFO: `/v3/projects/e282a0db2ac04fc1abe08ba3ed00ad86/users/50701b2c09f240ec8a2aa1563b7a9590/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:13.241286 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c82d9-9770-4e88-af2d-f25db92f60d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e282a0db2ac04fc1abe08ba3ed00ad86, user_id=50701b2c09f240ec8a2aa1563b7a9590, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:13.243910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c82d9-9770-4e88-af2d-f25db92f60d2 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:13.266738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 937/1888] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:13 2022] PUT /identity/v3/projects/e282a0db2ac04fc1abe08ba3ed00ad86/users/50701b2c09f240ec8a2aa1563b7a9590/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:13.270922 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb920fc6-adba-4e8f-8506-fe0d660b15b0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:13.281080 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb920fc6-adba-4e8f-8506-fe0d660b15b0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:13.338283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eff99e-8fb6-499e-9fa7-c4a66e07d597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:13.338964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eff99e-8fb6-499e-9fa7-c4a66e07d597 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:13.339250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eff99e-8fb6-499e-9fa7-c4a66e07d597 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:13.339530 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eff99e-8fb6-499e-9fa7-c4a66e07d597 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:13.340275 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eff99e-8fb6-499e-9fa7-c4a66e07d597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:13.341921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eff99e-8fb6-499e-9fa7-c4a66e07d597 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:13.352219 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 952/1889] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:13.356448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c82d9-9770-4e88-af2d-f25db92f60d2 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:13.367141 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c82d9-9770-4e88-af2d-f25db92f60d2 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:13.371597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115aba69-7741-4a62-9597-89b1d6c31dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:13.372808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aba69-7741-4a62-9597-89b1d6c31dae admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:13.373091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aba69-7741-4a62-9597-89b1d6c31dae admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:13.373362 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aba69-7741-4a62-9597-89b1d6c31dae admin admin] PATH_INFO: `/v3/projects/e282a0db2ac04fc1abe08ba3ed00ad86/users/50701b2c09f240ec8a2aa1563b7a9590/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:13.375438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115aba69-7741-4a62-9597-89b1d6c31dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e282a0db2ac04fc1abe08ba3ed00ad86, user_id=50701b2c09f240ec8a2aa1563b7a9590, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:13.378132 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115aba69-7741-4a62-9597-89b1d6c31dae admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:13.380637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:13.391372 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 938/1890] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:13 2022] PUT /identity/v3/projects/e282a0db2ac04fc1abe08ba3ed00ad86/users/50701b2c09f240ec8a2aa1563b7a9590/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:13.402504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbb5c1-be3f-49cf-8ca6-d884b4b22d49 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:13.402761 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbb5c1-be3f-49cf-8ca6-d884b4b22d49 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:13.403005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbb5c1-be3f-49cf-8ca6-d884b4b22d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:13.432641 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-d6dbb5c1-be3f-49cf-8ca6-d884b4b22d49 None None] MFA Rules not processed for user `50701b2c09f240ec8a2aa1563b7a9590`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:13.433831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d6dbb5c1-be3f-49cf-8ca6-d884b4b22d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:13.458678 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:13.505221 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 953/1891] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:13.516237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115aba69-7741-4a62-9597-89b1d6c31dae admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:13.518212 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-115aba69-7741-4a62-9597-89b1d6c31dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:13.576318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115aba69-7741-4a62-9597-89b1d6c31dae admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:13.580439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcce6c-73ab-450e-a106-6f02046e51ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:13.581115 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcce6c-73ab-450e-a106-6f02046e51ed service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:13.581403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcce6c-73ab-450e-a106-6f02046e51ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:13.581679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcce6c-73ab-450e-a106-6f02046e51ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:13.591819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcce6c-73ab-450e-a106-6f02046e51ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:13.593826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcce6c-73ab-450e-a106-6f02046e51ed service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:13.603529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 939/1892] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:14.188257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbb5c1-be3f-49cf-8ca6-d884b4b22d49 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:14.189905 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d6dbb5c1-be3f-49cf-8ca6-d884b4b22d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:14.203840 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbb5c1-be3f-49cf-8ca6-d884b4b22d49 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:14.207688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eb118-31f2-4462-b9a6-7af9e9de1a66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:14.208400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eb118-31f2-4462-b9a6-7af9e9de1a66 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:14.208681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eb118-31f2-4462-b9a6-7af9e9de1a66 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:14.208949 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eb118-31f2-4462-b9a6-7af9e9de1a66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:14.266969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922eb118-31f2-4462-b9a6-7af9e9de1a66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:14.268460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922eb118-31f2-4462-b9a6-7af9e9de1a66 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:14.278517 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 954/1893] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:15.548396 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcce6c-73ab-450e-a106-6f02046e51ed service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:15.550568 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-12dcce6c-73ab-450e-a106-6f02046e51ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:15.650164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcce6c-73ab-450e-a106-6f02046e51ed service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:15.663529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51873d42-7501-4ca6-8078-b96954279db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:15.664659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51873d42-7501-4ca6-8078-b96954279db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:15.665119 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51873d42-7501-4ca6-8078-b96954279db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:15.665743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51873d42-7501-4ca6-8078-b96954279db4 admin admin] PATH_INFO: `/v3/users/b4f06b61bf5a4999a6f73346c09b8627` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:15.667223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51873d42-7501-4ca6-8078-b96954279db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f06b61bf5a4999a6f73346c09b8627)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:15.669503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51873d42-7501-4ca6-8078-b96954279db4 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:15.788200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-51873d42-7501-4ca6-8078-b96954279db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f06b61bf5a4999a6f73346c09b8627'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:15.804803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-51873d42-7501-4ca6-8078-b96954279db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f06b61bf5a4999a6f73346c09b8627'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:15.806376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-51873d42-7501-4ca6-8078-b96954279db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f06b61bf5a4999a6f73346c09b8627'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:15.807626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-51873d42-7501-4ca6-8078-b96954279db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f06b61bf5a4999a6f73346c09b8627'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:15.819887 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-51873d42-7501-4ca6-8078-b96954279db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f06b61bf5a4999a6f73346c09b8627'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:15.860785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 940/1894] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:15 2022] DELETE /identity/v3/users/b4f06b61bf5a4999a6f73346c09b8627 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:15.866918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1ae61-2443-4665-bbba-c0e73486f2ff None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:15.866918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1ae61-2443-4665-bbba-c0e73486f2ff None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:15.870471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1ae61-2443-4665-bbba-c0e73486f2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:15.906460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-ace1ae61-2443-4665-bbba-c0e73486f2ff None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:15.907999 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ace1ae61-2443-4665-bbba-c0e73486f2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:16.005095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51873d42-7501-4ca6-8078-b96954279db4 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:16.007028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-51873d42-7501-4ca6-8078-b96954279db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:16.045963 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:16.076607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 955/1895] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:16.087676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1ae61-2443-4665-bbba-c0e73486f2ff None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:16.089367 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ace1ae61-2443-4665-bbba-c0e73486f2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:16.157904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51873d42-7501-4ca6-8078-b96954279db4 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:16.167494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f7972-9827-436e-94c0-60a7838b5e8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:16.168231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7972-9827-436e-94c0-60a7838b5e8e service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:16.168632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7972-9827-436e-94c0-60a7838b5e8e service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:16.168859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7972-9827-436e-94c0-60a7838b5e8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:16.174747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fb1f7972-9827-436e-94c0-60a7838b5e8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:16.277692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1ae61-2443-4665-bbba-c0e73486f2ff None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:16.282018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f8f08-6281-49de-9a2d-1caebd7d5985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:16.282918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f8f08-6281-49de-9a2d-1caebd7d5985 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:16.283353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f8f08-6281-49de-9a2d-1caebd7d5985 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:16.283777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f8f08-6281-49de-9a2d-1caebd7d5985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:16.314253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f8f08-6281-49de-9a2d-1caebd7d5985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:16.316108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f8f08-6281-49de-9a2d-1caebd7d5985 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:16.340272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 956/1896] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:16.359792 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f7972-9827-436e-94c0-60a7838b5e8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:16.361397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f7972-9827-436e-94c0-60a7838b5e8e service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:16.376253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 941/1897] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:50:17.288358 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f8f08-6281-49de-9a2d-1caebd7d5985 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:17.292036 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5e6f8f08-6281-49de-9a2d-1caebd7d5985 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:17.309308 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:17.326426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f8f08-6281-49de-9a2d-1caebd7d5985 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:17.350032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:17.351595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:17.353637 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:17.354120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] PATH_INFO: `/v3/projects/f0bb10440bbb415dba89fc241f4417ae` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:17.357203 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0bb10440bbb415dba89fc241f4417ae)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:17.360229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:17.525647 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0bb10440bbb415dba89fc241f4417ae', 'request_id': 'req-12067b74-a432-4a05-a5fc-da2842a6d09b'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:17.556940 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0bb10440bbb415dba89fc241f4417ae', 'request_id': 'req-12067b74-a432-4a05-a5fc-da2842a6d09b'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:17.571414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0bb10440bbb415dba89fc241f4417ae', 'request_id': 'req-12067b74-a432-4a05-a5fc-da2842a6d09b'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:17.596258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] The token cache is being invalidate because project f0bb10440bbb415dba89fc241f4417ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:17.596672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:17.597719 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:17.599870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 957/1898] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:17 2022] DELETE /identity/v3/projects/f0bb10440bbb415dba89fc241f4417ae => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:17.604336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f7972-9827-436e-94c0-60a7838b5e8e service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:17.627563 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f7972-9827-436e-94c0-60a7838b5e8e service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:17.757602 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93279f0-59bf-4bba-9031-f60e69835897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:17.758754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93279f0-59bf-4bba-9031-f60e69835897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:17.759105 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93279f0-59bf-4bba-9031-f60e69835897 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:17.759448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93279f0-59bf-4bba-9031-f60e69835897 admin admin] PATH_INFO: `/v3/users/1410aec6009f4e8d88641b0a6a73ba9a` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:17.760818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93279f0-59bf-4bba-9031-f60e69835897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1410aec6009f4e8d88641b0a6a73ba9a)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:17.762900 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93279f0-59bf-4bba-9031-f60e69835897 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:17.825414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e93279f0-59bf-4bba-9031-f60e69835897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1410aec6009f4e8d88641b0a6a73ba9a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:17.834851 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e93279f0-59bf-4bba-9031-f60e69835897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1410aec6009f4e8d88641b0a6a73ba9a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:17.835550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e93279f0-59bf-4bba-9031-f60e69835897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1410aec6009f4e8d88641b0a6a73ba9a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:17.836148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e93279f0-59bf-4bba-9031-f60e69835897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1410aec6009f4e8d88641b0a6a73ba9a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:17.844332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e93279f0-59bf-4bba-9031-f60e69835897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1410aec6009f4e8d88641b0a6a73ba9a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:17.849228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:17.864600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 942/1899] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:17 2022] DELETE /identity/v3/users/1410aec6009f4e8d88641b0a6a73ba9a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:18.154431 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:18.156609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:18.178100 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12067b74-a432-4a05-a5fc-da2842a6d09b admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:18.237728 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baedb8-2cfd-4612-97e3-a96617b0ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:18.238627 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baedb8-2cfd-4612-97e3-a96617b0ae5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:18.238874 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baedb8-2cfd-4612-97e3-a96617b0ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:18.239142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baedb8-2cfd-4612-97e3-a96617b0ae5c admin admin] PATH_INFO: `/v3/projects/0b3cafdfbcc94864a133e2f179e57a07` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:18.240497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baedb8-2cfd-4612-97e3-a96617b0ae5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3cafdfbcc94864a133e2f179e57a07)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:18.242437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baedb8-2cfd-4612-97e3-a96617b0ae5c admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:18.291765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-65baedb8-2cfd-4612-97e3-a96617b0ae5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3cafdfbcc94864a133e2f179e57a07', 'request_id': 'req-65baedb8-2cfd-4612-97e3-a96617b0ae5c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:18.298030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-65baedb8-2cfd-4612-97e3-a96617b0ae5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3cafdfbcc94864a133e2f179e57a07', 'request_id': 'req-65baedb8-2cfd-4612-97e3-a96617b0ae5c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:18.303831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-65baedb8-2cfd-4612-97e3-a96617b0ae5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3cafdfbcc94864a133e2f179e57a07', 'request_id': 'req-65baedb8-2cfd-4612-97e3-a96617b0ae5c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:18.316565 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-65baedb8-2cfd-4612-97e3-a96617b0ae5c admin admin] The token cache is being invalidate because project 0b3cafdfbcc94864a133e2f179e57a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:18.316856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-65baedb8-2cfd-4612-97e3-a96617b0ae5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:18.317516 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-65baedb8-2cfd-4612-97e3-a96617b0ae5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:18.319064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 958/1900] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:18 2022] DELETE /identity/v3/projects/0b3cafdfbcc94864a133e2f179e57a07 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:18.325186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bdf8a-6e8b-4cb7-b03e-fb5a4806cb71 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:18.325499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bdf8a-6e8b-4cb7-b03e-fb5a4806cb71 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:18.325741 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bdf8a-6e8b-4cb7-b03e-fb5a4806cb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:18.345158 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-782bdf8a-6e8b-4cb7-b03e-fb5a4806cb71 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:18.346424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-782bdf8a-6e8b-4cb7-b03e-fb5a4806cb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:18.411644 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 943/1901] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:18.420763 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530d50f-07ea-4150-841c-a156d84798bb None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:18.421052 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530d50f-07ea-4150-841c-a156d84798bb None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:18.421942 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530d50f-07ea-4150-841c-a156d84798bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:18.445893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-9530d50f-07ea-4150-841c-a156d84798bb None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:18.447129 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9530d50f-07ea-4150-841c-a156d84798bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:18.455831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 959/1902] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:18.460272 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bdf8a-6e8b-4cb7-b03e-fb5a4806cb71 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:18.470423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bdf8a-6e8b-4cb7-b03e-fb5a4806cb71 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:18.475051 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d27930-ce9a-4447-8dc7-6001cf41a052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:18.475716 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d27930-ce9a-4447-8dc7-6001cf41a052 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:18.476001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d27930-ce9a-4447-8dc7-6001cf41a052 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:18.476273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d27930-ce9a-4447-8dc7-6001cf41a052 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:18.477097 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d27930-ce9a-4447-8dc7-6001cf41a052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:18.477403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d27930-ce9a-4447-8dc7-6001cf41a052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:18.478997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d27930-ce9a-4447-8dc7-6001cf41a052 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:18.492324 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 944/1903] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:50:18.495721 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530d50f-07ea-4150-841c-a156d84798bb None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:18.508577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530d50f-07ea-4150-841c-a156d84798bb None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:18.513559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52550fd9-c633-4c4a-8b48-568c73f137d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:18.514229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52550fd9-c633-4c4a-8b48-568c73f137d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:18.514511 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52550fd9-c633-4c4a-8b48-568c73f137d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:18.514836 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52550fd9-c633-4c4a-8b48-568c73f137d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:18.516282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52550fd9-c633-4c4a-8b48-568c73f137d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:18.518224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52550fd9-c633-4c4a-8b48-568c73f137d2 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:18.528097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:18.550939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 960/1904] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:18 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:18.557838 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d27930-ce9a-4447-8dc7-6001cf41a052 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:18.568997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d27930-ce9a-4447-8dc7-6001cf41a052 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:18.633760 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807eccfe-3b37-43e8-a805-32a2e59a96bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:18.634550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eccfe-3b37-43e8-a805-32a2e59a96bc admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:18.634920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eccfe-3b37-43e8-a805-32a2e59a96bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:18.635259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eccfe-3b37-43e8-a805-32a2e59a96bc admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:18.636021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807eccfe-3b37-43e8-a805-32a2e59a96bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:18.638230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807eccfe-3b37-43e8-a805-32a2e59a96bc admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:18.662455 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 945/1905] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:18 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:18.666559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52550fd9-c633-4c4a-8b48-568c73f137d2 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:18.682968 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52550fd9-c633-4c4a-8b48-568c73f137d2 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:18.687825 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91355421-f401-45ae-8d05-6b8799470888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:18.688680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355421-f401-45ae-8d05-6b8799470888 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:18.689083 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355421-f401-45ae-8d05-6b8799470888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:18.689435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355421-f401-45ae-8d05-6b8799470888 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:18.690255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91355421-f401-45ae-8d05-6b8799470888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:18.691977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91355421-f401-45ae-8d05-6b8799470888 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:18.704947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 961/1906] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:18.710264 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807eccfe-3b37-43e8-a805-32a2e59a96bc admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:18.724547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807eccfe-3b37-43e8-a805-32a2e59a96bc admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:18.731695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4715c3-7e20-4313-baa0-baf546fc9f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:18.733133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4715c3-7e20-4313-baa0-baf546fc9f90 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:18.733506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4715c3-7e20-4313-baa0-baf546fc9f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:18.733910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4715c3-7e20-4313-baa0-baf546fc9f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:18.735259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4715c3-7e20-4313-baa0-baf546fc9f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:18.737127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4715c3-7e20-4313-baa0-baf546fc9f90 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:18.752366 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 946/1907] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:18.753192 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91355421-f401-45ae-8d05-6b8799470888 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:18.763628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91355421-f401-45ae-8d05-6b8799470888 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:18.768441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c710e-2976-4876-b856-ef4a7e769103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:18.769333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c710e-2976-4876-b856-ef4a7e769103 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:18.769616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c710e-2976-4876-b856-ef4a7e769103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:18.769889 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c710e-2976-4876-b856-ef4a7e769103 admin admin] PATH_INFO: `/v3/projects/34044a5cd3304817ad87c5fcf0725490/users/e25f6765cda949bdb7f066ce9a28851a/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:18.785615 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c710e-2976-4876-b856-ef4a7e769103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34044a5cd3304817ad87c5fcf0725490, user_id=e25f6765cda949bdb7f066ce9a28851a, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:18.788313 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c710e-2976-4876-b856-ef4a7e769103 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:18.804190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 962/1908] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:18 2022] PUT /identity/v3/projects/34044a5cd3304817ad87c5fcf0725490/users/e25f6765cda949bdb7f066ce9a28851a/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:18.814430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37236e1f-42f5-4bb3-802e-a6e73958a88d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:18.814742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37236e1f-42f5-4bb3-802e-a6e73958a88d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:18.815005 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37236e1f-42f5-4bb3-802e-a6e73958a88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:18.844598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-37236e1f-42f5-4bb3-802e-a6e73958a88d None None] MFA Rules not processed for user `e25f6765cda949bdb7f066ce9a28851a`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:18.845752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-37236e1f-42f5-4bb3-802e-a6e73958a88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:18.888472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:18.916316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 947/1909] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:21.085757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c710e-2976-4876-b856-ef4a7e769103 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:21.088067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-281c710e-2976-4876-b856-ef4a7e769103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:21.154961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c710e-2976-4876-b856-ef4a7e769103 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:21.159367 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030543ad-6846-43b3-9cd2-1764868c413c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:21.160023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030543ad-6846-43b3-9cd2-1764868c413c service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:21.160327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030543ad-6846-43b3-9cd2-1764868c413c service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:21.160604 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030543ad-6846-43b3-9cd2-1764868c413c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:21.162429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-030543ad-6846-43b3-9cd2-1764868c413c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:21.233355 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37236e1f-42f5-4bb3-802e-a6e73958a88d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:21.235048 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-37236e1f-42f5-4bb3-802e-a6e73958a88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:21.242270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030543ad-6846-43b3-9cd2-1764868c413c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:21.243742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030543ad-6846-43b3-9cd2-1764868c413c service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:21.255436 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 963/1910] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:21.312195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37236e1f-42f5-4bb3-802e-a6e73958a88d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:21.339996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9a362-d582-4f25-9c15-1151eb55885b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be29cfa76174b44b99ddaf3d293ead1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:21.339996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9a362-d582-4f25-9c15-1151eb55885b service glance] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:21.339996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9a362-d582-4f25-9c15-1151eb55885b service glance] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:21.339996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9a362-d582-4f25-9c15-1151eb55885b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:21.364789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9a362-d582-4f25-9c15-1151eb55885b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:21.367853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9a362-d582-4f25-9c15-1151eb55885b service glance] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:21.391013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 948/1911] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:23.426553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030543ad-6846-43b3-9cd2-1764868c413c service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:23.429972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-030543ad-6846-43b3-9cd2-1764868c413c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:23.508870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030543ad-6846-43b3-9cd2-1764868c413c service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:23.513547 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ebc06-6d28-4c36-92bd-2ab91dd07466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:23.514436 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ebc06-6d28-4c36-92bd-2ab91dd07466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:23.514716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ebc06-6d28-4c36-92bd-2ab91dd07466 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:23.515017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ebc06-6d28-4c36-92bd-2ab91dd07466 admin admin] PATH_INFO: `/v3/users/a12e6dd4298a4df5bbc15369d97c51e1` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:23.516595 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ebc06-6d28-4c36-92bd-2ab91dd07466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12e6dd4298a4df5bbc15369d97c51e1)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:23.518522 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ebc06-6d28-4c36-92bd-2ab91dd07466 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:23.529973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:23.566893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b95ebc06-6d28-4c36-92bd-2ab91dd07466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12e6dd4298a4df5bbc15369d97c51e1'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:23.573613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b95ebc06-6d28-4c36-92bd-2ab91dd07466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12e6dd4298a4df5bbc15369d97c51e1'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:23.574266 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b95ebc06-6d28-4c36-92bd-2ab91dd07466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12e6dd4298a4df5bbc15369d97c51e1'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:23.574863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b95ebc06-6d28-4c36-92bd-2ab91dd07466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12e6dd4298a4df5bbc15369d97c51e1'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:23.583255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b95ebc06-6d28-4c36-92bd-2ab91dd07466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12e6dd4298a4df5bbc15369d97c51e1'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:23.602191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 964/1912] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:23 2022] DELETE /identity/v3/users/a12e6dd4298a4df5bbc15369d97c51e1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:23.607028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd64485-c503-4219-b196-225cfef79889 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:23.607578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd64485-c503-4219-b196-225cfef79889 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:23.607578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd64485-c503-4219-b196-225cfef79889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:23.627239 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-6bd64485-c503-4219-b196-225cfef79889 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:23.628469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6bd64485-c503-4219-b196-225cfef79889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:23.692162 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 949/1913] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:23.702014 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ebc06-6d28-4c36-92bd-2ab91dd07466 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:23.704321 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b95ebc06-6d28-4c36-92bd-2ab91dd07466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:23.764997 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ebc06-6d28-4c36-92bd-2ab91dd07466 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:23.769674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbc643-39ba-431c-a25c-e8a2cb86de26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:23.770271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbc643-39ba-431c-a25c-e8a2cb86de26 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:23.770560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbc643-39ba-431c-a25c-e8a2cb86de26 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:23.770835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbc643-39ba-431c-a25c-e8a2cb86de26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:23.781802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbc643-39ba-431c-a25c-e8a2cb86de26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:23.783318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbc643-39ba-431c-a25c-e8a2cb86de26 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:23.794302 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 965/1914] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:24.233073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd64485-c503-4219-b196-225cfef79889 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:24.234686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6bd64485-c503-4219-b196-225cfef79889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:24.255224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd64485-c503-4219-b196-225cfef79889 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:24.264102 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f2995-6220-47be-83d2-aae6cae90530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:24.265765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f2995-6220-47be-83d2-aae6cae90530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:24.266011 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f2995-6220-47be-83d2-aae6cae90530 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:24.266479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f2995-6220-47be-83d2-aae6cae90530 admin admin] PATH_INFO: `/v3/projects/f97ee51bc3b94253b321d039762e1c52` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:24.267886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f2995-6220-47be-83d2-aae6cae90530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97ee51bc3b94253b321d039762e1c52)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:24.269913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f2995-6220-47be-83d2-aae6cae90530 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:24.325727 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-da5f2995-6220-47be-83d2-aae6cae90530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97ee51bc3b94253b321d039762e1c52', 'request_id': 'req-da5f2995-6220-47be-83d2-aae6cae90530'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:24.331337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-da5f2995-6220-47be-83d2-aae6cae90530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97ee51bc3b94253b321d039762e1c52', 'request_id': 'req-da5f2995-6220-47be-83d2-aae6cae90530'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:24.337977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-da5f2995-6220-47be-83d2-aae6cae90530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97ee51bc3b94253b321d039762e1c52', 'request_id': 'req-da5f2995-6220-47be-83d2-aae6cae90530'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:24.351000 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-da5f2995-6220-47be-83d2-aae6cae90530 admin admin] The token cache is being invalidate because project f97ee51bc3b94253b321d039762e1c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:24.351284 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-da5f2995-6220-47be-83d2-aae6cae90530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:24.351888 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-da5f2995-6220-47be-83d2-aae6cae90530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:24.353482 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 950/1915] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:24 2022] DELETE /identity/v3/projects/f97ee51bc3b94253b321d039762e1c52 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:24.358402 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af4a5-54eb-453a-90ec-188e7e1546c3 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:24.358752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af4a5-54eb-453a-90ec-188e7e1546c3 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:24.359030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af4a5-54eb-453a-90ec-188e7e1546c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:24.376812 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-ce2af4a5-54eb-453a-90ec-188e7e1546c3 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:24.378013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ce2af4a5-54eb-453a-90ec-188e7e1546c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:24.438916 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 966/1916] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:24.448068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e69924-2d54-437a-b856-6cf2cea75180 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:24.448389 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e69924-2d54-437a-b856-6cf2cea75180 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:24.448668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e69924-2d54-437a-b856-6cf2cea75180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:24.461885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:24.468913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-d9e69924-2d54-437a-b856-6cf2cea75180 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:24.470740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d9e69924-2d54-437a-b856-6cf2cea75180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:24.480709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 951/1917] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:24.485018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2af4a5-54eb-453a-90ec-188e7e1546c3 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:24.498738 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2af4a5-54eb-453a-90ec-188e7e1546c3 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:24.503996 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cedf9-383d-40e7-af32-5f51ca69637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:24.504797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cedf9-383d-40e7-af32-5f51ca69637d admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:24.505014 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cedf9-383d-40e7-af32-5f51ca69637d admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:24.506716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cedf9-383d-40e7-af32-5f51ca69637d admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:24.506716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cedf9-383d-40e7-af32-5f51ca69637d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:24.506716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cedf9-383d-40e7-af32-5f51ca69637d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:24.508122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cedf9-383d-40e7-af32-5f51ca69637d admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:24.521681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 967/1918] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:24.526076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e69924-2d54-437a-b856-6cf2cea75180 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:24.535545 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e69924-2d54-437a-b856-6cf2cea75180 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:24.540076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce110e28-effe-45a3-886f-bb61955a5ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:24.540776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce110e28-effe-45a3-886f-bb61955a5ecd admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:24.541062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce110e28-effe-45a3-886f-bb61955a5ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:24.541341 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce110e28-effe-45a3-886f-bb61955a5ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:24.542051 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce110e28-effe-45a3-886f-bb61955a5ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:24.543986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce110e28-effe-45a3-886f-bb61955a5ecd admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:24.577600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 952/1919] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:24 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:24.582211 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cedf9-383d-40e7-af32-5f51ca69637d admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:24.596790 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cedf9-383d-40e7-af32-5f51ca69637d admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:24.614030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:24.662934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca175a6-fb87-4b51-96ef-36ca9d5fa50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:24.663625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca175a6-fb87-4b51-96ef-36ca9d5fa50c admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:24.663912 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca175a6-fb87-4b51-96ef-36ca9d5fa50c admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:24.664190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca175a6-fb87-4b51-96ef-36ca9d5fa50c admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:24.664935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca175a6-fb87-4b51-96ef-36ca9d5fa50c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:24.666962 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca175a6-fb87-4b51-96ef-36ca9d5fa50c admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:24.691784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 968/1920] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:24 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:50:24.695585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce110e28-effe-45a3-886f-bb61955a5ecd admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:24.708398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce110e28-effe-45a3-886f-bb61955a5ecd admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:24.713651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e7cf-50d8-4be8-9565-18ce4dfd77bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:24.714509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e7cf-50d8-4be8-9565-18ce4dfd77bc admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:24.714806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e7cf-50d8-4be8-9565-18ce4dfd77bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:24.715077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e7cf-50d8-4be8-9565-18ce4dfd77bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:24.715829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e7cf-50d8-4be8-9565-18ce4dfd77bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:24.717488 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e7cf-50d8-4be8-9565-18ce4dfd77bc admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:24.729161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 953/1921] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:50:24.734439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca175a6-fb87-4b51-96ef-36ca9d5fa50c admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:24.746998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca175a6-fb87-4b51-96ef-36ca9d5fa50c admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:24.752534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1910f-5ef4-4dd0-bd63-af2f5089b11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:24.753212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1910f-5ef4-4dd0-bd63-af2f5089b11b admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:24.753500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1910f-5ef4-4dd0-bd63-af2f5089b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:24.754328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1910f-5ef4-4dd0-bd63-af2f5089b11b admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:24.754527 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1910f-5ef4-4dd0-bd63-af2f5089b11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:24.756172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1910f-5ef4-4dd0-bd63-af2f5089b11b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:24.770586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 969/1922] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:24.771788 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e7cf-50d8-4be8-9565-18ce4dfd77bc admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:24.784576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e7cf-50d8-4be8-9565-18ce4dfd77bc admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:24.789374 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22d0e2-a576-4467-ad65-9ee181524298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:24.790283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22d0e2-a576-4467-ad65-9ee181524298 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:24.790568 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22d0e2-a576-4467-ad65-9ee181524298 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:24.790841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22d0e2-a576-4467-ad65-9ee181524298 admin admin] PATH_INFO: `/v3/projects/fa98acc48d4240d488e7fbf3bab10c79/users/9d911e361d154e2b8af1d0ef920d8014/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:24.807752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22d0e2-a576-4467-ad65-9ee181524298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa98acc48d4240d488e7fbf3bab10c79, user_id=9d911e361d154e2b8af1d0ef920d8014, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:24.810464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22d0e2-a576-4467-ad65-9ee181524298 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:24.837814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 954/1923] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:24 2022] PUT /identity/v3/projects/fa98acc48d4240d488e7fbf3bab10c79/users/9d911e361d154e2b8af1d0ef920d8014/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:24.849389 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086be7a-f3ac-4b25-ac20-8141a109f7b6 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:24.849706 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086be7a-f3ac-4b25-ac20-8141a109f7b6 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:24.850077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086be7a-f3ac-4b25-ac20-8141a109f7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:24.881852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-d086be7a-f3ac-4b25-ac20-8141a109f7b6 None None] MFA Rules not processed for user `9d911e361d154e2b8af1d0ef920d8014`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:24.883086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d086be7a-f3ac-4b25-ac20-8141a109f7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:24.951364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 970/1924] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:24.955924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22d0e2-a576-4467-ad65-9ee181524298 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:25.019577 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22d0e2-a576-4467-ad65-9ee181524298 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:25.026021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae06706-6c3d-4b72-ba18-2c6d8fdf5adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:25.026852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae06706-6c3d-4b72-ba18-2c6d8fdf5adb admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:25.027232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae06706-6c3d-4b72-ba18-2c6d8fdf5adb admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:25.027615 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae06706-6c3d-4b72-ba18-2c6d8fdf5adb admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:25.028538 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae06706-6c3d-4b72-ba18-2c6d8fdf5adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:25.030821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae06706-6c3d-4b72-ba18-2c6d8fdf5adb admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:25.071757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 955/1925] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:24 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:25.076536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086be7a-f3ac-4b25-ac20-8141a109f7b6 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:25.093145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086be7a-f3ac-4b25-ac20-8141a109f7b6 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:25.157962 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76e8bb-e31c-40ee-85ce-e224eeb3eb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:25.158649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76e8bb-e31c-40ee-85ce-e224eeb3eb50 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:25.158964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76e8bb-e31c-40ee-85ce-e224eeb3eb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:25.159764 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76e8bb-e31c-40ee-85ce-e224eeb3eb50 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:25.160658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76e8bb-e31c-40ee-85ce-e224eeb3eb50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:25.163292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76e8bb-e31c-40ee-85ce-e224eeb3eb50 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:25.190887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 971/1926] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:25 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:25.194785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae06706-6c3d-4b72-ba18-2c6d8fdf5adb admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:25.208501 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae06706-6c3d-4b72-ba18-2c6d8fdf5adb admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:25.215004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf06c2-e5fe-4654-89c4-6a97ea396734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:25.215914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf06c2-e5fe-4654-89c4-6a97ea396734 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:25.216045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf06c2-e5fe-4654-89c4-6a97ea396734 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:25.216406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf06c2-e5fe-4654-89c4-6a97ea396734 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:25.217520 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf06c2-e5fe-4654-89c4-6a97ea396734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:25.219698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf06c2-e5fe-4654-89c4-6a97ea396734 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:25.232182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 956/1927] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:25.237794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76e8bb-e31c-40ee-85ce-e224eeb3eb50 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:25.248407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76e8bb-e31c-40ee-85ce-e224eeb3eb50 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:25.254357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e300ac-2285-4020-834f-2f319249c31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:25.255264 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e300ac-2285-4020-834f-2f319249c31f admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:25.255539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e300ac-2285-4020-834f-2f319249c31f admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:25.255828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e300ac-2285-4020-834f-2f319249c31f admin admin] PATH_INFO: `/v3/projects/16cb256edf014fc99f3f7db38fdab1ba/users/b61c91ca96214a0ba0910b098a97fa00/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:25.276165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:25.284670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e300ac-2285-4020-834f-2f319249c31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=16cb256edf014fc99f3f7db38fdab1ba, user_id=b61c91ca96214a0ba0910b098a97fa00, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:25.287423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e300ac-2285-4020-834f-2f319249c31f admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:25.306870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 972/1928] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:25 2022] PUT /identity/v3/projects/16cb256edf014fc99f3f7db38fdab1ba/users/b61c91ca96214a0ba0910b098a97fa00/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:25.310656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf06c2-e5fe-4654-89c4-6a97ea396734 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:25.322140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf06c2-e5fe-4654-89c4-6a97ea396734 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:25.392724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ce97d-6ecf-477e-8498-a35f654ad694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:25.393482 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ce97d-6ecf-477e-8498-a35f654ad694 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:25.393771 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ce97d-6ecf-477e-8498-a35f654ad694 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:25.394034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ce97d-6ecf-477e-8498-a35f654ad694 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:25.394782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ce97d-6ecf-477e-8498-a35f654ad694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:25.396454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ce97d-6ecf-477e-8498-a35f654ad694 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:25.406784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 957/1929] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:50:25.411012 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e300ac-2285-4020-834f-2f319249c31f admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:25.424172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e300ac-2285-4020-834f-2f319249c31f admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:25.432274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280b4dd-7c16-4615-918c-bae20d7a5c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:25.433638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280b4dd-7c16-4615-918c-bae20d7a5c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:25.434027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280b4dd-7c16-4615-918c-bae20d7a5c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:25.434387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280b4dd-7c16-4615-918c-bae20d7a5c71 admin admin] PATH_INFO: `/v3/projects/16cb256edf014fc99f3f7db38fdab1ba/users/b61c91ca96214a0ba0910b098a97fa00/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:25.437500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280b4dd-7c16-4615-918c-bae20d7a5c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16cb256edf014fc99f3f7db38fdab1ba, user_id=b61c91ca96214a0ba0910b098a97fa00, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:25.441310 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280b4dd-7c16-4615-918c-bae20d7a5c71 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:25.456475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 973/1930] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:25 2022] PUT /identity/v3/projects/16cb256edf014fc99f3f7db38fdab1ba/users/b61c91ca96214a0ba0910b098a97fa00/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:25.471184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ff59d-4f17-455a-98c2-5728dd1c8de0 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:25.471469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ff59d-4f17-455a-98c2-5728dd1c8de0 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:25.471744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ff59d-4f17-455a-98c2-5728dd1c8de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:25.498904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:25.502784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-fc3ff59d-4f17-455a-98c2-5728dd1c8de0 None None] MFA Rules not processed for user `b61c91ca96214a0ba0910b098a97fa00`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:25.504614 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fc3ff59d-4f17-455a-98c2-5728dd1c8de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:25.575410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 958/1931] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:27.102259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280b4dd-7c16-4615-918c-bae20d7a5c71 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:27.105092 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c280b4dd-7c16-4615-918c-bae20d7a5c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:27.143245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ff59d-4f17-455a-98c2-5728dd1c8de0 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:27.145079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fc3ff59d-4f17-455a-98c2-5728dd1c8de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:27.175871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280b4dd-7c16-4615-918c-bae20d7a5c71 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:27.180688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63193a95-735c-4191-95f5-ed2b3960fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:27.181573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63193a95-735c-4191-95f5-ed2b3960fdd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:27.181856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63193a95-735c-4191-95f5-ed2b3960fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:27.182120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63193a95-735c-4191-95f5-ed2b3960fdd6 admin admin] PATH_INFO: `/v3/users/573fa58b0a3f495fa0dc1b352eedc1ad` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:27.183361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63193a95-735c-4191-95f5-ed2b3960fdd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=573fa58b0a3f495fa0dc1b352eedc1ad)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:27.185425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63193a95-735c-4191-95f5-ed2b3960fdd6 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:27.210667 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ff59d-4f17-455a-98c2-5728dd1c8de0 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:27.215732 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851acb0-0c91-4ffc-892c-61ac0ffa7597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:27.216748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851acb0-0c91-4ffc-892c-61ac0ffa7597 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:27.217491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851acb0-0c91-4ffc-892c-61ac0ffa7597 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:27.217491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851acb0-0c91-4ffc-892c-61ac0ffa7597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:27.229445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851acb0-0c91-4ffc-892c-61ac0ffa7597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:27.231093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851acb0-0c91-4ffc-892c-61ac0ffa7597 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:27.241099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-63193a95-735c-4191-95f5-ed2b3960fdd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '573fa58b0a3f495fa0dc1b352eedc1ad'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:27.242086 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 959/1932] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:27.248680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-63193a95-735c-4191-95f5-ed2b3960fdd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '573fa58b0a3f495fa0dc1b352eedc1ad'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:27.249661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-63193a95-735c-4191-95f5-ed2b3960fdd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '573fa58b0a3f495fa0dc1b352eedc1ad'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:27.250199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-63193a95-735c-4191-95f5-ed2b3960fdd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '573fa58b0a3f495fa0dc1b352eedc1ad'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:27.257721 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-63193a95-735c-4191-95f5-ed2b3960fdd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '573fa58b0a3f495fa0dc1b352eedc1ad'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:27.275580 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 974/1933] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:27 2022] DELETE /identity/v3/users/573fa58b0a3f495fa0dc1b352eedc1ad => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:27.280579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691803fb-3acd-4faa-9e22-5a94da25079f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:27.280877 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691803fb-3acd-4faa-9e22-5a94da25079f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:27.281155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691803fb-3acd-4faa-9e22-5a94da25079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:27.298995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-691803fb-3acd-4faa-9e22-5a94da25079f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:27.300203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-691803fb-3acd-4faa-9e22-5a94da25079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:27.365547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 960/1934] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:27.374938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63193a95-735c-4191-95f5-ed2b3960fdd6 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:27.376481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-63193a95-735c-4191-95f5-ed2b3960fdd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:27.457319 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63193a95-735c-4191-95f5-ed2b3960fdd6 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:27.463611 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb9590-efcc-4bc1-81e7-e98c87e1673d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:27.464506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb9590-efcc-4bc1-81e7-e98c87e1673d service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:27.464791 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb9590-efcc-4bc1-81e7-e98c87e1673d service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:27.465063 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb9590-efcc-4bc1-81e7-e98c87e1673d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:27.476083 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb9590-efcc-4bc1-81e7-e98c87e1673d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:27.477676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb9590-efcc-4bc1-81e7-e98c87e1673d service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:27.484038 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:27.490906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 975/1935] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:27.593392 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691803fb-3acd-4faa-9e22-5a94da25079f None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:27.594920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-691803fb-3acd-4faa-9e22-5a94da25079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:27.674322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:27.718579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691803fb-3acd-4faa-9e22-5a94da25079f None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:27.726596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053c1ff-fff6-4d84-8e8b-4fac25dda763 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61c91ca96214a0ba0910b098a97fa00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16cb256edf014fc99f3f7db38fdab1ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:27.728111 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053c1ff-fff6-4d84-8e8b-4fac25dda763 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:27.728479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053c1ff-fff6-4d84-8e8b-4fac25dda763 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:27.728773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053c1ff-fff6-4d84-8e8b-4fac25dda763 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:27.729594 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053c1ff-fff6-4d84-8e8b-4fac25dda763 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:27.731163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053c1ff-fff6-4d84-8e8b-4fac25dda763 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:27.735249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053c1ff-fff6-4d84-8e8b-4fac25dda763 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:27.763640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb9590-efcc-4bc1-81e7-e98c87e1673d service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:27.777371 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 961/1936] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:27.779829 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb9590-efcc-4bc1-81e7-e98c87e1673d service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:27.785000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ef5a2-8e1a-4abe-bfc9-14d44f221af0 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61c91ca96214a0ba0910b098a97fa00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16cb256edf014fc99f3f7db38fdab1ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:27.785873 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ef5a2-8e1a-4abe-bfc9-14d44f221af0 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:27.786176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ef5a2-8e1a-4abe-bfc9-14d44f221af0 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:27.788048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ef5a2-8e1a-4abe-bfc9-14d44f221af0 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:27.788834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ef5a2-8e1a-4abe-bfc9-14d44f221af0 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:27.791964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ef5a2-8e1a-4abe-bfc9-14d44f221af0 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:27.841833 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 976/1937] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:27 2022] POST /identity/v3/projects => generated 354 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:27.843286 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053c1ff-fff6-4d84-8e8b-4fac25dda763 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:27.864104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053c1ff-fff6-4d84-8e8b-4fac25dda763 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:27.973352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab6dad-ea8b-4d2e-8ae6-184e35e9b998 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61c91ca96214a0ba0910b098a97fa00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16cb256edf014fc99f3f7db38fdab1ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:27.974817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab6dad-ea8b-4d2e-8ae6-184e35e9b998 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:27.975359 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab6dad-ea8b-4d2e-8ae6-184e35e9b998 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:27.975810 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab6dad-ea8b-4d2e-8ae6-184e35e9b998 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:27.977474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab6dad-ea8b-4d2e-8ae6-184e35e9b998 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:27.978450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab6dad-ea8b-4d2e-8ae6-184e35e9b998 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:27.980818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab6dad-ea8b-4d2e-8ae6-184e35e9b998 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:27.998087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 962/1938] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:28.115618 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ef5a2-8e1a-4abe-bfc9-14d44f221af0 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:28.130775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ef5a2-8e1a-4abe-bfc9-14d44f221af0 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:28.141558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b61c91ca96214a0ba0910b098a97fa00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16cb256edf014fc99f3f7db38fdab1ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:28.144612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:28.145524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:28.147023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] PATH_INFO: `/v3/projects/836e805af84f4549915abb9455f731dc` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:28.151366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] RBAC: Authorizing `identity:delete_project(project_id=836e805af84f4549915abb9455f731dc)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:28.153795 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:28.301110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836e805af84f4549915abb9455f731dc', 'request_id': 'req-8a2b23eb-16a4-4f8b-b606-c8f553afd357'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.315246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836e805af84f4549915abb9455f731dc', 'request_id': 'req-8a2b23eb-16a4-4f8b-b606-c8f553afd357'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.326079 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836e805af84f4549915abb9455f731dc', 'request_id': 'req-8a2b23eb-16a4-4f8b-b606-c8f553afd357'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.398279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] The token cache is being invalidate because project 836e805af84f4549915abb9455f731dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:28.406273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.408974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.419176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 977/1939] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:28 2022] DELETE /identity/v3/projects/836e805af84f4549915abb9455f731dc => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:28.578278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c071fb-cd4f-45d2-9044-6a192cd23e2f None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:28.578745 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:28.578863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c071fb-cd4f-45d2-9044-6a192cd23e2f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:28.578997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c071fb-cd4f-45d2-9044-6a192cd23e2f None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:28.580431 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:28.580589 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 963/1940] 10.222.0.26 () {54 vars in 921 bytes} [Mon Jul 11 15:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 15:50:28.596707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42309bc9-ecc9-4ee0-81d6-e580adad373f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:28.596847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42309bc9-ecc9-4ee0-81d6-e580adad373f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:28.597047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42309bc9-ecc9-4ee0-81d6-e580adad373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:28.638344 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-42309bc9-ecc9-4ee0-81d6-e580adad373f None None] MFA Rules not processed for user `fa038a2e30f544aaa609d32e0e1ceaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:28.639595 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-42309bc9-ecc9-4ee0-81d6-e580adad373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:28.705522 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b23eb-16a4-4f8b-b606-c8f553afd357 tempest-VolumeQuotaClassesTest-485134179 tempest-VolumeQuotaClassesTest-485134179-project-admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:28.712648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:28.713671 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:28.714063 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:28.714532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] PATH_INFO: `/v3/projects/812fe0b47bb64c69b0114992b7d0e84c` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:28.715996 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=812fe0b47bb64c69b0114992b7d0e84c)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:28.718997 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:28.744146 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 964/1941] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Jul 11 15:50:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:28.745521 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42309bc9-ecc9-4ee0-81d6-e580adad373f None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:28.746839 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-42309bc9-ecc9-4ee0-81d6-e580adad373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:28.762935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42309bc9-ecc9-4ee0-81d6-e580adad373f None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:28.768091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fef21-52ae-4843-8909-c9cedc73724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:28.769240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fef21-52ae-4843-8909-c9cedc73724f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:28.769640 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fef21-52ae-4843-8909-c9cedc73724f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:28.769932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fef21-52ae-4843-8909-c9cedc73724f admin admin] PATH_INFO: `/v3/users/9d911e361d154e2b8af1d0ef920d8014` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:28.771365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fef21-52ae-4843-8909-c9cedc73724f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d911e361d154e2b8af1d0ef920d8014)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:28.773624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fef21-52ae-4843-8909-c9cedc73724f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:28.782959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812fe0b47bb64c69b0114992b7d0e84c', 'request_id': 'req-f93e34d8-6266-45d5-98f7-b46843d540bd'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.793710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812fe0b47bb64c69b0114992b7d0e84c', 'request_id': 'req-f93e34d8-6266-45d5-98f7-b46843d540bd'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.803352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812fe0b47bb64c69b0114992b7d0e84c', 'request_id': 'req-f93e34d8-6266-45d5-98f7-b46843d540bd'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.805622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:28.842277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] The token cache is being invalidate because project 812fe0b47bb64c69b0114992b7d0e84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:28.842653 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.844104 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.846101 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 978/1942] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:28 2022] DELETE /identity/v3/projects/812fe0b47bb64c69b0114992b7d0e84c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:50:28.846645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:28.847993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:28.852328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5e5fef21-52ae-4843-8909-c9cedc73724f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d911e361d154e2b8af1d0ef920d8014'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.862185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5e5fef21-52ae-4843-8909-c9cedc73724f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d911e361d154e2b8af1d0ef920d8014'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.862895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5e5fef21-52ae-4843-8909-c9cedc73724f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d911e361d154e2b8af1d0ef920d8014'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.863612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5e5fef21-52ae-4843-8909-c9cedc73724f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d911e361d154e2b8af1d0ef920d8014'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.865375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:28.874295 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5e5fef21-52ae-4843-8909-c9cedc73724f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d911e361d154e2b8af1d0ef920d8014'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:28.902945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 965/1943] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:28 2022] DELETE /identity/v3/users/9d911e361d154e2b8af1d0ef920d8014 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:28.902945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fef21-52ae-4843-8909-c9cedc73724f admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:28.905017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5e5fef21-52ae-4843-8909-c9cedc73724f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:28.931205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e34d8-6266-45d5-98f7-b46843d540bd admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:28.983694 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fef21-52ae-4843-8909-c9cedc73724f admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:28.988852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382405dd-91c1-40ce-a5e4-25ce4f8ed4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:28.989739 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382405dd-91c1-40ce-a5e4-25ce4f8ed4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:28.990026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382405dd-91c1-40ce-a5e4-25ce4f8ed4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:28.990308 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382405dd-91c1-40ce-a5e4-25ce4f8ed4ca admin admin] PATH_INFO: `/v3/users/0f4ee2b7fe2f4af0bfcb0a3b373399a9` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:28.991511 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382405dd-91c1-40ce-a5e4-25ce4f8ed4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4ee2b7fe2f4af0bfcb0a3b373399a9)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:28.993505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382405dd-91c1-40ce-a5e4-25ce4f8ed4ca admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:29.001659 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2061d2-3b49-46aa-90f6-01ae36d42ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:29.002279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2061d2-3b49-46aa-90f6-01ae36d42ce8 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:29.002557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2061d2-3b49-46aa-90f6-01ae36d42ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:29.002825 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2061d2-3b49-46aa-90f6-01ae36d42ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:29.004646 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5a2061d2-3b49-46aa-90f6-01ae36d42ce8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:29.016518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2061d2-3b49-46aa-90f6-01ae36d42ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:29.018110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2061d2-3b49-46aa-90f6-01ae36d42ce8 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:29.029224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 979/1944] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:29.030538 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a2da9-c9b0-4bb4-ade1-ea9131205ef6 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:29.032129 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a2da9-c9b0-4bb4-ade1-ea9131205ef6 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:29.032518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a2da9-c9b0-4bb4-ade1-ea9131205ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:29.045558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-382405dd-91c1-40ce-a5e4-25ce4f8ed4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4ee2b7fe2f4af0bfcb0a3b373399a9'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.050887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-608a2da9-c9b0-4bb4-ade1-ea9131205ef6 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:29.052107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-608a2da9-c9b0-4bb4-ade1-ea9131205ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:29.054155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-382405dd-91c1-40ce-a5e4-25ce4f8ed4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4ee2b7fe2f4af0bfcb0a3b373399a9'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.055309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-382405dd-91c1-40ce-a5e4-25ce4f8ed4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4ee2b7fe2f4af0bfcb0a3b373399a9'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.056475 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-382405dd-91c1-40ce-a5e4-25ce4f8ed4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4ee2b7fe2f4af0bfcb0a3b373399a9'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.061480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 980/1945] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:29.069876 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-382405dd-91c1-40ce-a5e4-25ce4f8ed4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4ee2b7fe2f4af0bfcb0a3b373399a9'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.072273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a2da9-c9b0-4bb4-ade1-ea9131205ef6 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:29.073722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-608a2da9-c9b0-4bb4-ade1-ea9131205ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:29.090675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 966/1946] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:28 2022] DELETE /identity/v3/users/0f4ee2b7fe2f4af0bfcb0a3b373399a9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:29.134460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a2da9-c9b0-4bb4-ade1-ea9131205ef6 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:29.156580 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:29.229221 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3241225-1579-4fa1-b973-65405c5a85d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:29.229963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3241225-1579-4fa1-b973-65405c5a85d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:29.230241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3241225-1579-4fa1-b973-65405c5a85d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:29.230526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3241225-1579-4fa1-b973-65405c5a85d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:29.234256 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e3241225-1579-4fa1-b973-65405c5a85d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:29.312495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3241225-1579-4fa1-b973-65405c5a85d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:29.314520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3241225-1579-4fa1-b973-65405c5a85d0 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:29.328481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 981/1947] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:50:29.617923 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382405dd-91c1-40ce-a5e4-25ce4f8ed4ca admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:29.620125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-382405dd-91c1-40ce-a5e4-25ce4f8ed4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:29.634167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382405dd-91c1-40ce-a5e4-25ce4f8ed4ca admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:29.638754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:29.640235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:29.640235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:29.640235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] PATH_INFO: `/v3/projects/1eaf635984764976b86e7c16900e5525` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:29.641503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eaf635984764976b86e7c16900e5525)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:29.643431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:29.701216 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:INSERT=2,keystone:DELETE=17,keystone:SELECT=81 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:29.705660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eaf635984764976b86e7c16900e5525', 'request_id': 'req-bd0dd24b-d412-4165-b0d7-d840db685fb4'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.714929 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eaf635984764976b86e7c16900e5525', 'request_id': 'req-bd0dd24b-d412-4165-b0d7-d840db685fb4'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.723813 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eaf635984764976b86e7c16900e5525', 'request_id': 'req-bd0dd24b-d412-4165-b0d7-d840db685fb4'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.738073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] The token cache is being invalidate because project 1eaf635984764976b86e7c16900e5525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:29.738356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.738979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.741391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 967/1948] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:29 2022] DELETE /identity/v3/projects/1eaf635984764976b86e7c16900e5525 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:29.745618 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3241225-1579-4fa1-b973-65405c5a85d0 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:29.756186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3241225-1579-4fa1-b973-65405c5a85d0 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:29.788308 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:29.790315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:29.841292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72478de8-bd6b-491d-83be-f4cbfe29e338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:29.842217 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72478de8-bd6b-491d-83be-f4cbfe29e338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:29.842497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72478de8-bd6b-491d-83be-f4cbfe29e338 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:29.842803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72478de8-bd6b-491d-83be-f4cbfe29e338 admin admin] PATH_INFO: `/v3/users/50701b2c09f240ec8a2aa1563b7a9590` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:29.844226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72478de8-bd6b-491d-83be-f4cbfe29e338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50701b2c09f240ec8a2aa1563b7a9590)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:29.846179 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72478de8-bd6b-491d-83be-f4cbfe29e338 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:29.865958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dd24b-d412-4165-b0d7-d840db685fb4 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:29.872198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:29.873103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:29.873406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:29.873663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] PATH_INFO: `/v3/projects/fa98acc48d4240d488e7fbf3bab10c79` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:29.875500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa98acc48d4240d488e7fbf3bab10c79)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:29.877464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:29.902785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-72478de8-bd6b-491d-83be-f4cbfe29e338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50701b2c09f240ec8a2aa1563b7a9590'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.916276 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-72478de8-bd6b-491d-83be-f4cbfe29e338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50701b2c09f240ec8a2aa1563b7a9590'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.917229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-72478de8-bd6b-491d-83be-f4cbfe29e338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50701b2c09f240ec8a2aa1563b7a9590'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.917971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-72478de8-bd6b-491d-83be-f4cbfe29e338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50701b2c09f240ec8a2aa1563b7a9590'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.931497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-72478de8-bd6b-491d-83be-f4cbfe29e338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50701b2c09f240ec8a2aa1563b7a9590'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.941432 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa98acc48d4240d488e7fbf3bab10c79', 'request_id': 'req-8c85e74f-8f89-43de-9888-4012a34319a9'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.943094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:29.948021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa98acc48d4240d488e7fbf3bab10c79', 'request_id': 'req-8c85e74f-8f89-43de-9888-4012a34319a9'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.954184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 982/1949] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:29 2022] DELETE /identity/v3/users/50701b2c09f240ec8a2aa1563b7a9590 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:29.955144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa98acc48d4240d488e7fbf3bab10c79', 'request_id': 'req-8c85e74f-8f89-43de-9888-4012a34319a9'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.970185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] The token cache is being invalidate because project fa98acc48d4240d488e7fbf3bab10c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:29.970756 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.971414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:29.973169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 968/1950] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:29 2022] DELETE /identity/v3/projects/fa98acc48d4240d488e7fbf3bab10c79 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:50:29.977226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72478de8-bd6b-491d-83be-f4cbfe29e338 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:29.978767 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-72478de8-bd6b-491d-83be-f4cbfe29e338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:30.046053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72478de8-bd6b-491d-83be-f4cbfe29e338 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:30.051751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd5048-0fb4-4ee8-963d-bf590e897a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:30.052769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd5048-0fb4-4ee8-963d-bf590e897a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:30.053065 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd5048-0fb4-4ee8-963d-bf590e897a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:30.053343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd5048-0fb4-4ee8-963d-bf590e897a06 admin admin] PATH_INFO: `/v3/users/b61c91ca96214a0ba0910b098a97fa00` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:30.054800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd5048-0fb4-4ee8-963d-bf590e897a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b61c91ca96214a0ba0910b098a97fa00)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:30.056909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd5048-0fb4-4ee8-963d-bf590e897a06 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:30.122017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7afd5048-0fb4-4ee8-963d-bf590e897a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b61c91ca96214a0ba0910b098a97fa00'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.130191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7afd5048-0fb4-4ee8-963d-bf590e897a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b61c91ca96214a0ba0910b098a97fa00'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.130923 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7afd5048-0fb4-4ee8-963d-bf590e897a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b61c91ca96214a0ba0910b098a97fa00'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.131559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7afd5048-0fb4-4ee8-963d-bf590e897a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b61c91ca96214a0ba0910b098a97fa00'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.139370 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7afd5048-0fb4-4ee8-963d-bf590e897a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b61c91ca96214a0ba0910b098a97fa00'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.157502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 983/1951] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:29 2022] DELETE /identity/v3/users/b61c91ca96214a0ba0910b098a97fa00 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:30.342299 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:30.344506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:30.422641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85e74f-8f89-43de-9888-4012a34319a9 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:30.432792 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:30.486098 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:30.486995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:30.487272 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:30.487549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2 admin admin] PATH_INFO: `/v3/projects/e282a0db2ac04fc1abe08ba3ed00ad86` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:30.488820 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e282a0db2ac04fc1abe08ba3ed00ad86)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:30.490767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:30.532752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd5048-0fb4-4ee8-963d-bf590e897a06 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:30.534202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7afd5048-0fb4-4ee8-963d-bf590e897a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:30.551687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd5048-0fb4-4ee8-963d-bf590e897a06 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:30.558622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172182dd-951a-478c-a54c-a902c5a23320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:30.559707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172182dd-951a-478c-a54c-a902c5a23320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:30.559949 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172182dd-951a-478c-a54c-a902c5a23320 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:30.560355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172182dd-951a-478c-a54c-a902c5a23320 admin admin] PATH_INFO: `/v3/projects/16cb256edf014fc99f3f7db38fdab1ba` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:30.561810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172182dd-951a-478c-a54c-a902c5a23320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16cb256edf014fc99f3f7db38fdab1ba)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:30.563966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172182dd-951a-478c-a54c-a902c5a23320 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:30.594316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e282a0db2ac04fc1abe08ba3ed00ad86', 'request_id': 'req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.600797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e282a0db2ac04fc1abe08ba3ed00ad86', 'request_id': 'req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.607630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e282a0db2ac04fc1abe08ba3ed00ad86', 'request_id': 'req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.652568 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2 admin admin] The token cache is being invalidate because project e282a0db2ac04fc1abe08ba3ed00ad86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:30.653147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.653627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-dfb18fc5-aa8e-4ae5-b36b-d4d5ecbae9e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.655699 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 969/1952] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:30 2022] DELETE /identity/v3/projects/e282a0db2ac04fc1abe08ba3ed00ad86 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:30.657625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-172182dd-951a-478c-a54c-a902c5a23320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16cb256edf014fc99f3f7db38fdab1ba', 'request_id': 'req-172182dd-951a-478c-a54c-a902c5a23320'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.662394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f993752-e39d-449b-af3a-881963f15f82 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:30.662394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f993752-e39d-449b-af3a-881963f15f82 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:30.662571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f993752-e39d-449b-af3a-881963f15f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:30.678018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-172182dd-951a-478c-a54c-a902c5a23320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16cb256edf014fc99f3f7db38fdab1ba', 'request_id': 'req-172182dd-951a-478c-a54c-a902c5a23320'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.682217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-4f993752-e39d-449b-af3a-881963f15f82 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:30.683894 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4f993752-e39d-449b-af3a-881963f15f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:30.684954 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-172182dd-951a-478c-a54c-a902c5a23320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16cb256edf014fc99f3f7db38fdab1ba', 'request_id': 'req-172182dd-951a-478c-a54c-a902c5a23320'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.689156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:30.704149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-172182dd-951a-478c-a54c-a902c5a23320 admin admin] The token cache is being invalidate because project 16cb256edf014fc99f3f7db38fdab1ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:30.705220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-172182dd-951a-478c-a54c-a902c5a23320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.706271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-172182dd-951a-478c-a54c-a902c5a23320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:30.708572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 984/1953] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:30 2022] DELETE /identity/v3/projects/16cb256edf014fc99f3f7db38fdab1ba => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:50:30.714921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab82c8-4a47-41fa-b242-27ece82db1e6 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:30.716520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab82c8-4a47-41fa-b242-27ece82db1e6 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:30.716950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab82c8-4a47-41fa-b242-27ece82db1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:30.745597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-7bab82c8-4a47-41fa-b242-27ece82db1e6 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:30.746824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7bab82c8-4a47-41fa-b242-27ece82db1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:30.766832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 970/1954] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:30.775338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac304200-f293-4986-baf4-d6b3bd27bab4 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:30.775975 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac304200-f293-4986-baf4-d6b3bd27bab4 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:30.776491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac304200-f293-4986-baf4-d6b3bd27bab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:30.797973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-ac304200-f293-4986-baf4-d6b3bd27bab4 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:30.799876 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ac304200-f293-4986-baf4-d6b3bd27bab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:30.809356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 971/1955] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:30.813710 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac304200-f293-4986-baf4-d6b3bd27bab4 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:30.815077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 985/1956] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:30.824273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5b7f5-245d-40bf-b352-b04cd90a0002 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:30.826636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5b7f5-245d-40bf-b352-b04cd90a0002 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:30.827022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5b7f5-245d-40bf-b352-b04cd90a0002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:30.832792 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac304200-f293-4986-baf4-d6b3bd27bab4 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:30.840089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962899-3e72-4d04-a725-a5f482d3d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:30.840849 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962899-3e72-4d04-a725-a5f482d3d215 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:30.842456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962899-3e72-4d04-a725-a5f482d3d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:30.842456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962899-3e72-4d04-a725-a5f482d3d215 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:30.842456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d962899-3e72-4d04-a725-a5f482d3d215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:30.842456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d962899-3e72-4d04-a725-a5f482d3d215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:30.844196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d962899-3e72-4d04-a725-a5f482d3d215 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:30.861183 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-e6f5b7f5-245d-40bf-b352-b04cd90a0002 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:30.862426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e6f5b7f5-245d-40bf-b352-b04cd90a0002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:30.866854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 972/1957] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:30.871651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962899-3e72-4d04-a725-a5f482d3d215 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:30.877318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 986/1958] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:30.881263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5b7f5-245d-40bf-b352-b04cd90a0002 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:30.883910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962899-3e72-4d04-a725-a5f482d3d215 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:30.890216 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aa342-36a6-4637-85dd-19f95052ac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:30.890912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aa342-36a6-4637-85dd-19f95052ac31 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:30.891196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aa342-36a6-4637-85dd-19f95052ac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:30.891474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aa342-36a6-4637-85dd-19f95052ac31 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:30.892062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5b7f5-245d-40bf-b352-b04cd90a0002 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:30.892215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2aa342-36a6-4637-85dd-19f95052ac31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:30.895211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2aa342-36a6-4637-85dd-19f95052ac31 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:30.897994 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f125ad8-20ff-4219-9f1f-04adc2f81977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:30.898781 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125ad8-20ff-4219-9f1f-04adc2f81977 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:30.899125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125ad8-20ff-4219-9f1f-04adc2f81977 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:30.899463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125ad8-20ff-4219-9f1f-04adc2f81977 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:30.900314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f125ad8-20ff-4219-9f1f-04adc2f81977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:30.900678 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f125ad8-20ff-4219-9f1f-04adc2f81977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:30.902369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f125ad8-20ff-4219-9f1f-04adc2f81977 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:30.918697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 987/1959] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:30.919860 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f125ad8-20ff-4219-9f1f-04adc2f81977 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:30.927576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 973/1960] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:30 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:30.931757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aa342-36a6-4637-85dd-19f95052ac31 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:30.933434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f125ad8-20ff-4219-9f1f-04adc2f81977 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:30.937737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:31.003776 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d30dcf-c90c-4d4b-b1c3-f500b04d427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.004327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d30dcf-c90c-4d4b-b1c3-f500b04d427c admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.004718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d30dcf-c90c-4d4b-b1c3-f500b04d427c admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.004893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d30dcf-c90c-4d4b-b1c3-f500b04d427c admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.005622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d30dcf-c90c-4d4b-b1c3-f500b04d427c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.007589 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d30dcf-c90c-4d4b-b1c3-f500b04d427c admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.021263 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aa342-36a6-4637-85dd-19f95052ac31 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.027395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17e7e4-d888-4cc9-b3ff-d8ebb82bf3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.028145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17e7e4-d888-4cc9-b3ff-d8ebb82bf3ff admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.028676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17e7e4-d888-4cc9-b3ff-d8ebb82bf3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.028995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17e7e4-d888-4cc9-b3ff-d8ebb82bf3ff admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.029868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17e7e4-d888-4cc9-b3ff-d8ebb82bf3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.032316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17e7e4-d888-4cc9-b3ff-d8ebb82bf3ff admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.043346 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 988/1961] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:30 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:31.044610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d30dcf-c90c-4d4b-b1c3-f500b04d427c admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.056795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 974/1962] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:30 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:50:31.060870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17e7e4-d888-4cc9-b3ff-d8ebb82bf3ff admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.076226 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17e7e4-d888-4cc9-b3ff-d8ebb82bf3ff admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.124195 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d30dcf-c90c-4d4b-b1c3-f500b04d427c admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.129033 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a0091-bf9f-4a30-95b9-2ea64c2fd139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.129728 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a0091-bf9f-4a30-95b9-2ea64c2fd139 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.130010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a0091-bf9f-4a30-95b9-2ea64c2fd139 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.130280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a0091-bf9f-4a30-95b9-2ea64c2fd139 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.131033 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a0091-bf9f-4a30-95b9-2ea64c2fd139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.132940 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a0091-bf9f-4a30-95b9-2ea64c2fd139 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.134185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d1e06-da51-49c3-9cd8-1d605aee699d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.134863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d1e06-da51-49c3-9cd8-1d605aee699d admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.135179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d1e06-da51-49c3-9cd8-1d605aee699d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.135454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d1e06-da51-49c3-9cd8-1d605aee699d admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.136200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d1e06-da51-49c3-9cd8-1d605aee699d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.138099 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d1e06-da51-49c3-9cd8-1d605aee699d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.141030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:31.152618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 975/1963] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:50:31.153740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d1e06-da51-49c3-9cd8-1d605aee699d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.154986 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 989/1964] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:31 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:31.159355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a0091-bf9f-4a30-95b9-2ea64c2fd139 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.164148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d1e06-da51-49c3-9cd8-1d605aee699d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.169242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a0091-bf9f-4a30-95b9-2ea64c2fd139 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.169378 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b8f58-58e1-4182-895f-25c91bda423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.170059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b8f58-58e1-4182-895f-25c91bda423b admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.170345 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b8f58-58e1-4182-895f-25c91bda423b admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.170617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b8f58-58e1-4182-895f-25c91bda423b admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.171461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b8f58-58e1-4182-895f-25c91bda423b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.173269 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b8f58-58e1-4182-895f-25c91bda423b admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.175278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29ce55-4831-40cb-bb6b-cc0a847079f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.176338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29ce55-4831-40cb-bb6b-cc0a847079f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.176589 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29ce55-4831-40cb-bb6b-cc0a847079f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.176868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29ce55-4831-40cb-bb6b-cc0a847079f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.177609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29ce55-4831-40cb-bb6b-cc0a847079f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.179727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29ce55-4831-40cb-bb6b-cc0a847079f1 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.187999 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 976/1965] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:31.194902 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 990/1966] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:50:31.195012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b8f58-58e1-4182-895f-25c91bda423b admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.201326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29ce55-4831-40cb-bb6b-cc0a847079f1 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.203870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b8f58-58e1-4182-895f-25c91bda423b admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.209933 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878fe67-d4fc-4273-b090-4a56337f346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.210832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878fe67-d4fc-4273-b090-4a56337f346c admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.211111 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878fe67-d4fc-4273-b090-4a56337f346c admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.211382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878fe67-d4fc-4273-b090-4a56337f346c admin admin] PATH_INFO: `/v3/projects/5d8173e489914924a5a1f5731acc4a5a/users/27d8622feac946b79484495985fcdf40/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.211753 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29ce55-4831-40cb-bb6b-cc0a847079f1 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.216339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaeba75-6f3d-4e0d-820a-4273a9e62da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.217042 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaeba75-6f3d-4e0d-820a-4273a9e62da6 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.217326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaeba75-6f3d-4e0d-820a-4273a9e62da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.217602 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaeba75-6f3d-4e0d-820a-4273a9e62da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.218336 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaeba75-6f3d-4e0d-820a-4273a9e62da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.219944 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaeba75-6f3d-4e0d-820a-4273a9e62da6 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.228906 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878fe67-d4fc-4273-b090-4a56337f346c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8173e489914924a5a1f5731acc4a5a, user_id=27d8622feac946b79484495985fcdf40, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.231803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878fe67-d4fc-4273-b090-4a56337f346c admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.231921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 991/1967] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:31.236431 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaeba75-6f3d-4e0d-820a-4273a9e62da6 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.247977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaeba75-6f3d-4e0d-820a-4273a9e62da6 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.251656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 977/1968] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:31 2022] PUT /identity/v3/projects/5d8173e489914924a5a1f5731acc4a5a/users/27d8622feac946b79484495985fcdf40/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:31.264108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68f28f-7097-4172-b96b-5ff85a2116e3 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.264426 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68f28f-7097-4172-b96b-5ff85a2116e3 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.264785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68f28f-7097-4172-b96b-5ff85a2116e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.290819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-fc68f28f-7097-4172-b96b-5ff85a2116e3 None None] MFA Rules not processed for user `27d8622feac946b79484495985fcdf40`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:31.292057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fc68f28f-7097-4172-b96b-5ff85a2116e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:31.313165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0550c-3551-499d-9f36-ba16d2f44438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.314069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0550c-3551-499d-9f36-ba16d2f44438 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.314350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0550c-3551-499d-9f36-ba16d2f44438 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.314633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0550c-3551-499d-9f36-ba16d2f44438 admin admin] PATH_INFO: `/v3/projects/0d668d40627c4c7c87bd3f0ad4f4c6e3/users/53eecb24830f4140ad2af4905b700986/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.331415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0550c-3551-499d-9f36-ba16d2f44438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d668d40627c4c7c87bd3f0ad4f4c6e3, user_id=53eecb24830f4140ad2af4905b700986, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.334062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:31.335128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0550c-3551-499d-9f36-ba16d2f44438 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.349614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 992/1969] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:31 2022] PUT /identity/v3/projects/0d668d40627c4c7c87bd3f0ad4f4c6e3/users/53eecb24830f4140ad2af4905b700986/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:31.359954 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92e26-ae6c-4116-94e7-fe903e8c8075 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.360110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 978/1970] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:31.360317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92e26-ae6c-4116-94e7-fe903e8c8075 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.360613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92e26-ae6c-4116-94e7-fe903e8c8075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.364340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68f28f-7097-4172-b96b-5ff85a2116e3 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.374759 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68f28f-7097-4172-b96b-5ff85a2116e3 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.386579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-f7e92e26-ae6c-4116-94e7-fe903e8c8075 None None] MFA Rules not processed for user `53eecb24830f4140ad2af4905b700986`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:31.387846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f7e92e26-ae6c-4116-94e7-fe903e8c8075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:31.434153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9ce64-e966-4bf0-bfe1-bdaa5e154242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.434855 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9ce64-e966-4bf0-bfe1-bdaa5e154242 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.435139 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9ce64-e966-4bf0-bfe1-bdaa5e154242 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.435467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9ce64-e966-4bf0-bfe1-bdaa5e154242 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.436271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9ce64-e966-4bf0-bfe1-bdaa5e154242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.438588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9ce64-e966-4bf0-bfe1-bdaa5e154242 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.464839 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 993/1971] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:31.469433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 979/1972] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:31 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:50:31.473081 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e92e26-ae6c-4116-94e7-fe903e8c8075 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.476698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9ce64-e966-4bf0-bfe1-bdaa5e154242 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.478369 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-95b9ce64-e966-4bf0-bfe1-bdaa5e154242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:31.485299 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e92e26-ae6c-4116-94e7-fe903e8c8075 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.529585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:31.538032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9ce64-e966-4bf0-bfe1-bdaa5e154242 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.541931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a7cb5-9d66-4ca1-a5f3-f13c95d88b78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.542581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a7cb5-9d66-4ca1-a5f3-f13c95d88b78 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.542863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a7cb5-9d66-4ca1-a5f3-f13c95d88b78 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.543134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a7cb5-9d66-4ca1-a5f3-f13c95d88b78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.549433 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5eba78-d603-4319-b81c-ad9f92dff20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.550121 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5eba78-d603-4319-b81c-ad9f92dff20d admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.550438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5eba78-d603-4319-b81c-ad9f92dff20d admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.550737 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5eba78-d603-4319-b81c-ad9f92dff20d admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.551457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5eba78-d603-4319-b81c-ad9f92dff20d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.553456 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5eba78-d603-4319-b81c-ad9f92dff20d admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.577007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 994/1973] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:31 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:31.583163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5eba78-d603-4319-b81c-ad9f92dff20d admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.597297 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5eba78-d603-4319-b81c-ad9f92dff20d admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.602789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a2a46-469a-43eb-8551-8ac5517331b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.603481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a2a46-469a-43eb-8551-8ac5517331b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.603768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a2a46-469a-43eb-8551-8ac5517331b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.604047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a2a46-469a-43eb-8551-8ac5517331b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.604888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a2a46-469a-43eb-8551-8ac5517331b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.606580 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a2a46-469a-43eb-8551-8ac5517331b9 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.617985 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 995/1974] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:50:31.620438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a7cb5-9d66-4ca1-a5f3-f13c95d88b78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.621499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a2a46-469a-43eb-8551-8ac5517331b9 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.621891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a7cb5-9d66-4ca1-a5f3-f13c95d88b78 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.632423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a2a46-469a-43eb-8551-8ac5517331b9 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.632571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 980/1975] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:50:31.637789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb11039-462e-4eb6-b540-5644a474a0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.639280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb11039-462e-4eb6-b540-5644a474a0f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.639280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb11039-462e-4eb6-b540-5644a474a0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.644580 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb11039-462e-4eb6-b540-5644a474a0f6 admin admin] PATH_INFO: `/v3/projects/eef07805691f4faa8120d3c97bf4dade/users/9d230cc6af234ae28f70bee0e235112f/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.652031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a7cb5-9d66-4ca1-a5f3-f13c95d88b78 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.663033 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb11039-462e-4eb6-b540-5644a474a0f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef07805691f4faa8120d3c97bf4dade, user_id=9d230cc6af234ae28f70bee0e235112f, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.663253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a7cb5-9d66-4ca1-a5f3-f13c95d88b78 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.665819 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb11039-462e-4eb6-b540-5644a474a0f6 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.667955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae37eb3-c791-4c0d-a243-a0f71d4d030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.668737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae37eb3-c791-4c0d-a243-a0f71d4d030d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.669014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae37eb3-c791-4c0d-a243-a0f71d4d030d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.669283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae37eb3-c791-4c0d-a243-a0f71d4d030d admin admin] PATH_INFO: `/v3/users/53eecb24830f4140ad2af4905b700986` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.670475 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae37eb3-c791-4c0d-a243-a0f71d4d030d admin admin] RBAC: Authorizing `identity:delete_user(user_id=53eecb24830f4140ad2af4905b700986)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.672575 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae37eb3-c791-4c0d-a243-a0f71d4d030d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.680179 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 996/1976] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:31 2022] PUT /identity/v3/projects/eef07805691f4faa8120d3c97bf4dade/users/9d230cc6af234ae28f70bee0e235112f/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:31.683800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb11039-462e-4eb6-b540-5644a474a0f6 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.691118 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:31.738580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4ae37eb3-c791-4c0d-a243-a0f71d4d030d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53eecb24830f4140ad2af4905b700986'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:31.746960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4ae37eb3-c791-4c0d-a243-a0f71d4d030d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53eecb24830f4140ad2af4905b700986'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:31.747954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4ae37eb3-c791-4c0d-a243-a0f71d4d030d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53eecb24830f4140ad2af4905b700986'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:31.748671 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4ae37eb3-c791-4c0d-a243-a0f71d4d030d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53eecb24830f4140ad2af4905b700986'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:31.756835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb11039-462e-4eb6-b540-5644a474a0f6 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.758973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4ae37eb3-c791-4c0d-a243-a0f71d4d030d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53eecb24830f4140ad2af4905b700986'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:31.762219 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55edcf-c821-4dc6-9c1c-ffa4dc40598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.763528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55edcf-c821-4dc6-9c1c-ffa4dc40598e admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.763810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55edcf-c821-4dc6-9c1c-ffa4dc40598e admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.764082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55edcf-c821-4dc6-9c1c-ffa4dc40598e admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.764978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55edcf-c821-4dc6-9c1c-ffa4dc40598e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.767207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55edcf-c821-4dc6-9c1c-ffa4dc40598e admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.781130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 981/1977] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:31 2022] DELETE /identity/v3/users/53eecb24830f4140ad2af4905b700986 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:50:31.784471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 997/1978] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:31.786076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55edcf-c821-4dc6-9c1c-ffa4dc40598e admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.787636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc42da-72eb-434f-941c-0861f061f45d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.787987 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc42da-72eb-434f-941c-0861f061f45d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.788271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc42da-72eb-434f-941c-0861f061f45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.788810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4b55edcf-c821-4dc6-9c1c-ffa4dc40598e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:31.804917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55edcf-c821-4dc6-9c1c-ffa4dc40598e admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:31.809682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-31bc42da-72eb-434f-941c-0861f061f45d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:31.811379 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-31bc42da-72eb-434f-941c-0861f061f45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:31.913403 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e6cb3-45f3-416a-9fc8-c2ea6c5ed145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:31.914338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e6cb3-45f3-416a-9fc8-c2ea6c5ed145 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.914626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e6cb3-45f3-416a-9fc8-c2ea6c5ed145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.914908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e6cb3-45f3-416a-9fc8-c2ea6c5ed145 admin admin] PATH_INFO: `/v3/projects/eef07805691f4faa8120d3c97bf4dade/users/9d230cc6af234ae28f70bee0e235112f/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:31.931578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 982/1979] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:31.932989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e6cb3-45f3-416a-9fc8-c2ea6c5ed145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef07805691f4faa8120d3c97bf4dade, user_id=9d230cc6af234ae28f70bee0e235112f, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:31.937425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e6cb3-45f3-416a-9fc8-c2ea6c5ed145 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:31.944170 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc42da-72eb-434f-941c-0861f061f45d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:31.945840 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-31bc42da-72eb-434f-941c-0861f061f45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:31.969769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 998/1980] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:31 2022] PUT /identity/v3/projects/eef07805691f4faa8120d3c97bf4dade/users/9d230cc6af234ae28f70bee0e235112f/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:31.973075 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a68b20-f4cf-4434-9f61-2559338cb75b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:31.973578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a68b20-f4cf-4434-9f61-2559338cb75b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:31.973925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a68b20-f4cf-4434-9f61-2559338cb75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:32.009254 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-b4a68b20-f4cf-4434-9f61-2559338cb75b None None] MFA Rules not processed for user `9d230cc6af234ae28f70bee0e235112f`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:32.010647 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b4a68b20-f4cf-4434-9f61-2559338cb75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:32.012675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc42da-72eb-434f-941c-0861f061f45d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:32.027043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:32.074420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7e9a5-b1e1-404c-b48d-5423200530ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:32.075080 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7e9a5-b1e1-404c-b48d-5423200530ed service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:32.075364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7e9a5-b1e1-404c-b48d-5423200530ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:32.075641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7e9a5-b1e1-404c-b48d-5423200530ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:32.081698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:32.095532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 999/1981] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:32.103643 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a68b20-f4cf-4434-9f61-2559338cb75b None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:32.105124 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b4a68b20-f4cf-4434-9f61-2559338cb75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:32.169521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a68b20-f4cf-4434-9f61-2559338cb75b None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:32.173740 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1d0da-e134-4b21-8ea0-ee3459eb4ab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:32.174410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1d0da-e134-4b21-8ea0-ee3459eb4ab5 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:32.174732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1d0da-e134-4b21-8ea0-ee3459eb4ab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:32.174951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1d0da-e134-4b21-8ea0-ee3459eb4ab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:32.186592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1d0da-e134-4b21-8ea0-ee3459eb4ab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:32.188058 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1d0da-e134-4b21-8ea0-ee3459eb4ab5 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:32.193370 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7e9a5-b1e1-404c-b48d-5423200530ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:32.195555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7e9a5-b1e1-404c-b48d-5423200530ed service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:32.229606 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1000/1982] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:50:32.235176 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 983/1983] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:32.353706 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1d0da-e134-4b21-8ea0-ee3459eb4ab5 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:32.355495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b7e1d0da-e134-4b21-8ea0-ee3459eb4ab5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:32.369821 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1d0da-e134-4b21-8ea0-ee3459eb4ab5 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:32.374474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b8276-9358-4357-b919-bbb5adfffd8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:32.375672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b8276-9358-4357-b919-bbb5adfffd8d service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:32.376552 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b8276-9358-4357-b919-bbb5adfffd8d service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:32.377065 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b8276-9358-4357-b919-bbb5adfffd8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:32.380541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-030b8276-9358-4357-b919-bbb5adfffd8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:32.475909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b8276-9358-4357-b919-bbb5adfffd8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:32.478505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b8276-9358-4357-b919-bbb5adfffd8d service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:32.491541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1001/1984] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:32.891109 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7e9a5-b1e1-404c-b48d-5423200530ed service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:32.892720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-26d7e9a5-b1e1-404c-b48d-5423200530ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:32.910991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7e9a5-b1e1-404c-b48d-5423200530ed service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:32.916672 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:32.917841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:32.918289 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:32.918570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3 admin admin] PATH_INFO: `/v3/projects/0d668d40627c4c7c87bd3f0ad4f4c6e3` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:32.919902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d668d40627c4c7c87bd3f0ad4f4c6e3)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:32.922178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:32.972866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d668d40627c4c7c87bd3f0ad4f4c6e3', 'request_id': 'req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:32.979102 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d668d40627c4c7c87bd3f0ad4f4c6e3', 'request_id': 'req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:32.987900 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d668d40627c4c7c87bd3f0ad4f4c6e3', 'request_id': 'req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:33.001969 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3 admin admin] The token cache is being invalidate because project 0d668d40627c4c7c87bd3f0ad4f4c6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:33.002363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:33.003042 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f6c87ab0-e765-4566-84e4-a8bd03ddcea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:33.004748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 984/1985] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:32 2022] DELETE /identity/v3/projects/0d668d40627c4c7c87bd3f0ad4f4c6e3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:33.009703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba6c35-04f0-4520-b69e-1c71466004aa None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:33.009989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba6c35-04f0-4520-b69e-1c71466004aa None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:33.010272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba6c35-04f0-4520-b69e-1c71466004aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:33.028556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-bfba6c35-04f0-4520-b69e-1c71466004aa None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:33.029743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-bfba6c35-04f0-4520-b69e-1c71466004aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:33.076975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:33.091453 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1002/1986] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:33.099437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664654f-1ad1-47d2-8118-f92f61e8ec04 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:33.099794 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664654f-1ad1-47d2-8118-f92f61e8ec04 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:33.100144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664654f-1ad1-47d2-8118-f92f61e8ec04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:33.119128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-3664654f-1ad1-47d2-8118-f92f61e8ec04 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:33.120583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3664654f-1ad1-47d2-8118-f92f61e8ec04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:33.129040 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 985/1987] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:33.133585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba6c35-04f0-4520-b69e-1c71466004aa None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:33.144788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba6c35-04f0-4520-b69e-1c71466004aa None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:33.150883 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624c20f-98c3-4d96-9f2c-c7db0194505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:33.152073 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624c20f-98c3-4d96-9f2c-c7db0194505a admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:33.152475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624c20f-98c3-4d96-9f2c-c7db0194505a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:33.152754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624c20f-98c3-4d96-9f2c-c7db0194505a admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:33.153496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624c20f-98c3-4d96-9f2c-c7db0194505a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:33.153807 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624c20f-98c3-4d96-9f2c-c7db0194505a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:33.155528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624c20f-98c3-4d96-9f2c-c7db0194505a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:33.167640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1003/1988] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:33.172376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664654f-1ad1-47d2-8118-f92f61e8ec04 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:33.181976 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664654f-1ad1-47d2-8118-f92f61e8ec04 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:33.196131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f60772-3c47-44f8-b95b-a71cd1255a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:33.196548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f60772-3c47-44f8-b95b-a71cd1255a51 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:33.196860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f60772-3c47-44f8-b95b-a71cd1255a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:33.197107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f60772-3c47-44f8-b95b-a71cd1255a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:33.197826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f60772-3c47-44f8-b95b-a71cd1255a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:33.199785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f60772-3c47-44f8-b95b-a71cd1255a51 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:33.229210 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 986/1989] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:33 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:33.233308 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624c20f-98c3-4d96-9f2c-c7db0194505a admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:33.243291 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624c20f-98c3-4d96-9f2c-c7db0194505a admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:33.299915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c916-12b3-4f37-af1a-7a8c2e4a1013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:33.300624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c916-12b3-4f37-af1a-7a8c2e4a1013 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:33.300908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c916-12b3-4f37-af1a-7a8c2e4a1013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:33.301185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c916-12b3-4f37-af1a-7a8c2e4a1013 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:33.301899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888c916-12b3-4f37-af1a-7a8c2e4a1013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:33.303881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888c916-12b3-4f37-af1a-7a8c2e4a1013 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:33.324403 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1004/1990] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:33 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:33.328831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f60772-3c47-44f8-b95b-a71cd1255a51 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:33.339827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f60772-3c47-44f8-b95b-a71cd1255a51 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:33.344905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90c063-1962-49d4-a964-7e384bbbafc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:33.345590 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90c063-1962-49d4-a964-7e384bbbafc8 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:33.345860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90c063-1962-49d4-a964-7e384bbbafc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:33.346203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90c063-1962-49d4-a964-7e384bbbafc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:33.346987 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90c063-1962-49d4-a964-7e384bbbafc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:33.348788 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90c063-1962-49d4-a964-7e384bbbafc8 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:33.360334 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 987/1991] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:50:33.364544 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c916-12b3-4f37-af1a-7a8c2e4a1013 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:33.375662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c916-12b3-4f37-af1a-7a8c2e4a1013 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:33.380784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243678d-48e3-46a9-a9c5-f7b640ef5966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:33.381469 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243678d-48e3-46a9-a9c5-f7b640ef5966 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:33.381767 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243678d-48e3-46a9-a9c5-f7b640ef5966 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:33.382160 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243678d-48e3-46a9-a9c5-f7b640ef5966 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:33.382951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243678d-48e3-46a9-a9c5-f7b640ef5966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:33.384934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243678d-48e3-46a9-a9c5-f7b640ef5966 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:33.397964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1005/1992] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:33.401256 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90c063-1962-49d4-a964-7e384bbbafc8 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:33.420047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90c063-1962-49d4-a964-7e384bbbafc8 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:33.432924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3d2d6-3dcb-40c8-aa39-ef8bd34893e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:33.433850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3d2d6-3dcb-40c8-aa39-ef8bd34893e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:33.434135 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3d2d6-3dcb-40c8-aa39-ef8bd34893e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:33.434411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3d2d6-3dcb-40c8-aa39-ef8bd34893e5 admin admin] PATH_INFO: `/v3/projects/5149650f11584c849e8b36f6c13f552a/users/6bd2e9e931e54ff6b33ec98aefdf698a/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:33.451461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3d2d6-3dcb-40c8-aa39-ef8bd34893e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5149650f11584c849e8b36f6c13f552a, user_id=6bd2e9e931e54ff6b33ec98aefdf698a, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:33.454429 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3d2d6-3dcb-40c8-aa39-ef8bd34893e5 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:33.470012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 988/1993] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:33 2022] PUT /identity/v3/projects/5149650f11584c849e8b36f6c13f552a/users/6bd2e9e931e54ff6b33ec98aefdf698a/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:33.480968 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cf5ed-f487-45cc-bbd8-32d895f1bb73 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:33.481183 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cf5ed-f487-45cc-bbd8-32d895f1bb73 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:33.481315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cf5ed-f487-45cc-bbd8-32d895f1bb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:33.508862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-317cf5ed-f487-45cc-bbd8-32d895f1bb73 None None] MFA Rules not processed for user `6bd2e9e931e54ff6b33ec98aefdf698a`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:33.510091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-317cf5ed-f487-45cc-bbd8-32d895f1bb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:33.651740 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1006/1994] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:33.655843 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3d2d6-3dcb-40c8-aa39-ef8bd34893e5 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:33.681643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:33.795547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3d2d6-3dcb-40c8-aa39-ef8bd34893e5 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:33.800904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591ca5e-ab6c-4e85-9624-c4fa1791eee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:33.801787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591ca5e-ab6c-4e85-9624-c4fa1791eee3 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:33.802162 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591ca5e-ab6c-4e85-9624-c4fa1791eee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:33.802674 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591ca5e-ab6c-4e85-9624-c4fa1791eee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:33.804448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591ca5e-ab6c-4e85-9624-c4fa1791eee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:33.805685 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591ca5e-ab6c-4e85-9624-c4fa1791eee3 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:33.848404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 989/1995] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:33 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:33.859848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cf5ed-f487-45cc-bbd8-32d895f1bb73 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:33.880128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cf5ed-f487-45cc-bbd8-32d895f1bb73 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:33.935000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:33.958135 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85786274-b4a7-45ae-a7b0-b91e6f9addd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:33.959035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85786274-b4a7-45ae-a7b0-b91e6f9addd5 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:33.960739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85786274-b4a7-45ae-a7b0-b91e6f9addd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:33.960739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85786274-b4a7-45ae-a7b0-b91e6f9addd5 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:33.961360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85786274-b4a7-45ae-a7b0-b91e6f9addd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:33.963660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85786274-b4a7-45ae-a7b0-b91e6f9addd5 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:33.985684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1007/1996] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:33 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:33.989884 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591ca5e-ab6c-4e85-9624-c4fa1791eee3 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:34.008000 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591ca5e-ab6c-4e85-9624-c4fa1791eee3 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:34.015171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71496f-f8c3-4e36-a824-1db160617640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:34.015642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71496f-f8c3-4e36-a824-1db160617640 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:34.016017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71496f-f8c3-4e36-a824-1db160617640 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:34.016471 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71496f-f8c3-4e36-a824-1db160617640 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:34.017344 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71496f-f8c3-4e36-a824-1db160617640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:34.019174 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71496f-f8c3-4e36-a824-1db160617640 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:34.038359 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 990/1997] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:50:34.039570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85786274-b4a7-45ae-a7b0-b91e6f9addd5 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:34.052367 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85786274-b4a7-45ae-a7b0-b91e6f9addd5 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:34.058637 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e649b3-e4ea-4eb5-96c4-89b200732af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:34.059426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e649b3-e4ea-4eb5-96c4-89b200732af6 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:34.061794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e649b3-e4ea-4eb5-96c4-89b200732af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:34.062230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e649b3-e4ea-4eb5-96c4-89b200732af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:34.063246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e649b3-e4ea-4eb5-96c4-89b200732af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:34.065884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e649b3-e4ea-4eb5-96c4-89b200732af6 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:34.085343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1008/1998] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:34.089498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71496f-f8c3-4e36-a824-1db160617640 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:34.099693 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71496f-f8c3-4e36-a824-1db160617640 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:34.104461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f6668-f254-4512-9cb9-c5c9d2f15788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:34.105353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f6668-f254-4512-9cb9-c5c9d2f15788 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:34.105634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f6668-f254-4512-9cb9-c5c9d2f15788 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:34.105909 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f6668-f254-4512-9cb9-c5c9d2f15788 admin admin] PATH_INFO: `/v3/projects/5a83b93871d8456eb4845b332d051e87/users/b9bd0a05db094f6298a0eb0348ad0748/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:34.121039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f6668-f254-4512-9cb9-c5c9d2f15788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a83b93871d8456eb4845b332d051e87, user_id=b9bd0a05db094f6298a0eb0348ad0748, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:34.124131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f6668-f254-4512-9cb9-c5c9d2f15788 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:34.138388 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 991/1999] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:34 2022] PUT /identity/v3/projects/5a83b93871d8456eb4845b332d051e87/users/b9bd0a05db094f6298a0eb0348ad0748/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:50:34.151526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a671ae-8346-472e-9a26-8a54622eaed5 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:34.151526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a671ae-8346-472e-9a26-8a54622eaed5 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:34.151526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a671ae-8346-472e-9a26-8a54622eaed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:34.195192 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-55a671ae-8346-472e-9a26-8a54622eaed5 None None] MFA Rules not processed for user `b9bd0a05db094f6298a0eb0348ad0748`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:34.196543 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-55a671ae-8346-472e-9a26-8a54622eaed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:34.272006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1009/2000] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:34.273226 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f6668-f254-4512-9cb9-c5c9d2f15788 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:34.338983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f6668-f254-4512-9cb9-c5c9d2f15788 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:34.343964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f2d00-c7a9-4f97-ba3d-d4b929372fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:34.344676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2d00-c7a9-4f97-ba3d-d4b929372fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:34.344959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2d00-c7a9-4f97-ba3d-d4b929372fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:34.345237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2d00-c7a9-4f97-ba3d-d4b929372fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:34.345943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f2d00-c7a9-4f97-ba3d-d4b929372fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:34.347875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f2d00-c7a9-4f97-ba3d-d4b929372fd4 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:34.375119 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 992/2001] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:34 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:34.377522 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a671ae-8346-472e-9a26-8a54622eaed5 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:34.390634 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a671ae-8346-472e-9a26-8a54622eaed5 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:34.452732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4319281-d3d5-4e37-ab3e-ce189db66bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:34.453126 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4319281-d3d5-4e37-ab3e-ce189db66bdf admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:34.453435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4319281-d3d5-4e37-ab3e-ce189db66bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:34.453697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4319281-d3d5-4e37-ab3e-ce189db66bdf admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:34.454397 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4319281-d3d5-4e37-ab3e-ce189db66bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:34.456420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4319281-d3d5-4e37-ab3e-ce189db66bdf admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:34.479307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1010/2002] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:34 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:34.483439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f2d00-c7a9-4f97-ba3d-d4b929372fd4 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:34.496800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f2d00-c7a9-4f97-ba3d-d4b929372fd4 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:34.503501 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af27df-f714-445e-8bb0-0ce70f06e4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:34.504172 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af27df-f714-445e-8bb0-0ce70f06e4de admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:34.504492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af27df-f714-445e-8bb0-0ce70f06e4de admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:34.504766 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af27df-f714-445e-8bb0-0ce70f06e4de admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:34.505537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af27df-f714-445e-8bb0-0ce70f06e4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:34.507166 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af27df-f714-445e-8bb0-0ce70f06e4de admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:34.519623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 993/2003] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:34.524661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4319281-d3d5-4e37-ab3e-ce189db66bdf admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:34.538763 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4319281-d3d5-4e37-ab3e-ce189db66bdf admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:34.544145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa3607-dd5a-410f-a10b-5430d78401fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:34.545102 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa3607-dd5a-410f-a10b-5430d78401fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:34.545388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa3607-dd5a-410f-a10b-5430d78401fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:34.545663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa3607-dd5a-410f-a10b-5430d78401fa admin admin] PATH_INFO: `/v3/projects/eb7fa499fc0344559a36685ce0812172/users/6546f315b86b40aa86168eb814d77f29/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:34.561637 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa3607-dd5a-410f-a10b-5430d78401fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7fa499fc0344559a36685ce0812172, user_id=6546f315b86b40aa86168eb814d77f29, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:34.564798 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa3607-dd5a-410f-a10b-5430d78401fa admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:34.582329 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1011/2004] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:34 2022] PUT /identity/v3/projects/eb7fa499fc0344559a36685ce0812172/users/6546f315b86b40aa86168eb814d77f29/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:34.589065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af27df-f714-445e-8bb0-0ce70f06e4de admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:34.601092 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af27df-f714-445e-8bb0-0ce70f06e4de admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:34.650009 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:34.667911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae557662-d72f-4e0a-bfa8-ab3367bbf87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:34.668629 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae557662-d72f-4e0a-bfa8-ab3367bbf87f admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:34.668907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae557662-d72f-4e0a-bfa8-ab3367bbf87f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:34.669178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae557662-d72f-4e0a-bfa8-ab3367bbf87f admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:34.669914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae557662-d72f-4e0a-bfa8-ab3367bbf87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:34.671572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae557662-d72f-4e0a-bfa8-ab3367bbf87f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:34.686323 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 994/2005] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:34.688307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa3607-dd5a-410f-a10b-5430d78401fa admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:34.699727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa3607-dd5a-410f-a10b-5430d78401fa admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:34.705420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24aad5c-1625-4d7a-9dab-43510996c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:34.706404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aad5c-1625-4d7a-9dab-43510996c03f admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:34.706720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aad5c-1625-4d7a-9dab-43510996c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:34.706963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aad5c-1625-4d7a-9dab-43510996c03f admin admin] PATH_INFO: `/v3/projects/eb7fa499fc0344559a36685ce0812172/users/6546f315b86b40aa86168eb814d77f29/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:34.709661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24aad5c-1625-4d7a-9dab-43510996c03f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7fa499fc0344559a36685ce0812172, user_id=6546f315b86b40aa86168eb814d77f29, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:34.712250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24aad5c-1625-4d7a-9dab-43510996c03f admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:34.725439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1012/2006] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:34 2022] PUT /identity/v3/projects/eb7fa499fc0344559a36685ce0812172/users/6546f315b86b40aa86168eb814d77f29/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:34.738028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b0773-87f5-4cf5-b499-e233920cc3b0 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:34.738498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b0773-87f5-4cf5-b499-e233920cc3b0 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:34.738907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b0773-87f5-4cf5-b499-e233920cc3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:34.768203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-6d1b0773-87f5-4cf5-b499-e233920cc3b0 None None] MFA Rules not processed for user `6546f315b86b40aa86168eb814d77f29`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:34.769449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6d1b0773-87f5-4cf5-b499-e233920cc3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:34.841133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 995/2007] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:34.852507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24aad5c-1625-4d7a-9dab-43510996c03f admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:34.854324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c24aad5c-1625-4d7a-9dab-43510996c03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:34.866209 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:34.918784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24aad5c-1625-4d7a-9dab-43510996c03f admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:34.923324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17658bc4-883e-4a4d-b54e-2ac745db6110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:34.923987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658bc4-883e-4a4d-b54e-2ac745db6110 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:34.924253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658bc4-883e-4a4d-b54e-2ac745db6110 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:34.924554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658bc4-883e-4a4d-b54e-2ac745db6110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:34.988350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17658bc4-883e-4a4d-b54e-2ac745db6110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:34.989815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17658bc4-883e-4a4d-b54e-2ac745db6110 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:34.999414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1013/2008] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:38.393277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b0773-87f5-4cf5-b499-e233920cc3b0 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:38.394994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6d1b0773-87f5-4cf5-b499-e233920cc3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:38.476950 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b0773-87f5-4cf5-b499-e233920cc3b0 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:38.481441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc205e-82cb-4a35-b0c3-4480a3dd8e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:38.482330 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc205e-82cb-4a35-b0c3-4480a3dd8e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:38.482609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc205e-82cb-4a35-b0c3-4480a3dd8e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:38.482879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc205e-82cb-4a35-b0c3-4480a3dd8e9a admin admin] PATH_INFO: `/v3/users/27d8622feac946b79484495985fcdf40` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:38.484153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc205e-82cb-4a35-b0c3-4480a3dd8e9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d8622feac946b79484495985fcdf40)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:38.486137 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc205e-82cb-4a35-b0c3-4480a3dd8e9a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:38.535198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d5cc205e-82cb-4a35-b0c3-4480a3dd8e9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d8622feac946b79484495985fcdf40'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:38.542612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d5cc205e-82cb-4a35-b0c3-4480a3dd8e9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d8622feac946b79484495985fcdf40'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:38.543293 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d5cc205e-82cb-4a35-b0c3-4480a3dd8e9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d8622feac946b79484495985fcdf40'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:38.543904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d5cc205e-82cb-4a35-b0c3-4480a3dd8e9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d8622feac946b79484495985fcdf40'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:38.551968 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d5cc205e-82cb-4a35-b0c3-4480a3dd8e9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d8622feac946b79484495985fcdf40'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:38.556719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:38.572115 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 996/2009] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:38 2022] DELETE /identity/v3/users/27d8622feac946b79484495985fcdf40 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:38.576990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab6130-12ba-4d47-a67e-d6f9dced71ca None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:38.578118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab6130-12ba-4d47-a67e-d6f9dced71ca None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:38.578118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab6130-12ba-4d47-a67e-d6f9dced71ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:38.600409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-bbab6130-12ba-4d47-a67e-d6f9dced71ca None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:38.601800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-bbab6130-12ba-4d47-a67e-d6f9dced71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:38.637752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc205e-82cb-4a35-b0c3-4480a3dd8e9a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:38.644705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d5cc205e-82cb-4a35-b0c3-4480a3dd8e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:38.703729 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1014/2010] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:38.714039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab6130-12ba-4d47-a67e-d6f9dced71ca None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:38.721249 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-bbab6130-12ba-4d47-a67e-d6f9dced71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:38.743648 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc205e-82cb-4a35-b0c3-4480a3dd8e9a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:38.748204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76157961-7fb3-419d-a000-82f033a6579c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:38.749065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157961-7fb3-419d-a000-82f033a6579c service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:38.749733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157961-7fb3-419d-a000-82f033a6579c service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:38.750061 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157961-7fb3-419d-a000-82f033a6579c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:38.752106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-76157961-7fb3-419d-a000-82f033a6579c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:38.799424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab6130-12ba-4d47-a67e-d6f9dced71ca None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:38.803249 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a8648-8ef1-4fa0-8d06-666bddab3440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:38.804043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a8648-8ef1-4fa0-8d06-666bddab3440 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:38.804461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a8648-8ef1-4fa0-8d06-666bddab3440 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:38.804842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a8648-8ef1-4fa0-8d06-666bddab3440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:38.815371 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a8648-8ef1-4fa0-8d06-666bddab3440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:38.817554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a8648-8ef1-4fa0-8d06-666bddab3440 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:38.820850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76157961-7fb3-419d-a000-82f033a6579c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:38.822532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76157961-7fb3-419d-a000-82f033a6579c service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:38.830394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1015/2011] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:50:38.832993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 997/2012] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:50:39.200102 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a8648-8ef1-4fa0-8d06-666bddab3440 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:39.201775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1a9a8648-8ef1-4fa0-8d06-666bddab3440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:39.217119 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a8648-8ef1-4fa0-8d06-666bddab3440 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:39.222775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:39.224134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:39.224134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:39.224560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] PATH_INFO: `/v3/projects/5d8173e489914924a5a1f5731acc4a5a` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:39.226147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8173e489914924a5a1f5731acc4a5a)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:39.228028 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:39.229923 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:39.310992 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8173e489914924a5a1f5731acc4a5a', 'request_id': 'req-57f5cc28-6a06-4058-9092-55f0affa399a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:39.320936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8173e489914924a5a1f5731acc4a5a', 'request_id': 'req-57f5cc28-6a06-4058-9092-55f0affa399a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:39.334672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8173e489914924a5a1f5731acc4a5a', 'request_id': 'req-57f5cc28-6a06-4058-9092-55f0affa399a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:39.357444 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] The token cache is being invalidate because project 5d8173e489914924a5a1f5731acc4a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:39.357832 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:39.358579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:39.368560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1016/2013] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:39 2022] DELETE /identity/v3/projects/5d8173e489914924a5a1f5731acc4a5a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:39.371277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76157961-7fb3-419d-a000-82f033a6579c service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:39.393512 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76157961-7fb3-419d-a000-82f033a6579c service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:39.490104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad1645-5648-4a1e-b081-4f9b6fa32e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:39.491237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1645-5648-4a1e-b081-4f9b6fa32e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:39.491658 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1645-5648-4a1e-b081-4f9b6fa32e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:39.492069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1645-5648-4a1e-b081-4f9b6fa32e7d admin admin] PATH_INFO: `/v3/users/9d230cc6af234ae28f70bee0e235112f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:39.494053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad1645-5648-4a1e-b081-4f9b6fa32e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d230cc6af234ae28f70bee0e235112f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:39.496560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad1645-5648-4a1e-b081-4f9b6fa32e7d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:39.559927 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:DELETE=8,keystone:SELECT=92 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:39.567305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-c8ad1645-5648-4a1e-b081-4f9b6fa32e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d230cc6af234ae28f70bee0e235112f'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:39.576696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-c8ad1645-5648-4a1e-b081-4f9b6fa32e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d230cc6af234ae28f70bee0e235112f'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:39.577433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-c8ad1645-5648-4a1e-b081-4f9b6fa32e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d230cc6af234ae28f70bee0e235112f'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:39.578143 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-c8ad1645-5648-4a1e-b081-4f9b6fa32e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d230cc6af234ae28f70bee0e235112f'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:39.595754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-c8ad1645-5648-4a1e-b081-4f9b6fa32e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d230cc6af234ae28f70bee0e235112f'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:39.629718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 998/2014] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:39 2022] DELETE /identity/v3/users/9d230cc6af234ae28f70bee0e235112f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:39.632212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:39.634915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:39.724554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5cc28-6a06-4058-9092-55f0affa399a admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:39.828168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3c59e-dae4-44b2-82bf-1fe15aff2668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:39.829347 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3c59e-dae4-44b2-82bf-1fe15aff2668 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:39.829636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3c59e-dae4-44b2-82bf-1fe15aff2668 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:39.829913 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3c59e-dae4-44b2-82bf-1fe15aff2668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:39.832555 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4ec3c59e-dae4-44b2-82bf-1fe15aff2668 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:39.944890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:39.952053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3c59e-dae4-44b2-82bf-1fe15aff2668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:39.955332 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3c59e-dae4-44b2-82bf-1fe15aff2668 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:39.971573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1017/2015] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:40.063430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad1645-5648-4a1e-b081-4f9b6fa32e7d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:40.065478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-c8ad1645-5648-4a1e-b081-4f9b6fa32e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:40.187020 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad1645-5648-4a1e-b081-4f9b6fa32e7d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:40.194967 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16b992-fccb-4cf8-b773-6a0a781ee90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:40.195806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b992-fccb-4cf8-b773-6a0a781ee90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:40.196176 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b992-fccb-4cf8-b773-6a0a781ee90a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:40.196514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b992-fccb-4cf8-b773-6a0a781ee90a admin admin] PATH_INFO: `/v3/projects/eef07805691f4faa8120d3c97bf4dade` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:40.197791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16b992-fccb-4cf8-b773-6a0a781ee90a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef07805691f4faa8120d3c97bf4dade)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:40.202170 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16b992-fccb-4cf8-b773-6a0a781ee90a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:40.264033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5f16b992-fccb-4cf8-b773-6a0a781ee90a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef07805691f4faa8120d3c97bf4dade', 'request_id': 'req-5f16b992-fccb-4cf8-b773-6a0a781ee90a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:40.272729 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5f16b992-fccb-4cf8-b773-6a0a781ee90a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef07805691f4faa8120d3c97bf4dade', 'request_id': 'req-5f16b992-fccb-4cf8-b773-6a0a781ee90a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:40.280033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5f16b992-fccb-4cf8-b773-6a0a781ee90a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef07805691f4faa8120d3c97bf4dade', 'request_id': 'req-5f16b992-fccb-4cf8-b773-6a0a781ee90a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:40.316769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5f16b992-fccb-4cf8-b773-6a0a781ee90a admin admin] The token cache is being invalidate because project eef07805691f4faa8120d3c97bf4dade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:40.317015 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5f16b992-fccb-4cf8-b773-6a0a781ee90a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:40.317624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5f16b992-fccb-4cf8-b773-6a0a781ee90a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:40.324611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 999/2016] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:40 2022] DELETE /identity/v3/projects/eef07805691f4faa8120d3c97bf4dade => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:40.326357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7624a-b904-485c-b3c3-636800a71180 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:40.326932 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7624a-b904-485c-b3c3-636800a71180 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:40.327714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7624a-b904-485c-b3c3-636800a71180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:40.361022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-a4b7624a-b904-485c-b3c3-636800a71180 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:40.363264 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a4b7624a-b904-485c-b3c3-636800a71180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:40.464897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1018/2017] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:40.467180 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b7875-fb90-42ff-8ee1-a79effa9238e None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:40.467830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b7875-fb90-42ff-8ee1-a79effa9238e None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:40.470710 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b7875-fb90-42ff-8ee1-a79effa9238e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:40.494510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-ee2b7875-fb90-42ff-8ee1-a79effa9238e None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:40.495954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ee2b7875-fb90-42ff-8ee1-a79effa9238e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:40.509840 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1000/2018] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:40.513813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7624a-b904-485c-b3c3-636800a71180 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:40.530620 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7624a-b904-485c-b3c3-636800a71180 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:40.544489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352b6a2-3e78-477e-acb8-5fb5592e8036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:40.544489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b6a2-3e78-477e-acb8-5fb5592e8036 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:40.544489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b6a2-3e78-477e-acb8-5fb5592e8036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:40.544489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b6a2-3e78-477e-acb8-5fb5592e8036 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:40.545435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352b6a2-3e78-477e-acb8-5fb5592e8036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:40.545435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352b6a2-3e78-477e-acb8-5fb5592e8036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:40.545435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352b6a2-3e78-477e-acb8-5fb5592e8036 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:40.557423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1019/2019] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:40.561844 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b7875-fb90-42ff-8ee1-a79effa9238e None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:40.572188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b7875-fb90-42ff-8ee1-a79effa9238e None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:40.578317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f420908-ea03-45a5-96c6-dcda95626daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:40.579166 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f420908-ea03-45a5-96c6-dcda95626daa admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:40.579448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f420908-ea03-45a5-96c6-dcda95626daa admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:40.579717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f420908-ea03-45a5-96c6-dcda95626daa admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:40.580461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f420908-ea03-45a5-96c6-dcda95626daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:40.582611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f420908-ea03-45a5-96c6-dcda95626daa admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:40.623033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1001/2020] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:40 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:40.628372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352b6a2-3e78-477e-acb8-5fb5592e8036 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:40.645750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352b6a2-3e78-477e-acb8-5fb5592e8036 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:40.730645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1634e-ac1c-4632-be1b-b1099c2297f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:40.731390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1634e-ac1c-4632-be1b-b1099c2297f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:40.731641 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1634e-ac1c-4632-be1b-b1099c2297f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:40.731898 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1634e-ac1c-4632-be1b-b1099c2297f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:40.732645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1634e-ac1c-4632-be1b-b1099c2297f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:40.735234 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1634e-ac1c-4632-be1b-b1099c2297f2 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:40.755541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1020/2021] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:40 2022] POST /identity/v3/users => generated 283 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:40.759671 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f420908-ea03-45a5-96c6-dcda95626daa admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:40.770615 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f420908-ea03-45a5-96c6-dcda95626daa admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:40.775412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49de94-0f57-420e-a4dd-1b3a06a17325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:40.776120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49de94-0f57-420e-a4dd-1b3a06a17325 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:40.776387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49de94-0f57-420e-a4dd-1b3a06a17325 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:40.776662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49de94-0f57-420e-a4dd-1b3a06a17325 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:40.777399 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49de94-0f57-420e-a4dd-1b3a06a17325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:40.779039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49de94-0f57-420e-a4dd-1b3a06a17325 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:40.790774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1002/2022] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:40.794833 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1634e-ac1c-4632-be1b-b1099c2297f2 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:40.806122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1634e-ac1c-4632-be1b-b1099c2297f2 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:40.811135 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ba4a6-dc60-41ff-aaba-237ac486e209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:40.812046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ba4a6-dc60-41ff-aaba-237ac486e209 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:40.812358 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ba4a6-dc60-41ff-aaba-237ac486e209 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:40.812637 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ba4a6-dc60-41ff-aaba-237ac486e209 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:40.813380 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ba4a6-dc60-41ff-aaba-237ac486e209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:40.815003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ba4a6-dc60-41ff-aaba-237ac486e209 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:40.825233 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1021/2023] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:40.830067 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49de94-0f57-420e-a4dd-1b3a06a17325 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:40.841136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49de94-0f57-420e-a4dd-1b3a06a17325 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:40.847206 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823562ed-fe72-4031-8107-41cee54a130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:40.848105 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823562ed-fe72-4031-8107-41cee54a130f admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:40.848423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823562ed-fe72-4031-8107-41cee54a130f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:40.848704 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823562ed-fe72-4031-8107-41cee54a130f admin admin] PATH_INFO: `/v3/projects/90e763cc27b94cb5a027c643ccd0cdee/users/5c352608271b4fcf97ccd8ddf2b1ac38/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:40.852204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:40.868045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823562ed-fe72-4031-8107-41cee54a130f admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e763cc27b94cb5a027c643ccd0cdee, user_id=5c352608271b4fcf97ccd8ddf2b1ac38, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:40.872747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823562ed-fe72-4031-8107-41cee54a130f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:40.892218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1003/2024] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:40 2022] PUT /identity/v3/projects/90e763cc27b94cb5a027c643ccd0cdee/users/5c352608271b4fcf97ccd8ddf2b1ac38/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:40.903550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdd4b4-2ec1-4d7a-990f-cc8f1b15e2d9 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:40.903837 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdd4b4-2ec1-4d7a-990f-cc8f1b15e2d9 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:40.904115 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdd4b4-2ec1-4d7a-990f-cc8f1b15e2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:40.936722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-83cdd4b4-2ec1-4d7a-990f-cc8f1b15e2d9 None None] MFA Rules not processed for user `5c352608271b4fcf97ccd8ddf2b1ac38`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:40.938021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-83cdd4b4-2ec1-4d7a-990f-cc8f1b15e2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:40.996823 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:41.019959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1022/2025] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:41.033085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823562ed-fe72-4031-8107-41cee54a130f admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:41.035201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-823562ed-fe72-4031-8107-41cee54a130f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:41.109008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823562ed-fe72-4031-8107-41cee54a130f admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:41.114903 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d470e-e730-4e17-b453-e5b99cdda5fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:41.116681 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d470e-e730-4e17-b453-e5b99cdda5fc service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:41.117105 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d470e-e730-4e17-b453-e5b99cdda5fc service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:41.117553 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d470e-e730-4e17-b453-e5b99cdda5fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:41.129244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d470e-e730-4e17-b453-e5b99cdda5fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:41.130884 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d470e-e730-4e17-b453-e5b99cdda5fc service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:41.141055 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1004/2026] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:42.770908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdd4b4-2ec1-4d7a-990f-cc8f1b15e2d9 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:42.773382 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-83cdd4b4-2ec1-4d7a-990f-cc8f1b15e2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:42.902514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdd4b4-2ec1-4d7a-990f-cc8f1b15e2d9 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:42.934046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ce019-8753-4d6f-a39c-4ba2b0431aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:42.935289 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ce019-8753-4d6f-a39c-4ba2b0431aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:42.938548 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ce019-8753-4d6f-a39c-4ba2b0431aad admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:42.939118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ce019-8753-4d6f-a39c-4ba2b0431aad admin admin] PATH_INFO: `/v3/users/867b83a9c63d41af9bf0ff874bcb567f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:42.940991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ce019-8753-4d6f-a39c-4ba2b0431aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=867b83a9c63d41af9bf0ff874bcb567f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:42.943735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ce019-8753-4d6f-a39c-4ba2b0431aad admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:43.023486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f23ce019-8753-4d6f-a39c-4ba2b0431aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867b83a9c63d41af9bf0ff874bcb567f'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:43.041671 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f23ce019-8753-4d6f-a39c-4ba2b0431aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867b83a9c63d41af9bf0ff874bcb567f'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:43.042463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f23ce019-8753-4d6f-a39c-4ba2b0431aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867b83a9c63d41af9bf0ff874bcb567f'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:43.043114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f23ce019-8753-4d6f-a39c-4ba2b0431aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867b83a9c63d41af9bf0ff874bcb567f'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:43.054205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f23ce019-8753-4d6f-a39c-4ba2b0431aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867b83a9c63d41af9bf0ff874bcb567f'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:43.089575 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1023/2027] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:42 2022] DELETE /identity/v3/users/867b83a9c63d41af9bf0ff874bcb567f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:43.091060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af06e5-18bb-4b88-8663-24f8a59889d9 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:43.091510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af06e5-18bb-4b88-8663-24f8a59889d9 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:43.091774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af06e5-18bb-4b88-8663-24f8a59889d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:43.118818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-b4af06e5-18bb-4b88-8663-24f8a59889d9 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:43.120423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b4af06e5-18bb-4b88-8663-24f8a59889d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:43.223903 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1005/2028] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:43.238816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ce019-8753-4d6f-a39c-4ba2b0431aad admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:43.241583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f23ce019-8753-4d6f-a39c-4ba2b0431aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:43.383109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ce019-8753-4d6f-a39c-4ba2b0431aad admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:43.394151 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f763df6-1a03-4672-a09b-9bb0e3f19946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:43.394851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f763df6-1a03-4672-a09b-9bb0e3f19946 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:43.395137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f763df6-1a03-4672-a09b-9bb0e3f19946 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:43.395432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f763df6-1a03-4672-a09b-9bb0e3f19946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:43.422614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f763df6-1a03-4672-a09b-9bb0e3f19946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:43.425045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f763df6-1a03-4672-a09b-9bb0e3f19946 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:43.477238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1024/2029] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:44.290679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af06e5-18bb-4b88-8663-24f8a59889d9 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:44.292240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b4af06e5-18bb-4b88-8663-24f8a59889d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:44.305273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af06e5-18bb-4b88-8663-24f8a59889d9 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:44.310549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:44.311520 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:44.311796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:44.312065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] PATH_INFO: `/v3/projects/1e1af493a16c49e9b48255ffb33a97f6` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:44.313318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1af493a16c49e9b48255ffb33a97f6)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:44.315241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:44.380677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1af493a16c49e9b48255ffb33a97f6', 'request_id': 'req-01495848-4d35-4032-949f-5a7cf3a0ff5d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.386268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1af493a16c49e9b48255ffb33a97f6', 'request_id': 'req-01495848-4d35-4032-949f-5a7cf3a0ff5d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.398783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1af493a16c49e9b48255ffb33a97f6', 'request_id': 'req-01495848-4d35-4032-949f-5a7cf3a0ff5d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.414345 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] The token cache is being invalidate because project 1e1af493a16c49e9b48255ffb33a97f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:44.414669 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.415302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.416949 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1006/2030] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:44 2022] DELETE /identity/v3/projects/1e1af493a16c49e9b48255ffb33a97f6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:44.421376 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f763df6-1a03-4672-a09b-9bb0e3f19946 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:44.431397 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f763df6-1a03-4672-a09b-9bb0e3f19946 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:44.440611 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:44.513352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b242a3-27ac-4b4e-9631-126f2cc5a80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:44.514311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b242a3-27ac-4b4e-9631-126f2cc5a80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:44.514601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b242a3-27ac-4b4e-9631-126f2cc5a80c admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:44.514878 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b242a3-27ac-4b4e-9631-126f2cc5a80c admin admin] PATH_INFO: `/v3/users/264c2b9ab4654605a649dae2b17a8174` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:44.516087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b242a3-27ac-4b4e-9631-126f2cc5a80c admin admin] RBAC: Authorizing `identity:delete_user(user_id=264c2b9ab4654605a649dae2b17a8174)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:44.518083 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b242a3-27ac-4b4e-9631-126f2cc5a80c admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:44.578701 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b5b242a3-27ac-4b4e-9631-126f2cc5a80c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264c2b9ab4654605a649dae2b17a8174'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.595693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b5b242a3-27ac-4b4e-9631-126f2cc5a80c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264c2b9ab4654605a649dae2b17a8174'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.596799 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b5b242a3-27ac-4b4e-9631-126f2cc5a80c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264c2b9ab4654605a649dae2b17a8174'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.597539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b5b242a3-27ac-4b4e-9631-126f2cc5a80c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264c2b9ab4654605a649dae2b17a8174'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.607266 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b5b242a3-27ac-4b4e-9631-126f2cc5a80c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264c2b9ab4654605a649dae2b17a8174'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.627990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1025/2031] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:44 2022] DELETE /identity/v3/users/264c2b9ab4654605a649dae2b17a8174 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:44.640155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:44.642210 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:44.658965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01495848-4d35-4032-949f-5a7cf3a0ff5d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:44.669692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:44.774761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee66dc-7aea-4048-91e0-f4d3e77d3848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:44.775684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee66dc-7aea-4048-91e0-f4d3e77d3848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:44.775973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee66dc-7aea-4048-91e0-f4d3e77d3848 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:44.777656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee66dc-7aea-4048-91e0-f4d3e77d3848 admin admin] PATH_INFO: `/v3/users/6bd2e9e931e54ff6b33ec98aefdf698a` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:44.779007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee66dc-7aea-4048-91e0-f4d3e77d3848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bd2e9e931e54ff6b33ec98aefdf698a)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:44.782767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee66dc-7aea-4048-91e0-f4d3e77d3848 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:44.867870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-cfee66dc-7aea-4048-91e0-f4d3e77d3848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd2e9e931e54ff6b33ec98aefdf698a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.893511 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-cfee66dc-7aea-4048-91e0-f4d3e77d3848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd2e9e931e54ff6b33ec98aefdf698a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.909817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-cfee66dc-7aea-4048-91e0-f4d3e77d3848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd2e9e931e54ff6b33ec98aefdf698a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.912098 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-cfee66dc-7aea-4048-91e0-f4d3e77d3848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd2e9e931e54ff6b33ec98aefdf698a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.937751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-cfee66dc-7aea-4048-91e0-f4d3e77d3848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd2e9e931e54ff6b33ec98aefdf698a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:44.975334 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1007/2032] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:44 2022] DELETE /identity/v3/users/6bd2e9e931e54ff6b33ec98aefdf698a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:44.980902 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61026b4-de30-4f4d-b301-fa3c247686cb None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:44.981247 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61026b4-de30-4f4d-b301-fa3c247686cb None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:44.981524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61026b4-de30-4f4d-b301-fa3c247686cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:45.002936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-d61026b4-de30-4f4d-b301-fa3c247686cb None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:45.004254 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d61026b4-de30-4f4d-b301-fa3c247686cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:45.100908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1026/2033] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:45.120305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee66dc-7aea-4048-91e0-f4d3e77d3848 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:45.122046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-cfee66dc-7aea-4048-91e0-f4d3e77d3848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:45.200052 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61026b4-de30-4f4d-b301-fa3c247686cb None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:45.201459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d61026b4-de30-4f4d-b301-fa3c247686cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:45.229506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61026b4-de30-4f4d-b301-fa3c247686cb None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:45.235872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbcb17-6106-40c2-a290-de4e14a4e468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:45.237639 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbcb17-6106-40c2-a290-de4e14a4e468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:45.237921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbcb17-6106-40c2-a290-de4e14a4e468 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:45.238193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbcb17-6106-40c2-a290-de4e14a4e468 admin admin] PATH_INFO: `/v3/projects/827dfa5ee8204c78afb6b64076cab204` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:45.239984 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbcb17-6106-40c2-a290-de4e14a4e468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=827dfa5ee8204c78afb6b64076cab204)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:45.243115 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbcb17-6106-40c2-a290-de4e14a4e468 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:45.247725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee66dc-7aea-4048-91e0-f4d3e77d3848 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:45.255293 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365ea77-801f-4bcc-8ed4-96024019205a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:45.256100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365ea77-801f-4bcc-8ed4-96024019205a service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:45.256683 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365ea77-801f-4bcc-8ed4-96024019205a service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:45.257026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365ea77-801f-4bcc-8ed4-96024019205a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:45.273043 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365ea77-801f-4bcc-8ed4-96024019205a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:45.274917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365ea77-801f-4bcc-8ed4-96024019205a service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:45.286503 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:45.289912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1008/2034] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:45.310300 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3ddbcb17-6106-40c2-a290-de4e14a4e468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827dfa5ee8204c78afb6b64076cab204', 'request_id': 'req-3ddbcb17-6106-40c2-a290-de4e14a4e468'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:45.320503 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3ddbcb17-6106-40c2-a290-de4e14a4e468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827dfa5ee8204c78afb6b64076cab204', 'request_id': 'req-3ddbcb17-6106-40c2-a290-de4e14a4e468'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:45.328808 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3ddbcb17-6106-40c2-a290-de4e14a4e468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827dfa5ee8204c78afb6b64076cab204', 'request_id': 'req-3ddbcb17-6106-40c2-a290-de4e14a4e468'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:45.349248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3ddbcb17-6106-40c2-a290-de4e14a4e468 admin admin] The token cache is being invalidate because project 827dfa5ee8204c78afb6b64076cab204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:45.349677 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3ddbcb17-6106-40c2-a290-de4e14a4e468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:45.350477 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3ddbcb17-6106-40c2-a290-de4e14a4e468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:45.355947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1027/2035] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:45 2022] DELETE /identity/v3/projects/827dfa5ee8204c78afb6b64076cab204 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:45.357884 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a7e81-6bd1-4358-ac16-57a15c167bd9 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:45.358442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a7e81-6bd1-4358-ac16-57a15c167bd9 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:45.358667 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a7e81-6bd1-4358-ac16-57a15c167bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:45.389461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-cb4a7e81-6bd1-4358-ac16-57a15c167bd9 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:45.393902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-cb4a7e81-6bd1-4358-ac16-57a15c167bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:45.449694 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:45.489574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1009/2036] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:45.498739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905d986-3842-40ca-90e3-595cc5f9b2e3 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:45.499270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905d986-3842-40ca-90e3-595cc5f9b2e3 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:45.499447 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905d986-3842-40ca-90e3-595cc5f9b2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:45.527733 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-0905d986-3842-40ca-90e3-595cc5f9b2e3 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:45.529325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-0905d986-3842-40ca-90e3-595cc5f9b2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:45.557434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1028/2037] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:45.561600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a7e81-6bd1-4358-ac16-57a15c167bd9 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:45.573949 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a7e81-6bd1-4358-ac16-57a15c167bd9 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:45.579980 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3358a02-3a87-4e43-b0aa-5c6a80122e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:45.581168 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3358a02-3a87-4e43-b0aa-5c6a80122e61 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:45.581561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3358a02-3a87-4e43-b0aa-5c6a80122e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:45.581932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3358a02-3a87-4e43-b0aa-5c6a80122e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:45.582784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3358a02-3a87-4e43-b0aa-5c6a80122e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:45.583162 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3358a02-3a87-4e43-b0aa-5c6a80122e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:45.585278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3358a02-3a87-4e43-b0aa-5c6a80122e61 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:45.598976 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1010/2038] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:45.603528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905d986-3842-40ca-90e3-595cc5f9b2e3 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:45.616398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905d986-3842-40ca-90e3-595cc5f9b2e3 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:45.624009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bdb4e-62cf-464b-b9f4-29de2bf1fb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:45.624882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bdb4e-62cf-464b-b9f4-29de2bf1fb2b admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:45.625178 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bdb4e-62cf-464b-b9f4-29de2bf1fb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:45.625460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bdb4e-62cf-464b-b9f4-29de2bf1fb2b admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:45.626188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bdb4e-62cf-464b-b9f4-29de2bf1fb2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:45.628171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bdb4e-62cf-464b-b9f4-29de2bf1fb2b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:45.663542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1029/2039] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:45 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:45.667727 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3358a02-3a87-4e43-b0aa-5c6a80122e61 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:45.680004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3358a02-3a87-4e43-b0aa-5c6a80122e61 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:45.699554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bdb4e-62cf-464b-b9f4-29de2bf1fb2b admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:45.701389 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1f7bdb4e-62cf-464b-b9f4-29de2bf1fb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:45.766880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acc988-bdbe-45d3-bbf6-ecd4345ae631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:45.767312 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc988-bdbe-45d3-bbf6-ecd4345ae631 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:45.767691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc988-bdbe-45d3-bbf6-ecd4345ae631 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:45.768062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc988-bdbe-45d3-bbf6-ecd4345ae631 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:45.769066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acc988-bdbe-45d3-bbf6-ecd4345ae631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:45.771493 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acc988-bdbe-45d3-bbf6-ecd4345ae631 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:45.787310 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bdb4e-62cf-464b-b9f4-29de2bf1fb2b admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:45.793751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:45.794622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:45.794907 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:45.795180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] PATH_INFO: `/v3/projects/5149650f11584c849e8b36f6c13f552a` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:45.796671 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5149650f11584c849e8b36f6c13f552a)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:45.798864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:45.810782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1011/2040] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:45 2022] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:45.812558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acc988-bdbe-45d3-bbf6-ecd4345ae631 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:45.828122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acc988-bdbe-45d3-bbf6-ecd4345ae631 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:45.833712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176b1d7-8b9c-487c-ab51-5fb59384d59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:45.834753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176b1d7-8b9c-487c-ab51-5fb59384d59e admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:45.835148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176b1d7-8b9c-487c-ab51-5fb59384d59e admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:45.835420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176b1d7-8b9c-487c-ab51-5fb59384d59e admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:45.836335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176b1d7-8b9c-487c-ab51-5fb59384d59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:45.838101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176b1d7-8b9c-487c-ab51-5fb59384d59e admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:45.858808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1012/2041] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:45.861077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176b1d7-8b9c-487c-ab51-5fb59384d59e admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:45.869074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5149650f11584c849e8b36f6c13f552a', 'request_id': 'req-7f430718-3ff3-4740-bb61-0de640d55caf'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:45.877812 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5149650f11584c849e8b36f6c13f552a', 'request_id': 'req-7f430718-3ff3-4740-bb61-0de640d55caf'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:45.879943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176b1d7-8b9c-487c-ab51-5fb59384d59e admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:45.884122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5149650f11584c849e8b36f6c13f552a', 'request_id': 'req-7f430718-3ff3-4740-bb61-0de640d55caf'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:45.918504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] The token cache is being invalidate because project 5149650f11584c849e8b36f6c13f552a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:45.918803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:45.919480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:45.922613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1030/2042] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:45 2022] DELETE /identity/v3/projects/5149650f11584c849e8b36f6c13f552a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:45.926206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:45.927602 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:45.948967 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:46.019334 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f430718-3ff3-4740-bb61-0de640d55caf admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:46.023200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4bf9c-5b8e-4db1-a5a2-200a29e4fb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:46.024500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4bf9c-5b8e-4db1-a5a2-200a29e4fb87 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.025056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4bf9c-5b8e-4db1-a5a2-200a29e4fb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.025284 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4bf9c-5b8e-4db1-a5a2-200a29e4fb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.026218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4bf9c-5b8e-4db1-a5a2-200a29e4fb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:46.028018 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4bf9c-5b8e-4db1-a5a2-200a29e4fb87 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:46.030815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f052c8-6306-43cc-809a-d39f95b92261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:46.031890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f052c8-6306-43cc-809a-d39f95b92261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.033593 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f052c8-6306-43cc-809a-d39f95b92261 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.033593 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f052c8-6306-43cc-809a-d39f95b92261 admin admin] PATH_INFO: `/v3/users/b9bd0a05db094f6298a0eb0348ad0748` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.034352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f052c8-6306-43cc-809a-d39f95b92261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9bd0a05db094f6298a0eb0348ad0748)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:46.037161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f052c8-6306-43cc-809a-d39f95b92261 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:46.041341 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1013/2043] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:46.045622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4bf9c-5b8e-4db1-a5a2-200a29e4fb87 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:46.047505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7ef4bf9c-5b8e-4db1-a5a2-200a29e4fb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:46.062030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4bf9c-5b8e-4db1-a5a2-200a29e4fb87 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:46.067188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a14ec0-2749-4509-bae9-44cd93ad7d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:46.067710 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a14ec0-2749-4509-bae9-44cd93ad7d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.068024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a14ec0-2749-4509-bae9-44cd93ad7d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.068312 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a14ec0-2749-4509-bae9-44cd93ad7d39 admin admin] PATH_INFO: `/v3/projects/02793f148bf54c3394ef0351411ccf1b/users/538775a431514d4aaa465ab43c8e7fd6/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.088383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a14ec0-2749-4509-bae9-44cd93ad7d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02793f148bf54c3394ef0351411ccf1b, user_id=538775a431514d4aaa465ab43c8e7fd6, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:46.092991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a14ec0-2749-4509-bae9-44cd93ad7d39 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:46.109613 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1014/2044] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:46 2022] PUT /identity/v3/projects/02793f148bf54c3394ef0351411ccf1b/users/538775a431514d4aaa465ab43c8e7fd6/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:46.118946 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-80f052c8-6306-43cc-809a-d39f95b92261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9bd0a05db094f6298a0eb0348ad0748'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:46.121043 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bfa59-b02e-4d32-88b3-4147ec411c30 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.121340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bfa59-b02e-4d32-88b3-4147ec411c30 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.121857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bfa59-b02e-4d32-88b3-4147ec411c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.132008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-80f052c8-6306-43cc-809a-d39f95b92261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9bd0a05db094f6298a0eb0348ad0748'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:46.133088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-80f052c8-6306-43cc-809a-d39f95b92261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9bd0a05db094f6298a0eb0348ad0748'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:46.133833 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-80f052c8-6306-43cc-809a-d39f95b92261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9bd0a05db094f6298a0eb0348ad0748'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:46.144774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-80f052c8-6306-43cc-809a-d39f95b92261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9bd0a05db094f6298a0eb0348ad0748'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:46.148808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:46.158885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e72bfa59-b02e-4d32-88b3-4147ec411c30 None None] MFA Rules not processed for user `538775a431514d4aaa465ab43c8e7fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:46.162470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e72bfa59-b02e-4d32-88b3-4147ec411c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:46.171866 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1031/2045] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:45 2022] DELETE /identity/v3/users/b9bd0a05db094f6298a0eb0348ad0748 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:50:46.294124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1015/2046] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:46.298844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f052c8-6306-43cc-809a-d39f95b92261 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:46.301082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-80f052c8-6306-43cc-809a-d39f95b92261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:46.410707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f052c8-6306-43cc-809a-d39f95b92261 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:46.429127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff0fb0-a2b2-4b00-b55b-55f724988d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:46.430904 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff0fb0-a2b2-4b00-b55b-55f724988d95 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.431193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff0fb0-a2b2-4b00-b55b-55f724988d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.431724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff0fb0-a2b2-4b00-b55b-55f724988d95 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.433416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff0fb0-a2b2-4b00-b55b-55f724988d95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:46.437243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff0fb0-a2b2-4b00-b55b-55f724988d95 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:46.476851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1032/2047] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:46 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:46.480792 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bfa59-b02e-4d32-88b3-4147ec411c30 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:46.583267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bfa59-b02e-4d32-88b3-4147ec411c30 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:46.599615 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff0fb0-a2b2-4b00-b55b-55f724988d95 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:46.602207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4dff0fb0-a2b2-4b00-b55b-55f724988d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:46.633288 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:46.653173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fabcb4-9895-40c3-a604-2ce8615c74cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:46.653983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabcb4-9895-40c3-a604-2ce8615c74cb admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.654383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabcb4-9895-40c3-a604-2ce8615c74cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.654955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabcb4-9895-40c3-a604-2ce8615c74cb admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.655929 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fabcb4-9895-40c3-a604-2ce8615c74cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:46.657991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fabcb4-9895-40c3-a604-2ce8615c74cb admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:46.679604 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff0fb0-a2b2-4b00-b55b-55f724988d95 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:46.685974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1016/2048] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:46 2022] POST /identity/v3/users => generated 300 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:46.686162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:46.686162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.686162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.686162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] PATH_INFO: `/v3/projects/5a83b93871d8456eb4845b332d051e87` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.687333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fabcb4-9895-40c3-a604-2ce8615c74cb admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:46.687432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a83b93871d8456eb4845b332d051e87)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:46.689416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:46.696884 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fabcb4-9895-40c3-a604-2ce8615c74cb admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:46.702281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5689-2fae-4b13-826a-26794f6d9996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:46.702964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5689-2fae-4b13-826a-26794f6d9996 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.703245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5689-2fae-4b13-826a-26794f6d9996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.703516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5689-2fae-4b13-826a-26794f6d9996 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.704274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf5689-2fae-4b13-826a-26794f6d9996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:46.706021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf5689-2fae-4b13-826a-26794f6d9996 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:46.717155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1017/2049] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:46.721446 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5689-2fae-4b13-826a-26794f6d9996 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:46.731292 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5689-2fae-4b13-826a-26794f6d9996 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:46.737789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a83b93871d8456eb4845b332d051e87', 'request_id': 'req-dc8a6970-d51d-46d3-b2af-d20287e2bef9'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:46.744115 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a83b93871d8456eb4845b332d051e87', 'request_id': 'req-dc8a6970-d51d-46d3-b2af-d20287e2bef9'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:46.749908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a83b93871d8456eb4845b332d051e87', 'request_id': 'req-dc8a6970-d51d-46d3-b2af-d20287e2bef9'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:46.757331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:46.763383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] The token cache is being invalidate because project 5a83b93871d8456eb4845b332d051e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:46.763672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:46.764485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:46.766203 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1033/2050] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:46 2022] DELETE /identity/v3/projects/5a83b93871d8456eb4845b332d051e87 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:50:46.770247 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:46.771707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:46.793284 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fe3a8-5c17-4c77-b6c0-6cd6693d4c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:46.794186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fe3a8-5c17-4c77-b6c0-6cd6693d4c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.794463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fe3a8-5c17-4c77-b6c0-6cd6693d4c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.794730 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fe3a8-5c17-4c77-b6c0-6cd6693d4c09 admin admin] PATH_INFO: `/v3/projects/fbc851a3640d4f9aa60cf37eccf70ee6/users/92f638851d0a4a348db873d579ff3977/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.809478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fe3a8-5c17-4c77-b6c0-6cd6693d4c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc851a3640d4f9aa60cf37eccf70ee6, user_id=92f638851d0a4a348db873d579ff3977, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:46.812692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fe3a8-5c17-4c77-b6c0-6cd6693d4c09 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:46.828449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1018/2051] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:46 2022] PUT /identity/v3/projects/fbc851a3640d4f9aa60cf37eccf70ee6/users/92f638851d0a4a348db873d579ff3977/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:50:46.832179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fe3a8-5c17-4c77-b6c0-6cd6693d4c09 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:46.834048 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-543fe3a8-5c17-4c77-b6c0-6cd6693d4c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:46.847507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a6970-d51d-46d3-b2af-d20287e2bef9 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:46.901060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fe3a8-5c17-4c77-b6c0-6cd6693d4c09 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:46.906529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8779d-ae07-47a3-87a3-77cf95c18198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:46.907398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8779d-ae07-47a3-87a3-77cf95c18198 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.907666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8779d-ae07-47a3-87a3-77cf95c18198 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.908150 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8779d-ae07-47a3-87a3-77cf95c18198 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.908737 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d723d-1b2f-40cc-97b3-a6e873528653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:46.909007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8779d-ae07-47a3-87a3-77cf95c18198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:46.909677 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d723d-1b2f-40cc-97b3-a6e873528653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.909963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d723d-1b2f-40cc-97b3-a6e873528653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.910236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d723d-1b2f-40cc-97b3-a6e873528653 admin admin] PATH_INFO: `/v3/users/6546f315b86b40aa86168eb814d77f29` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.910600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8779d-ae07-47a3-87a3-77cf95c18198 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:46.911541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d723d-1b2f-40cc-97b3-a6e873528653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6546f315b86b40aa86168eb814d77f29)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:46.913800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d723d-1b2f-40cc-97b3-a6e873528653 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:46.916111 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:46.933284 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1019/2052] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:46.934858 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8779d-ae07-47a3-87a3-77cf95c18198 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:46.945413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8779d-ae07-47a3-87a3-77cf95c18198 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:46.950219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf55d5-c8ec-407c-bf47-1cbb95f42163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:46.951101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf55d5-c8ec-407c-bf47-1cbb95f42163 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.951387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf55d5-c8ec-407c-bf47-1cbb95f42163 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.952371 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf55d5-c8ec-407c-bf47-1cbb95f42163 admin admin] PATH_INFO: `/v3/projects/fbc851a3640d4f9aa60cf37eccf70ee6/users/92f638851d0a4a348db873d579ff3977/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.954743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf55d5-c8ec-407c-bf47-1cbb95f42163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc851a3640d4f9aa60cf37eccf70ee6, user_id=92f638851d0a4a348db873d579ff3977, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:46.957446 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf55d5-c8ec-407c-bf47-1cbb95f42163 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:46.969528 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1020/2053] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:46 2022] PUT /identity/v3/projects/fbc851a3640d4f9aa60cf37eccf70ee6/users/92f638851d0a4a348db873d579ff3977/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:46.978579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-384d723d-1b2f-40cc-97b3-a6e873528653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6546f315b86b40aa86168eb814d77f29'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:46.979779 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d211fb9-fa87-4ee0-a4d1-f4c8185a1b8d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:46.980075 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d211fb9-fa87-4ee0-a4d1-f4c8185a1b8d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:46.980393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d211fb9-fa87-4ee0-a4d1-f4c8185a1b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:46.986017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-384d723d-1b2f-40cc-97b3-a6e873528653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6546f315b86b40aa86168eb814d77f29'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:46.986787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-384d723d-1b2f-40cc-97b3-a6e873528653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6546f315b86b40aa86168eb814d77f29'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:46.987787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-384d723d-1b2f-40cc-97b3-a6e873528653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6546f315b86b40aa86168eb814d77f29'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:46.999096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-384d723d-1b2f-40cc-97b3-a6e873528653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6546f315b86b40aa86168eb814d77f29'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:47.015328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-8d211fb9-fa87-4ee0-a4d1-f4c8185a1b8d None None] MFA Rules not processed for user `92f638851d0a4a348db873d579ff3977`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:47.016743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8d211fb9-fa87-4ee0-a4d1-f4c8185a1b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:47.021875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1034/2054] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:46 2022] DELETE /identity/v3/users/6546f315b86b40aa86168eb814d77f29 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:47.096078 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1021/2055] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:47.107764 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d723d-1b2f-40cc-97b3-a6e873528653 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:47.109419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-384d723d-1b2f-40cc-97b3-a6e873528653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:47.203505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d723d-1b2f-40cc-97b3-a6e873528653 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:47.207255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc60cf-0c4d-4ad7-a97b-8f9c91ae8a3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:47.207924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc60cf-0c4d-4ad7-a97b-8f9c91ae8a3a service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:47.208208 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc60cf-0c4d-4ad7-a97b-8f9c91ae8a3a service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:47.208528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc60cf-0c4d-4ad7-a97b-8f9c91ae8a3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:47.279453 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc60cf-0c4d-4ad7-a97b-8f9c91ae8a3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:47.281411 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc60cf-0c4d-4ad7-a97b-8f9c91ae8a3a service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:47.296556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1035/2056] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:47.352110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d211fb9-fa87-4ee0-a4d1-f4c8185a1b8d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:47.354356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8d211fb9-fa87-4ee0-a4d1-f4c8185a1b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:47.393324 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:47.456579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d211fb9-fa87-4ee0-a4d1-f4c8185a1b8d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:47.468000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc60cf-0c4d-4ad7-a97b-8f9c91ae8a3a service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:47.469689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-53fc60cf-0c4d-4ad7-a97b-8f9c91ae8a3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:47.521810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:47.542752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65726a87-5141-40db-827e-036231893fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:47.544866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726a87-5141-40db-827e-036231893fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:47.545338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726a87-5141-40db-827e-036231893fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:47.547325 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726a87-5141-40db-827e-036231893fb8 admin admin] PATH_INFO: `/v3/projects/eb7fa499fc0344559a36685ce0812172` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:47.549840 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65726a87-5141-40db-827e-036231893fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7fa499fc0344559a36685ce0812172)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:47.553824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65726a87-5141-40db-827e-036231893fb8 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:47.576973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc60cf-0c4d-4ad7-a97b-8f9c91ae8a3a service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:47.582553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ca60f-e30d-475d-a07e-4faed7a606ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:47.583462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca60f-e30d-475d-a07e-4faed7a606ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:47.583746 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca60f-e30d-475d-a07e-4faed7a606ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:47.584539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca60f-e30d-475d-a07e-4faed7a606ae admin admin] PATH_INFO: `/v3/users/538775a431514d4aaa465ab43c8e7fd6` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:47.585906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ca60f-e30d-475d-a07e-4faed7a606ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=538775a431514d4aaa465ab43c8e7fd6)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:47.587873 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ca60f-e30d-475d-a07e-4faed7a606ae admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:47.635907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-65726a87-5141-40db-827e-036231893fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7fa499fc0344559a36685ce0812172', 'request_id': 'req-65726a87-5141-40db-827e-036231893fb8'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:47.645336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-65726a87-5141-40db-827e-036231893fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7fa499fc0344559a36685ce0812172', 'request_id': 'req-65726a87-5141-40db-827e-036231893fb8'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:47.657630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-65726a87-5141-40db-827e-036231893fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7fa499fc0344559a36685ce0812172', 'request_id': 'req-65726a87-5141-40db-827e-036231893fb8'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:47.668688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-860ca60f-e30d-475d-a07e-4faed7a606ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538775a431514d4aaa465ab43c8e7fd6'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:47.675862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-65726a87-5141-40db-827e-036231893fb8 admin admin] The token cache is being invalidate because project eb7fa499fc0344559a36685ce0812172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:47.676207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-65726a87-5141-40db-827e-036231893fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:47.677263 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-65726a87-5141-40db-827e-036231893fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:47.679697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-860ca60f-e30d-475d-a07e-4faed7a606ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538775a431514d4aaa465ab43c8e7fd6'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:47.680145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1022/2057] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:47 2022] DELETE /identity/v3/projects/eb7fa499fc0344559a36685ce0812172 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:47.683646 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-860ca60f-e30d-475d-a07e-4faed7a606ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538775a431514d4aaa465ab43c8e7fd6'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:47.684688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-860ca60f-e30d-475d-a07e-4faed7a606ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538775a431514d4aaa465ab43c8e7fd6'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:47.685597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49872981-d520-4ea1-8cc2-82f48a068859 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:47.685597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49872981-d520-4ea1-8cc2-82f48a068859 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:47.685827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49872981-d520-4ea1-8cc2-82f48a068859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:47.695365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-860ca60f-e30d-475d-a07e-4faed7a606ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538775a431514d4aaa465ab43c8e7fd6'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:47.718897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-49872981-d520-4ea1-8cc2-82f48a068859 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:47.719082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1036/2058] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:47 2022] DELETE /identity/v3/users/538775a431514d4aaa465ab43c8e7fd6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:47.719929 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-49872981-d520-4ea1-8cc2-82f48a068859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:47.723444 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3b500-95fa-428b-8e0f-fc4ab6bdb01d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:47.723747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3b500-95fa-428b-8e0f-fc4ab6bdb01d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:47.724037 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3b500-95fa-428b-8e0f-fc4ab6bdb01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:47.745990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-dea3b500-95fa-428b-8e0f-fc4ab6bdb01d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:47.747951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-dea3b500-95fa-428b-8e0f-fc4ab6bdb01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:47.773575 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:47.797420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1023/2059] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:47.799277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ddd23-1964-4181-b2f6-04fa72318edd None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:47.799588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ddd23-1964-4181-b2f6-04fa72318edd None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:47.799907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ddd23-1964-4181-b2f6-04fa72318edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:47.823983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-fa9ddd23-1964-4181-b2f6-04fa72318edd None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:47.825854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fa9ddd23-1964-4181-b2f6-04fa72318edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:47.838420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1037/2060] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:47.840316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1024/2061] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:47.853552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ddd23-1964-4181-b2f6-04fa72318edd None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:47.853647 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3b500-95fa-428b-8e0f-fc4ab6bdb01d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:47.853741 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fa9ddd23-1964-4181-b2f6-04fa72318edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:47.863386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3b500-95fa-428b-8e0f-fc4ab6bdb01d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:47.869605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcecb95-eff1-4543-a15c-886fa22775c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:47.870293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcecb95-eff1-4543-a15c-886fa22775c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:47.870576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcecb95-eff1-4543-a15c-886fa22775c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:47.870852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcecb95-eff1-4543-a15c-886fa22775c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:47.871599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcecb95-eff1-4543-a15c-886fa22775c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:47.871928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcecb95-eff1-4543-a15c-886fa22775c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:47.874785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcecb95-eff1-4543-a15c-886fa22775c1 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:47.888597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1038/2062] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:47.894105 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcecb95-eff1-4543-a15c-886fa22775c1 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:47.906425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcecb95-eff1-4543-a15c-886fa22775c1 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:47.911716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286a503-0ee0-441b-bb68-3c0d95709ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:47.912910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286a503-0ee0-441b-bb68-3c0d95709ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:47.913235 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286a503-0ee0-441b-bb68-3c0d95709ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:47.913605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286a503-0ee0-441b-bb68-3c0d95709ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:47.914324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286a503-0ee0-441b-bb68-3c0d95709ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:47.916412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286a503-0ee0-441b-bb68-3c0d95709ae0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:47.920142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ddd23-1964-4181-b2f6-04fa72318edd None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:47.924701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3597f-9471-405a-a0e1-da6521bfeb98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:47.925380 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3597f-9471-405a-a0e1-da6521bfeb98 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:47.925651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3597f-9471-405a-a0e1-da6521bfeb98 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:47.928914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3597f-9471-405a-a0e1-da6521bfeb98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:47.941031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3597f-9471-405a-a0e1-da6521bfeb98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:47.942827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3597f-9471-405a-a0e1-da6521bfeb98 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:47.948044 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1039/2063] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:47 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:50:47.949415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286a503-0ee0-441b-bb68-3c0d95709ae0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:47.956464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1025/2064] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:50:47.965976 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:48.022847 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286a503-0ee0-441b-bb68-3c0d95709ae0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:48.028650 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2839c63-0e3e-48ad-8d21-d8f9c765d527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:48.029338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2839c63-0e3e-48ad-8d21-d8f9c765d527 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:48.029621 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2839c63-0e3e-48ad-8d21-d8f9c765d527 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:48.030010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2839c63-0e3e-48ad-8d21-d8f9c765d527 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:48.031403 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2839c63-0e3e-48ad-8d21-d8f9c765d527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:48.033400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2839c63-0e3e-48ad-8d21-d8f9c765d527 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:48.056803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1040/2065] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:47 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:50:48.061811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3597f-9471-405a-a0e1-da6521bfeb98 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:48.072406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3597f-9471-405a-a0e1-da6521bfeb98 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:48.077841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ced820-8f0b-4868-8115-0e530e49c9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:48.078509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ced820-8f0b-4868-8115-0e530e49c9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:48.078785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ced820-8f0b-4868-8115-0e530e49c9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:48.079059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ced820-8f0b-4868-8115-0e530e49c9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:48.079792 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ced820-8f0b-4868-8115-0e530e49c9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:48.081427 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ced820-8f0b-4868-8115-0e530e49c9b5 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:48.091798 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1026/2066] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:50:48.096017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2839c63-0e3e-48ad-8d21-d8f9c765d527 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:48.106765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2839c63-0e3e-48ad-8d21-d8f9c765d527 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:48.113120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183ec52-b026-4ef0-a207-1780bc0f52f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:48.119841 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183ec52-b026-4ef0-a207-1780bc0f52f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:48.120270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183ec52-b026-4ef0-a207-1780bc0f52f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:48.120592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183ec52-b026-4ef0-a207-1780bc0f52f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:48.121409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183ec52-b026-4ef0-a207-1780bc0f52f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:48.123089 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183ec52-b026-4ef0-a207-1780bc0f52f9 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:48.148391 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1041/2067] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:48.149925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ced820-8f0b-4868-8115-0e530e49c9b5 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:48.161221 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ced820-8f0b-4868-8115-0e530e49c9b5 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:48.165973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f609f30-2f24-4619-8b93-bab3a8642fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:48.166880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f609f30-2f24-4619-8b93-bab3a8642fae admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:48.167192 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f609f30-2f24-4619-8b93-bab3a8642fae admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:48.167470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f609f30-2f24-4619-8b93-bab3a8642fae admin admin] PATH_INFO: `/v3/projects/11fadb4c78064684a79aad2bd747a107/users/a8328d726e0f413ca43e911a20e086d8/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:48.184119 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f609f30-2f24-4619-8b93-bab3a8642fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=11fadb4c78064684a79aad2bd747a107, user_id=a8328d726e0f413ca43e911a20e086d8, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:48.187679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f609f30-2f24-4619-8b93-bab3a8642fae admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:48.203776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1027/2068] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:48 2022] PUT /identity/v3/projects/11fadb4c78064684a79aad2bd747a107/users/a8328d726e0f413ca43e911a20e086d8/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:48.214647 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de5b44-9781-4b66-ba3a-d1068cab6aab None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:48.214948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de5b44-9781-4b66-ba3a-d1068cab6aab None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:48.215226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de5b44-9781-4b66-ba3a-d1068cab6aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:48.242973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-c8de5b44-9781-4b66-ba3a-d1068cab6aab None None] MFA Rules not processed for user `a8328d726e0f413ca43e911a20e086d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:48.244189 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c8de5b44-9781-4b66-ba3a-d1068cab6aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:48.249238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f609f30-2f24-4619-8b93-bab3a8642fae admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:48.252156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5f609f30-2f24-4619-8b93-bab3a8642fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:48.322881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1042/2069] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:48.329140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f609f30-2f24-4619-8b93-bab3a8642fae admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:48.334604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:48.335253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de5b44-9781-4b66-ba3a-d1068cab6aab None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:48.335491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:48.335776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:48.336050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] PATH_INFO: `/v3/projects/02793f148bf54c3394ef0351411ccf1b` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:48.336811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c8de5b44-9781-4b66-ba3a-d1068cab6aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:48.337336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02793f148bf54c3394ef0351411ccf1b)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:48.339263 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:48.387773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02793f148bf54c3394ef0351411ccf1b', 'request_id': 'req-351826b2-240e-4186-a710-de2bb4315871'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:48.394277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02793f148bf54c3394ef0351411ccf1b', 'request_id': 'req-351826b2-240e-4186-a710-de2bb4315871'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:48.395534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:48.396005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de5b44-9781-4b66-ba3a-d1068cab6aab None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:48.404006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02793f148bf54c3394ef0351411ccf1b', 'request_id': 'req-351826b2-240e-4186-a710-de2bb4315871'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:48.425240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] The token cache is being invalidate because project 02793f148bf54c3394ef0351411ccf1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:48.425638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:48.426515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:48.429089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1028/2070] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:48 2022] DELETE /identity/v3/projects/02793f148bf54c3394ef0351411ccf1b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:50:48.433880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:48.435456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:48.438697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:48.456253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764470e-6076-499b-b9a6-8f38f6d1ee08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:48.457096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764470e-6076-499b-b9a6-8f38f6d1ee08 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:48.457637 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764470e-6076-499b-b9a6-8f38f6d1ee08 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:48.458036 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764470e-6076-499b-b9a6-8f38f6d1ee08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:48.460321 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d764470e-6076-499b-b9a6-8f38f6d1ee08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:48.511402 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351826b2-240e-4186-a710-de2bb4315871 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:48.517131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e020331-dcbe-4cac-9deb-097d2a5d6e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:48.518014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e020331-dcbe-4cac-9deb-097d2a5d6e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:48.518291 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e020331-dcbe-4cac-9deb-097d2a5d6e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:48.518562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e020331-dcbe-4cac-9deb-097d2a5d6e4c admin admin] PATH_INFO: `/v3/users/92f638851d0a4a348db873d579ff3977` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:48.519866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e020331-dcbe-4cac-9deb-097d2a5d6e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f638851d0a4a348db873d579ff3977)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:48.521840 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e020331-dcbe-4cac-9deb-097d2a5d6e4c admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:48.528796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764470e-6076-499b-b9a6-8f38f6d1ee08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:48.530330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764470e-6076-499b-b9a6-8f38f6d1ee08 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:48.539605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1043/2071] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:50:48.574713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6e020331-dcbe-4cac-9deb-097d2a5d6e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f638851d0a4a348db873d579ff3977'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:48.582125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6e020331-dcbe-4cac-9deb-097d2a5d6e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f638851d0a4a348db873d579ff3977'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:48.582818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6e020331-dcbe-4cac-9deb-097d2a5d6e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f638851d0a4a348db873d579ff3977'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:48.583457 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6e020331-dcbe-4cac-9deb-097d2a5d6e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f638851d0a4a348db873d579ff3977'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:48.592463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6e020331-dcbe-4cac-9deb-097d2a5d6e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f638851d0a4a348db873d579ff3977'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:48.613794 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1029/2072] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:48 2022] DELETE /identity/v3/users/92f638851d0a4a348db873d579ff3977 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:48.965913 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764470e-6076-499b-b9a6-8f38f6d1ee08 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:48.983665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764470e-6076-499b-b9a6-8f38f6d1ee08 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:49.050640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:49.051614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.051961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.052313 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f admin admin] PATH_INFO: `/v3/projects/fbc851a3640d4f9aa60cf37eccf70ee6` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.053602 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc851a3640d4f9aa60cf37eccf70ee6)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:49.055550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:49.104178 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc851a3640d4f9aa60cf37eccf70ee6', 'request_id': 'req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:49.110489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc851a3640d4f9aa60cf37eccf70ee6', 'request_id': 'req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:49.116428 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc851a3640d4f9aa60cf37eccf70ee6', 'request_id': 'req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:49.130288 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f admin admin] The token cache is being invalidate because project fbc851a3640d4f9aa60cf37eccf70ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:49.130577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:49.131212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-cf9fbb90-f2a1-4455-aaae-6850b564eb9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:49.132852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1044/2073] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:48 2022] DELETE /identity/v3/projects/fbc851a3640d4f9aa60cf37eccf70ee6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:49.137756 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607116fc-9cfd-4d2b-b25b-db480e194847 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.138044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607116fc-9cfd-4d2b-b25b-db480e194847 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.138320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607116fc-9cfd-4d2b-b25b-db480e194847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.156926 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-607116fc-9cfd-4d2b-b25b-db480e194847 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:49.158064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-607116fc-9cfd-4d2b-b25b-db480e194847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:49.222827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1030/2074] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:49.231724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe92a1d-48ab-4e13-9564-c141bc975296 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.232035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe92a1d-48ab-4e13-9564-c141bc975296 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.232398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe92a1d-48ab-4e13-9564-c141bc975296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.251190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-5fe92a1d-48ab-4e13-9564-c141bc975296 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:49.252447 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5fe92a1d-48ab-4e13-9564-c141bc975296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:49.260769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1045/2075] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:49.265235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607116fc-9cfd-4d2b-b25b-db480e194847 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:49.275407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607116fc-9cfd-4d2b-b25b-db480e194847 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:49.281310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe03a3-52b9-423c-9d4e-46d714da5b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:49.281961 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe03a3-52b9-423c-9d4e-46d714da5b41 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.282241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe03a3-52b9-423c-9d4e-46d714da5b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.282513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe03a3-52b9-423c-9d4e-46d714da5b41 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.283286 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe03a3-52b9-423c-9d4e-46d714da5b41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:49.283592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe03a3-52b9-423c-9d4e-46d714da5b41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:49.285250 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe03a3-52b9-423c-9d4e-46d714da5b41 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:49.286778 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:49.298823 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1031/2076] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:49.302961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe92a1d-48ab-4e13-9564-c141bc975296 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:49.312863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe92a1d-48ab-4e13-9564-c141bc975296 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:49.318380 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f1f24-1b82-41be-9cf0-08adb4f66496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:49.319037 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f1f24-1b82-41be-9cf0-08adb4f66496 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.319316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f1f24-1b82-41be-9cf0-08adb4f66496 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.319587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f1f24-1b82-41be-9cf0-08adb4f66496 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.320328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f1f24-1b82-41be-9cf0-08adb4f66496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:49.322269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f1f24-1b82-41be-9cf0-08adb4f66496 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:49.336174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:49.352793 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1046/2077] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:49 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:49.357465 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe03a3-52b9-423c-9d4e-46d714da5b41 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:49.368145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe03a3-52b9-423c-9d4e-46d714da5b41 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:49.426443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d115f-815b-40be-95c8-d46c30e2b1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:49.427030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d115f-815b-40be-95c8-d46c30e2b1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.427299 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d115f-815b-40be-95c8-d46c30e2b1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.427590 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d115f-815b-40be-95c8-d46c30e2b1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.428280 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d115f-815b-40be-95c8-d46c30e2b1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:49.430250 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d115f-815b-40be-95c8-d46c30e2b1c3 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:49.453540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1032/2078] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:49 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:49.457692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f1f24-1b82-41be-9cf0-08adb4f66496 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:49.468500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f1f24-1b82-41be-9cf0-08adb4f66496 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:49.473404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dd935-7747-47c7-ae9a-e81b98ea742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:49.474083 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dd935-7747-47c7-ae9a-e81b98ea742f admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.474368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dd935-7747-47c7-ae9a-e81b98ea742f admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.474646 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dd935-7747-47c7-ae9a-e81b98ea742f admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.475383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dd935-7747-47c7-ae9a-e81b98ea742f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:49.477030 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dd935-7747-47c7-ae9a-e81b98ea742f admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:49.488596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1047/2079] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:49.492976 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d115f-815b-40be-95c8-d46c30e2b1c3 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:49.503616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d115f-815b-40be-95c8-d46c30e2b1c3 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:49.509273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90071f18-98e7-4879-b8c4-75a8a4b4a7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:49.509918 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90071f18-98e7-4879-b8c4-75a8a4b4a7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.510199 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90071f18-98e7-4879-b8c4-75a8a4b4a7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.510469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90071f18-98e7-4879-b8c4-75a8a4b4a7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.511203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90071f18-98e7-4879-b8c4-75a8a4b4a7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:49.512845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90071f18-98e7-4879-b8c4-75a8a4b4a7e9 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:49.523754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1033/2080] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:49.528041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dd935-7747-47c7-ae9a-e81b98ea742f admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:49.539760 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dd935-7747-47c7-ae9a-e81b98ea742f admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:49.544960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554e4f8-ac93-4e5e-8c1f-92fc4ef7a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:49.546082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554e4f8-ac93-4e5e-8c1f-92fc4ef7a939 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.546387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554e4f8-ac93-4e5e-8c1f-92fc4ef7a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.546681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554e4f8-ac93-4e5e-8c1f-92fc4ef7a939 admin admin] PATH_INFO: `/v3/projects/1caf1bd65c0449f7a8c806ca3c8105fa/users/37fdecd968f7487b838d065966670d6a/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.565077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554e4f8-ac93-4e5e-8c1f-92fc4ef7a939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1caf1bd65c0449f7a8c806ca3c8105fa, user_id=37fdecd968f7487b838d065966670d6a, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:49.567755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554e4f8-ac93-4e5e-8c1f-92fc4ef7a939 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:49.582827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1048/2081] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:49 2022] PUT /identity/v3/projects/1caf1bd65c0449f7a8c806ca3c8105fa/users/37fdecd968f7487b838d065966670d6a/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:49.593611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818bfc6-bed8-4cdc-ad10-5a5e2314de60 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.594134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818bfc6-bed8-4cdc-ad10-5a5e2314de60 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.594134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818bfc6-bed8-4cdc-ad10-5a5e2314de60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.624735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-5818bfc6-bed8-4cdc-ad10-5a5e2314de60 None None] MFA Rules not processed for user `37fdecd968f7487b838d065966670d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:49.625955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5818bfc6-bed8-4cdc-ad10-5a5e2314de60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:49.702242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1034/2082] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:49.707401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554e4f8-ac93-4e5e-8c1f-92fc4ef7a939 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:49.771727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554e4f8-ac93-4e5e-8c1f-92fc4ef7a939 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:49.776662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80024df0-6cad-4e73-b9a7-c3499cabcc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:49.777318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80024df0-6cad-4e73-b9a7-c3499cabcc0f admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.777599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80024df0-6cad-4e73-b9a7-c3499cabcc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.777873 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80024df0-6cad-4e73-b9a7-c3499cabcc0f admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.778559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80024df0-6cad-4e73-b9a7-c3499cabcc0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:49.780557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80024df0-6cad-4e73-b9a7-c3499cabcc0f admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:49.807896 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1049/2083] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:49 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:49.812745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818bfc6-bed8-4cdc-ad10-5a5e2314de60 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:49.823815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818bfc6-bed8-4cdc-ad10-5a5e2314de60 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:49.883119 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b279e-864e-4ea4-9c7f-128d9d102216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:49.883793 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b279e-864e-4ea4-9c7f-128d9d102216 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.884178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b279e-864e-4ea4-9c7f-128d9d102216 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.884518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b279e-864e-4ea4-9c7f-128d9d102216 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.885208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b279e-864e-4ea4-9c7f-128d9d102216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:49.887135 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b279e-864e-4ea4-9c7f-128d9d102216 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:49.895972 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:49.910132 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1035/2084] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:49 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:49.914215 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80024df0-6cad-4e73-b9a7-c3499cabcc0f admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:49.925769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80024df0-6cad-4e73-b9a7-c3499cabcc0f admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:49.935537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793b348-645a-4e91-9c39-70abb62c5633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:49.936409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793b348-645a-4e91-9c39-70abb62c5633 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.936545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793b348-645a-4e91-9c39-70abb62c5633 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.936826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793b348-645a-4e91-9c39-70abb62c5633 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.937574 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793b348-645a-4e91-9c39-70abb62c5633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:49.939278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793b348-645a-4e91-9c39-70abb62c5633 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:49.952168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1050/2085] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:50:49.955242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b279e-864e-4ea4-9c7f-128d9d102216 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:49.966221 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b279e-864e-4ea4-9c7f-128d9d102216 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:49.971359 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb96f8-ca75-4dfe-96f5-a64a2daeca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:49.972262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb96f8-ca75-4dfe-96f5-a64a2daeca88 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:49.972586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb96f8-ca75-4dfe-96f5-a64a2daeca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:49.973209 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb96f8-ca75-4dfe-96f5-a64a2daeca88 admin admin] PATH_INFO: `/v3/projects/3dc949df4f6a4457b47024da73e46b3e/users/4fe38269b35b4dbc89a90e0bffc55d4c/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:49.988506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb96f8-ca75-4dfe-96f5-a64a2daeca88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc949df4f6a4457b47024da73e46b3e, user_id=4fe38269b35b4dbc89a90e0bffc55d4c, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:49.991183 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb96f8-ca75-4dfe-96f5-a64a2daeca88 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:50.005226 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1036/2086] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:49 2022] PUT /identity/v3/projects/3dc949df4f6a4457b47024da73e46b3e/users/4fe38269b35b4dbc89a90e0bffc55d4c/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:50.009246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793b348-645a-4e91-9c39-70abb62c5633 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:50.019776 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793b348-645a-4e91-9c39-70abb62c5633 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:50.091573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42884aaf-fe2c-4a8d-835d-4e051f963ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:50.092256 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884aaf-fe2c-4a8d-835d-4e051f963ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:50.092607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884aaf-fe2c-4a8d-835d-4e051f963ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:50.093486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884aaf-fe2c-4a8d-835d-4e051f963ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:50.094233 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42884aaf-fe2c-4a8d-835d-4e051f963ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:50.095850 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42884aaf-fe2c-4a8d-835d-4e051f963ff6 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:50.109332 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1051/2087] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:50.110536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb96f8-ca75-4dfe-96f5-a64a2daeca88 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:50.120919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb96f8-ca75-4dfe-96f5-a64a2daeca88 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:50.126223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097038e-357a-4837-a7d4-94cf2871f8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:50.127208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097038e-357a-4837-a7d4-94cf2871f8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:50.127496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097038e-357a-4837-a7d4-94cf2871f8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:50.127773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097038e-357a-4837-a7d4-94cf2871f8f0 admin admin] PATH_INFO: `/v3/projects/3dc949df4f6a4457b47024da73e46b3e/users/4fe38269b35b4dbc89a90e0bffc55d4c/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:50.129803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097038e-357a-4837-a7d4-94cf2871f8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc949df4f6a4457b47024da73e46b3e, user_id=4fe38269b35b4dbc89a90e0bffc55d4c, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:50.132501 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097038e-357a-4837-a7d4-94cf2871f8f0 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:50.144323 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1037/2088] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:50 2022] PUT /identity/v3/projects/3dc949df4f6a4457b47024da73e46b3e/users/4fe38269b35b4dbc89a90e0bffc55d4c/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:50.154487 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080d417-dab2-4f31-a4dd-eacc92837e1f None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:50.154897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080d417-dab2-4f31-a4dd-eacc92837e1f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:50.155310 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080d417-dab2-4f31-a4dd-eacc92837e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:50.183514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3080d417-dab2-4f31-a4dd-eacc92837e1f None None] MFA Rules not processed for user `4fe38269b35b4dbc89a90e0bffc55d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:50.184777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3080d417-dab2-4f31-a4dd-eacc92837e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:50.203571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:50.258308 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1052/2089] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:50.273406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097038e-357a-4837-a7d4-94cf2871f8f0 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:50.276523 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e097038e-357a-4837-a7d4-94cf2871f8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:50.338797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097038e-357a-4837-a7d4-94cf2871f8f0 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:50.342690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc19d2-5d52-48fd-b8e0-bb16f3286833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:50.343525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc19d2-5d52-48fd-b8e0-bb16f3286833 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:50.343808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc19d2-5d52-48fd-b8e0-bb16f3286833 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:50.344085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc19d2-5d52-48fd-b8e0-bb16f3286833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:50.353175 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc19d2-5d52-48fd-b8e0-bb16f3286833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:50.354684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc19d2-5d52-48fd-b8e0-bb16f3286833 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:50.364390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1038/2090] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:50.780815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080d417-dab2-4f31-a4dd-eacc92837e1f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:50.845094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080d417-dab2-4f31-a4dd-eacc92837e1f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:50.849546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aa3a0-14e3-4ac9-820d-83dadb0294e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:50.850423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aa3a0-14e3-4ac9-820d-83dadb0294e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:50.850706 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aa3a0-14e3-4ac9-820d-83dadb0294e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:50.851034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aa3a0-14e3-4ac9-820d-83dadb0294e8 admin admin] PATH_INFO: `/v3/users/37fdecd968f7487b838d065966670d6a` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:50.852229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2aa3a0-14e3-4ac9-820d-83dadb0294e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37fdecd968f7487b838d065966670d6a)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:50.854253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2aa3a0-14e3-4ac9-820d-83dadb0294e8 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:50.913689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ce2aa3a0-14e3-4ac9-820d-83dadb0294e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37fdecd968f7487b838d065966670d6a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:50.922736 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ce2aa3a0-14e3-4ac9-820d-83dadb0294e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37fdecd968f7487b838d065966670d6a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:50.923417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ce2aa3a0-14e3-4ac9-820d-83dadb0294e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37fdecd968f7487b838d065966670d6a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:50.924045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ce2aa3a0-14e3-4ac9-820d-83dadb0294e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37fdecd968f7487b838d065966670d6a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:50.932911 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ce2aa3a0-14e3-4ac9-820d-83dadb0294e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37fdecd968f7487b838d065966670d6a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:50.951328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1053/2091] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:50 2022] DELETE /identity/v3/users/37fdecd968f7487b838d065966670d6a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:50.957313 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298803-46ad-42a4-8b63-d568fc74c322 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:50.957313 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298803-46ad-42a4-8b63-d568fc74c322 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:50.958187 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298803-46ad-42a4-8b63-d568fc74c322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:50.977586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-20298803-46ad-42a4-8b63-d568fc74c322 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:50.978811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-20298803-46ad-42a4-8b63-d568fc74c322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:51.047587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1039/2092] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:50:51.059340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aa3a0-14e3-4ac9-820d-83dadb0294e8 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:51.061233 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ce2aa3a0-14e3-4ac9-820d-83dadb0294e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:51.099076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:51.124059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aa3a0-14e3-4ac9-820d-83dadb0294e8 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:51.127681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99962e-8a3a-450e-8fb0-89062da27b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:51.128491 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99962e-8a3a-450e-8fb0-89062da27b66 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:51.128702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99962e-8a3a-450e-8fb0-89062da27b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:51.128931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99962e-8a3a-450e-8fb0-89062da27b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:51.138579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99962e-8a3a-450e-8fb0-89062da27b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:51.140437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99962e-8a3a-450e-8fb0-89062da27b66 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:51.150446 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1054/2093] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:51.430234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20298803-46ad-42a4-8b63-d568fc74c322 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:51.431772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-20298803-46ad-42a4-8b63-d568fc74c322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:51.446593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20298803-46ad-42a4-8b63-d568fc74c322 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:51.455094 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:51.463373 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:51.463673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:51.463955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] PATH_INFO: `/v3/projects/1caf1bd65c0449f7a8c806ca3c8105fa` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:51.465418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1caf1bd65c0449f7a8c806ca3c8105fa)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:51.467415 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:51.519424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1caf1bd65c0449f7a8c806ca3c8105fa', 'request_id': 'req-cb66d5d9-fc96-4d29-895b-f295c047c159'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:51.521305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:51.525809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1caf1bd65c0449f7a8c806ca3c8105fa', 'request_id': 'req-cb66d5d9-fc96-4d29-895b-f295c047c159'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:51.533008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1caf1bd65c0449f7a8c806ca3c8105fa', 'request_id': 'req-cb66d5d9-fc96-4d29-895b-f295c047c159'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:51.546771 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] The token cache is being invalidate because project 1caf1bd65c0449f7a8c806ca3c8105fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:51.547061 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:51.547677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:51.549264 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1040/2094] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:51 2022] DELETE /identity/v3/projects/1caf1bd65c0449f7a8c806ca3c8105fa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:51.553262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99962e-8a3a-450e-8fb0-89062da27b66 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:51.564322 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99962e-8a3a-450e-8fb0-89062da27b66 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:51.630803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251378f2-edd8-4e43-9c5b-1b036996e29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:51.631697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251378f2-edd8-4e43-9c5b-1b036996e29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:51.631976 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251378f2-edd8-4e43-9c5b-1b036996e29f admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:51.632252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251378f2-edd8-4e43-9c5b-1b036996e29f admin admin] PATH_INFO: `/v3/users/4fe38269b35b4dbc89a90e0bffc55d4c` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:51.633516 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251378f2-edd8-4e43-9c5b-1b036996e29f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe38269b35b4dbc89a90e0bffc55d4c)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:51.635459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251378f2-edd8-4e43-9c5b-1b036996e29f admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:51.695430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-251378f2-edd8-4e43-9c5b-1b036996e29f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe38269b35b4dbc89a90e0bffc55d4c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:51.705416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-251378f2-edd8-4e43-9c5b-1b036996e29f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe38269b35b4dbc89a90e0bffc55d4c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:51.706138 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-251378f2-edd8-4e43-9c5b-1b036996e29f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe38269b35b4dbc89a90e0bffc55d4c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:51.706794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-251378f2-edd8-4e43-9c5b-1b036996e29f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe38269b35b4dbc89a90e0bffc55d4c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:51.716685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-251378f2-edd8-4e43-9c5b-1b036996e29f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe38269b35b4dbc89a90e0bffc55d4c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:51.737486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1055/2095] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:51 2022] DELETE /identity/v3/users/4fe38269b35b4dbc89a90e0bffc55d4c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:52.008570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:52.010846 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:52.025087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66d5d9-fc96-4d29-895b-f295c047c159 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:52.102871 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254000d4-dedb-4a06-a2d4-0352bac61bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:52.103743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254000d4-dedb-4a06-a2d4-0352bac61bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:52.104024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254000d4-dedb-4a06-a2d4-0352bac61bed admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:52.104327 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254000d4-dedb-4a06-a2d4-0352bac61bed admin admin] PATH_INFO: `/v3/projects/3dc949df4f6a4457b47024da73e46b3e` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:52.105521 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254000d4-dedb-4a06-a2d4-0352bac61bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc949df4f6a4457b47024da73e46b3e)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:52.107451 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254000d4-dedb-4a06-a2d4-0352bac61bed admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:52.156647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-254000d4-dedb-4a06-a2d4-0352bac61bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc949df4f6a4457b47024da73e46b3e', 'request_id': 'req-254000d4-dedb-4a06-a2d4-0352bac61bed'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:52.162244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-254000d4-dedb-4a06-a2d4-0352bac61bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc949df4f6a4457b47024da73e46b3e', 'request_id': 'req-254000d4-dedb-4a06-a2d4-0352bac61bed'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:52.168621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-254000d4-dedb-4a06-a2d4-0352bac61bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc949df4f6a4457b47024da73e46b3e', 'request_id': 'req-254000d4-dedb-4a06-a2d4-0352bac61bed'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:52.182479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-254000d4-dedb-4a06-a2d4-0352bac61bed admin admin] The token cache is being invalidate because project 3dc949df4f6a4457b47024da73e46b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:52.182769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-254000d4-dedb-4a06-a2d4-0352bac61bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:52.183400 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-254000d4-dedb-4a06-a2d4-0352bac61bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:52.184989 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1041/2096] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:52 2022] DELETE /identity/v3/projects/3dc949df4f6a4457b47024da73e46b3e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:52.189993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529308-5274-4af9-b402-7d778475c3da None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:52.190487 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529308-5274-4af9-b402-7d778475c3da None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:52.190581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529308-5274-4af9-b402-7d778475c3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:52.209975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-0f529308-5274-4af9-b402-7d778475c3da None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:52.211196 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-0f529308-5274-4af9-b402-7d778475c3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:52.261213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:52.274541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1056/2097] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:52.282268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb8f3c-1f03-41d1-9319-eb7bc10bc259 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:52.282553 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb8f3c-1f03-41d1-9319-eb7bc10bc259 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:52.282826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb8f3c-1f03-41d1-9319-eb7bc10bc259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:52.301985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-f2eb8f3c-1f03-41d1-9319-eb7bc10bc259 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:52.303210 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-f2eb8f3c-1f03-41d1-9319-eb7bc10bc259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:52.316318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1042/2098] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:52.317384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f529308-5274-4af9-b402-7d778475c3da None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:52.329419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f529308-5274-4af9-b402-7d778475c3da None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:52.335226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963d71c-bf96-40d4-8f63-40ee4add0970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:52.335913 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963d71c-bf96-40d4-8f63-40ee4add0970 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:52.336199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963d71c-bf96-40d4-8f63-40ee4add0970 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:52.336664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963d71c-bf96-40d4-8f63-40ee4add0970 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:52.337422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963d71c-bf96-40d4-8f63-40ee4add0970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:50:52.337732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963d71c-bf96-40d4-8f63-40ee4add0970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:52.339396 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963d71c-bf96-40d4-8f63-40ee4add0970 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:52.352219 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1057/2099] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:50:52.357240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb8f3c-1f03-41d1-9319-eb7bc10bc259 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:52.366932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb8f3c-1f03-41d1-9319-eb7bc10bc259 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:52.371830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97df08-95a6-4f38-a308-b3e441b49c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:52.372524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97df08-95a6-4f38-a308-b3e441b49c9a admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:52.372810 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97df08-95a6-4f38-a308-b3e441b49c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:52.373084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97df08-95a6-4f38-a308-b3e441b49c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:52.373809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97df08-95a6-4f38-a308-b3e441b49c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:52.376047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97df08-95a6-4f38-a308-b3e441b49c9a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:52.405230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1043/2100] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:52 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:52.409643 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963d71c-bf96-40d4-8f63-40ee4add0970 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:52.420116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963d71c-bf96-40d4-8f63-40ee4add0970 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:52.480435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf3ef2-7c72-4b0d-8061-2be187fc75d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:52.480435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf3ef2-7c72-4b0d-8061-2be187fc75d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:52.480675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf3ef2-7c72-4b0d-8061-2be187fc75d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:52.480927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf3ef2-7c72-4b0d-8061-2be187fc75d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:52.481681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf3ef2-7c72-4b0d-8061-2be187fc75d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:52.483649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf3ef2-7c72-4b0d-8061-2be187fc75d4 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:52.505187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1058/2101] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:52 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:50:52.509371 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97df08-95a6-4f38-a308-b3e441b49c9a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:52.520387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97df08-95a6-4f38-a308-b3e441b49c9a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:52.525558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e88b2-5cd7-4a2c-8494-9dd8a4e1ba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:52.526225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e88b2-5cd7-4a2c-8494-9dd8a4e1ba73 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:52.526510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e88b2-5cd7-4a2c-8494-9dd8a4e1ba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:52.526785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e88b2-5cd7-4a2c-8494-9dd8a4e1ba73 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:52.527526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e88b2-5cd7-4a2c-8494-9dd8a4e1ba73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:52.529216 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e88b2-5cd7-4a2c-8494-9dd8a4e1ba73 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:52.540405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1044/2102] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:52.544487 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf3ef2-7c72-4b0d-8061-2be187fc75d4 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:52.554997 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf3ef2-7c72-4b0d-8061-2be187fc75d4 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:52.560817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20356e7b-5ba8-4991-91bf-d48c98fc1a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:52.561622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20356e7b-5ba8-4991-91bf-d48c98fc1a84 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:52.561920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20356e7b-5ba8-4991-91bf-d48c98fc1a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:52.562203 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20356e7b-5ba8-4991-91bf-d48c98fc1a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:52.563000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20356e7b-5ba8-4991-91bf-d48c98fc1a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:52.564724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20356e7b-5ba8-4991-91bf-d48c98fc1a84 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:52.575213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1059/2103] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:50:52.579278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e88b2-5cd7-4a2c-8494-9dd8a4e1ba73 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:52.589686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e88b2-5cd7-4a2c-8494-9dd8a4e1ba73 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:52.594526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20528d19-b2f3-4706-853b-4bea9fcb8761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:52.595397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20528d19-b2f3-4706-853b-4bea9fcb8761 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:52.595680 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20528d19-b2f3-4706-853b-4bea9fcb8761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:52.595963 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20528d19-b2f3-4706-853b-4bea9fcb8761 admin admin] PATH_INFO: `/v3/projects/425e5ac970424075959424404dbb7bc3/users/3249641be83f4e88b26b7a9df0020e99/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:52.613133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20528d19-b2f3-4706-853b-4bea9fcb8761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=425e5ac970424075959424404dbb7bc3, user_id=3249641be83f4e88b26b7a9df0020e99, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:52.615787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20528d19-b2f3-4706-853b-4bea9fcb8761 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:52.632084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1045/2104] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:52 2022] PUT /identity/v3/projects/425e5ac970424075959424404dbb7bc3/users/3249641be83f4e88b26b7a9df0020e99/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:52.638581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4d1b4-599e-4853-8eef-fbce83e5a76a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:52.640349 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4d1b4-599e-4853-8eef-fbce83e5a76a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:52.640853 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4d1b4-599e-4853-8eef-fbce83e5a76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:52.667362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-bbb4d1b4-599e-4853-8eef-fbce83e5a76a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:52.668910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-bbb4d1b4-599e-4853-8eef-fbce83e5a76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:52.748944 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1060/2105] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:52.758955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20528d19-b2f3-4706-853b-4bea9fcb8761 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:52.760625 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-20528d19-b2f3-4706-853b-4bea9fcb8761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:52.771424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:52.835131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20528d19-b2f3-4706-853b-4bea9fcb8761 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:52.839080 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab443b14-7d4f-44f8-a1a9-4a730945ff98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:52.839731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab443b14-7d4f-44f8-a1a9-4a730945ff98 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:52.840014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab443b14-7d4f-44f8-a1a9-4a730945ff98 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:52.840315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab443b14-7d4f-44f8-a1a9-4a730945ff98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:52.850193 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab443b14-7d4f-44f8-a1a9-4a730945ff98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:52.851645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab443b14-7d4f-44f8-a1a9-4a730945ff98 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:52.862088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1046/2106] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:53.632164 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b4b42-009f-4ab2-b963-dd081402e4db None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:53.632960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b4b42-009f-4ab2-b963-dd081402e4db None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:53.633131 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b4b42-009f-4ab2-b963-dd081402e4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:53.667792 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-4d4b4b42-009f-4ab2-b963-dd081402e4db None None] MFA Rules not processed for user `3249641be83f4e88b26b7a9df0020e99`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:53.669126 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4d4b4b42-009f-4ab2-b963-dd081402e4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:53.727165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:53.758181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1061/2107] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:53.759250 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab443b14-7d4f-44f8-a1a9-4a730945ff98 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:53.772529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab443b14-7d4f-44f8-a1a9-4a730945ff98 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:53.776135 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffe0c7-2675-47e6-aa2c-711adc13ba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:53.776877 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffe0c7-2675-47e6-aa2c-711adc13ba87 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:53.777304 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffe0c7-2675-47e6-aa2c-711adc13ba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:53.777631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffe0c7-2675-47e6-aa2c-711adc13ba87 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:53.778497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffe0c7-2675-47e6-aa2c-711adc13ba87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:53.781066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffe0c7-2675-47e6-aa2c-711adc13ba87 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:53.810198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1047/2108] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:50:53 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:53.814331 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b4b42-009f-4ab2-b963-dd081402e4db None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:53.824910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b4b42-009f-4ab2-b963-dd081402e4db None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:53.892166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96f7d5-2a17-4071-9684-09e3cdcbbe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:53.892884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96f7d5-2a17-4071-9684-09e3cdcbbe52 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:53.893239 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96f7d5-2a17-4071-9684-09e3cdcbbe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:53.893514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96f7d5-2a17-4071-9684-09e3cdcbbe52 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:53.894220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96f7d5-2a17-4071-9684-09e3cdcbbe52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:53.896446 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96f7d5-2a17-4071-9684-09e3cdcbbe52 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:53.923607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1062/2109] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:50:53 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:50:53.928316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffe0c7-2675-47e6-aa2c-711adc13ba87 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:53.940739 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffe0c7-2675-47e6-aa2c-711adc13ba87 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:53.946578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684e853-914c-44c6-9887-93d5039a8fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:53.947381 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684e853-914c-44c6-9887-93d5039a8fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:53.947733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684e853-914c-44c6-9887-93d5039a8fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:53.948078 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684e853-914c-44c6-9887-93d5039a8fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:53.948961 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684e853-914c-44c6-9887-93d5039a8fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:53.950720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684e853-914c-44c6-9887-93d5039a8fc8 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:53.968564 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1048/2110] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:50:53.970200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96f7d5-2a17-4071-9684-09e3cdcbbe52 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:53.981414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96f7d5-2a17-4071-9684-09e3cdcbbe52 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:53.987777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66126-8944-440a-8a56-4d3cbbf5eca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:53.988841 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66126-8944-440a-8a56-4d3cbbf5eca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:53.989197 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66126-8944-440a-8a56-4d3cbbf5eca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:53.989515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66126-8944-440a-8a56-4d3cbbf5eca0 admin admin] PATH_INFO: `/v3/projects/5e5e497a889d4b828e39378c8920aa58/users/b278e4c68f624eb5b29e0eb2f35f7322/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:54.011974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d66126-8944-440a-8a56-4d3cbbf5eca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5e497a889d4b828e39378c8920aa58, user_id=b278e4c68f624eb5b29e0eb2f35f7322, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:54.015581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d66126-8944-440a-8a56-4d3cbbf5eca0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:54.037534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1063/2111] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:53 2022] PUT /identity/v3/projects/5e5e497a889d4b828e39378c8920aa58/users/b278e4c68f624eb5b29e0eb2f35f7322/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:54.041576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684e853-914c-44c6-9887-93d5039a8fc8 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:54.055391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684e853-914c-44c6-9887-93d5039a8fc8 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:54.139303 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327d3e4-a096-4d8a-9662-dbe962a6d0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:54.140841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327d3e4-a096-4d8a-9662-dbe962a6d0db admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:54.141312 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327d3e4-a096-4d8a-9662-dbe962a6d0db admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:54.141651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327d3e4-a096-4d8a-9662-dbe962a6d0db admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:54.142536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327d3e4-a096-4d8a-9662-dbe962a6d0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:54.144611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327d3e4-a096-4d8a-9662-dbe962a6d0db admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:54.160362 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1049/2112] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:50:54.162258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66126-8944-440a-8a56-4d3cbbf5eca0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:54.174020 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66126-8944-440a-8a56-4d3cbbf5eca0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:54.179160 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a9a35-7fed-473e-8b74-a5d63eca9f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:54.180062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9a35-7fed-473e-8b74-a5d63eca9f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:54.180374 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9a35-7fed-473e-8b74-a5d63eca9f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:54.180995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9a35-7fed-473e-8b74-a5d63eca9f8a admin admin] PATH_INFO: `/v3/projects/5e5e497a889d4b828e39378c8920aa58/users/b278e4c68f624eb5b29e0eb2f35f7322/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:54.182631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a9a35-7fed-473e-8b74-a5d63eca9f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5e497a889d4b828e39378c8920aa58, user_id=b278e4c68f624eb5b29e0eb2f35f7322, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:54.189486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a9a35-7fed-473e-8b74-a5d63eca9f8a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:54.206176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1064/2113] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:50:54 2022] PUT /identity/v3/projects/5e5e497a889d4b828e39378c8920aa58/users/b278e4c68f624eb5b29e0eb2f35f7322/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:54.499980 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327d3e4-a096-4d8a-9662-dbe962a6d0db admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:54.502259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e327d3e4-a096-4d8a-9662-dbe962a6d0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:54.514981 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327d3e4-a096-4d8a-9662-dbe962a6d0db admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:54.581118 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2232f-9bf1-4562-85f1-d425141e4d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:54.582237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2232f-9bf1-4562-85f1-d425141e4d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:54.582586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2232f-9bf1-4562-85f1-d425141e4d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:54.582930 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2232f-9bf1-4562-85f1-d425141e4d05 admin admin] PATH_INFO: `/v3/users/a8328d726e0f413ca43e911a20e086d8` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:54.584642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2232f-9bf1-4562-85f1-d425141e4d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8328d726e0f413ca43e911a20e086d8)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:54.586660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2232f-9bf1-4562-85f1-d425141e4d05 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:54.602604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:54.654356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b6e2232f-9bf1-4562-85f1-d425141e4d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8328d726e0f413ca43e911a20e086d8'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:54.664393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b6e2232f-9bf1-4562-85f1-d425141e4d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8328d726e0f413ca43e911a20e086d8'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:54.665135 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b6e2232f-9bf1-4562-85f1-d425141e4d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8328d726e0f413ca43e911a20e086d8'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:54.665750 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b6e2232f-9bf1-4562-85f1-d425141e4d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8328d726e0f413ca43e911a20e086d8'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:54.674101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b6e2232f-9bf1-4562-85f1-d425141e4d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8328d726e0f413ca43e911a20e086d8'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:54.694670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1050/2114] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:50:54 2022] DELETE /identity/v3/users/a8328d726e0f413ca43e911a20e086d8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:50:54.698984 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8040f7-7e42-4910-a908-e285a34cff97 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:54.699450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8040f7-7e42-4910-a908-e285a34cff97 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:54.699643 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8040f7-7e42-4910-a908-e285a34cff97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:54.718800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-2c8040f7-7e42-4910-a908-e285a34cff97 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:54.720102 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2c8040f7-7e42-4910-a908-e285a34cff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:54.783426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1065/2115] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:54.793990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2232f-9bf1-4562-85f1-d425141e4d05 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:54.795525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b6e2232f-9bf1-4562-85f1-d425141e4d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:54.865183 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2232f-9bf1-4562-85f1-d425141e4d05 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:54.868787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5f095-59de-418c-bdaa-f86762461de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:54.869466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5f095-59de-418c-bdaa-f86762461de8 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:54.869744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5f095-59de-418c-bdaa-f86762461de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:54.870018 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5f095-59de-418c-bdaa-f86762461de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:54.880141 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5f095-59de-418c-bdaa-f86762461de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:54.881550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5f095-59de-418c-bdaa-f86762461de8 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:54.893295 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1051/2116] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:50:54.960272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85be464-85e7-4a2d-a1be-ed0267266f8d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:54.960615 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85be464-85e7-4a2d-a1be-ed0267266f8d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:54.960921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85be464-85e7-4a2d-a1be-ed0267266f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:54.992746 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-b85be464-85e7-4a2d-a1be-ed0267266f8d None None] MFA Rules not processed for user `b278e4c68f624eb5b29e0eb2f35f7322`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:50:54.994074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b85be464-85e7-4a2d-a1be-ed0267266f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:55.031220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:55.077788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1066/2117] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:50:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:50:55.099985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5f095-59de-418c-bdaa-f86762461de8 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:55.102257 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a0e5f095-59de-418c-bdaa-f86762461de8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:55.171707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5f095-59de-418c-bdaa-f86762461de8 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:55.177336 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd48b8-44e3-4812-a576-feab7ff9a65c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:55.178628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd48b8-44e3-4812-a576-feab7ff9a65c service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:55.179178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd48b8-44e3-4812-a576-feab7ff9a65c service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:55.179465 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd48b8-44e3-4812-a576-feab7ff9a65c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:55.181338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-23dd48b8-44e3-4812-a576-feab7ff9a65c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:55.225494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85be464-85e7-4a2d-a1be-ed0267266f8d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:55.227281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b85be464-85e7-4a2d-a1be-ed0267266f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:55.241406 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85be464-85e7-4a2d-a1be-ed0267266f8d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:55.246975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:55.247995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:55.248274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:55.248585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] PATH_INFO: `/v3/projects/11fadb4c78064684a79aad2bd747a107` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:55.249868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11fadb4c78064684a79aad2bd747a107)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:55.251971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:55.261139 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:50:55.275360 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd48b8-44e3-4812-a576-feab7ff9a65c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:55.276858 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd48b8-44e3-4812-a576-feab7ff9a65c service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:55.287618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1052/2118] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:50:55.302567 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11fadb4c78064684a79aad2bd747a107', 'request_id': 'req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:55.309003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11fadb4c78064684a79aad2bd747a107', 'request_id': 'req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:55.314886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11fadb4c78064684a79aad2bd747a107', 'request_id': 'req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:55.328182 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] The token cache is being invalidate because project 11fadb4c78064684a79aad2bd747a107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:50:55.328527 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:55.329268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:50:55.331061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1067/2119] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:50:55 2022] DELETE /identity/v3/projects/11fadb4c78064684a79aad2bd747a107 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:50:57.749282 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd48b8-44e3-4812-a576-feab7ff9a65c service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:50:57.758407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd48b8-44e3-4812-a576-feab7ff9a65c service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:50:57.810842 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283d841-66bb-44c1-bf1f-29b3bceae4a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:50:57.811532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d841-66bb-44c1-bf1f-29b3bceae4a8 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:50:57.811806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d841-66bb-44c1-bf1f-29b3bceae4a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:50:57.812091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d841-66bb-44c1-bf1f-29b3bceae4a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:50:57.814161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2283d841-66bb-44c1-bf1f-29b3bceae4a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:50:57.896771 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283d841-66bb-44c1-bf1f-29b3bceae4a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:50:57.897953 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283d841-66bb-44c1-bf1f-29b3bceae4a8 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:50:57.908775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1053/2120] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:50:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:05.324842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:07.545110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:07.547324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:07.636388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663eb0a9-1eb3-4b98-84bf-09cecd31abe0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:07.641383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48781db2-6816-46d2-a5db-1034eeecc76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:07.642271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48781db2-6816-46d2-a5db-1034eeecc76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:07.642549 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48781db2-6816-46d2-a5db-1034eeecc76a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:07.642831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48781db2-6816-46d2-a5db-1034eeecc76a admin admin] PATH_INFO: `/v3/users/e25f6765cda949bdb7f066ce9a28851a` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:07.644008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48781db2-6816-46d2-a5db-1034eeecc76a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25f6765cda949bdb7f066ce9a28851a)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:07.646028 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48781db2-6816-46d2-a5db-1034eeecc76a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:07.701542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-48781db2-6816-46d2-a5db-1034eeecc76a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25f6765cda949bdb7f066ce9a28851a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:07.708953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-48781db2-6816-46d2-a5db-1034eeecc76a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25f6765cda949bdb7f066ce9a28851a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:07.709981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-48781db2-6816-46d2-a5db-1034eeecc76a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25f6765cda949bdb7f066ce9a28851a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:07.712064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-48781db2-6816-46d2-a5db-1034eeecc76a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25f6765cda949bdb7f066ce9a28851a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:07.721869 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-48781db2-6816-46d2-a5db-1034eeecc76a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25f6765cda949bdb7f066ce9a28851a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:07.740645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1068/2121] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:51:07 2022] DELETE /identity/v3/users/e25f6765cda949bdb7f066ce9a28851a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:07.745634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb31803-528e-410c-8bc4-fe7de24f0d3a None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:07.746143 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb31803-528e-410c-8bc4-fe7de24f0d3a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:07.746302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb31803-528e-410c-8bc4-fe7de24f0d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:07.764965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-2bb31803-528e-410c-8bc4-fe7de24f0d3a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:07.765955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2bb31803-528e-410c-8bc4-fe7de24f0d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:07.829646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1054/2122] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:51:07.843230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48781db2-6816-46d2-a5db-1034eeecc76a admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:07.844765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-48781db2-6816-46d2-a5db-1034eeecc76a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:07.906188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48781db2-6816-46d2-a5db-1034eeecc76a admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:07.910067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7f858-bdf7-48c6-bbb1-e5bc56cbb324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:07.910746 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7f858-bdf7-48c6-bbb1-e5bc56cbb324 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:07.911034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7f858-bdf7-48c6-bbb1-e5bc56cbb324 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:07.911315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7f858-bdf7-48c6-bbb1-e5bc56cbb324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:07.924867 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7f858-bdf7-48c6-bbb1-e5bc56cbb324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:07.926930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7f858-bdf7-48c6-bbb1-e5bc56cbb324 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:07.956069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1069/2123] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:08.539259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb31803-528e-410c-8bc4-fe7de24f0d3a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:08.541641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2bb31803-528e-410c-8bc4-fe7de24f0d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:08.573602 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb31803-528e-410c-8bc4-fe7de24f0d3a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:08.580898 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335255b-a625-4022-a05f-03d121217f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:08.582289 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335255b-a625-4022-a05f-03d121217f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:08.582568 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335255b-a625-4022-a05f-03d121217f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:08.583002 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335255b-a625-4022-a05f-03d121217f6f admin admin] PATH_INFO: `/v3/projects/34044a5cd3304817ad87c5fcf0725490` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:08.584614 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335255b-a625-4022-a05f-03d121217f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=34044a5cd3304817ad87c5fcf0725490)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:08.586979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335255b-a625-4022-a05f-03d121217f6f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:08.644186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:08.662836 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d335255b-a625-4022-a05f-03d121217f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34044a5cd3304817ad87c5fcf0725490', 'request_id': 'req-d335255b-a625-4022-a05f-03d121217f6f'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:08.672123 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d335255b-a625-4022-a05f-03d121217f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34044a5cd3304817ad87c5fcf0725490', 'request_id': 'req-d335255b-a625-4022-a05f-03d121217f6f'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:08.680839 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d335255b-a625-4022-a05f-03d121217f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34044a5cd3304817ad87c5fcf0725490', 'request_id': 'req-d335255b-a625-4022-a05f-03d121217f6f'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:08.699983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d335255b-a625-4022-a05f-03d121217f6f admin admin] The token cache is being invalidate because project 34044a5cd3304817ad87c5fcf0725490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:51:08.700514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d335255b-a625-4022-a05f-03d121217f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:08.701747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d335255b-a625-4022-a05f-03d121217f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:08.703596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1055/2124] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:51:08 2022] DELETE /identity/v3/projects/34044a5cd3304817ad87c5fcf0725490 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:08.708965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9aa9-8993-457b-ab94-4269a085a39b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:08.710520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9aa9-8993-457b-ab94-4269a085a39b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:08.710672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9aa9-8993-457b-ab94-4269a085a39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:08.732257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-79ba9aa9-8993-457b-ab94-4269a085a39b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:08.734190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-79ba9aa9-8993-457b-ab94-4269a085a39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:08.758991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:08.821477 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1070/2125] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:08.830093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626593fe-6631-4564-86a1-dc259b550e73 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:08.830992 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626593fe-6631-4564-86a1-dc259b550e73 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:08.831545 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626593fe-6631-4564-86a1-dc259b550e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:08.859632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-626593fe-6631-4564-86a1-dc259b550e73 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:08.861315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-626593fe-6631-4564-86a1-dc259b550e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:08.873471 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1056/2126] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:51:08.877895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba9aa9-8993-457b-ab94-4269a085a39b None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:08.890922 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba9aa9-8993-457b-ab94-4269a085a39b None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:08.897536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c77700-7c9d-482f-9de6-691bb89f2a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:08.898445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c77700-7c9d-482f-9de6-691bb89f2a21 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:08.898872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c77700-7c9d-482f-9de6-691bb89f2a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:08.899441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c77700-7c9d-482f-9de6-691bb89f2a21 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:08.900373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c77700-7c9d-482f-9de6-691bb89f2a21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:51:08.900846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c77700-7c9d-482f-9de6-691bb89f2a21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:08.902613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c77700-7c9d-482f-9de6-691bb89f2a21 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:08.922493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1071/2127] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:51:08.927690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626593fe-6631-4564-86a1-dc259b550e73 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:08.938962 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626593fe-6631-4564-86a1-dc259b550e73 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:08.944602 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4a5a4-2e00-4e7f-b1ee-3815e43e10c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:08.945311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4a5a4-2e00-4e7f-b1ee-3815e43e10c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:08.945632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4a5a4-2e00-4e7f-b1ee-3815e43e10c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:08.945912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4a5a4-2e00-4e7f-b1ee-3815e43e10c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:08.946621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4a5a4-2e00-4e7f-b1ee-3815e43e10c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:08.948610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4a5a4-2e00-4e7f-b1ee-3815e43e10c5 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:08.996223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1057/2128] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:51:08 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:08.998038 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c77700-7c9d-482f-9de6-691bb89f2a21 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:09.009048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c77700-7c9d-482f-9de6-691bb89f2a21 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:09.077300 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd81a3a-9ead-4dd1-9859-49d572221440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:09.077980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81a3a-9ead-4dd1-9859-49d572221440 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:09.078260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81a3a-9ead-4dd1-9859-49d572221440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:09.078531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81a3a-9ead-4dd1-9859-49d572221440 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:09.079241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd81a3a-9ead-4dd1-9859-49d572221440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:09.081659 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd81a3a-9ead-4dd1-9859-49d572221440 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:09.107333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1072/2129] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:51:08 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:51:09.111308 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4a5a4-2e00-4e7f-b1ee-3815e43e10c5 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:09.125229 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4a5a4-2e00-4e7f-b1ee-3815e43e10c5 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:09.141809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cca3f-ec4a-424a-8caf-0a08ec47f455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:09.142503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cca3f-ec4a-424a-8caf-0a08ec47f455 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:09.142788 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cca3f-ec4a-424a-8caf-0a08ec47f455 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:09.143064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cca3f-ec4a-424a-8caf-0a08ec47f455 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:09.146309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cca3f-ec4a-424a-8caf-0a08ec47f455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:09.147934 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cca3f-ec4a-424a-8caf-0a08ec47f455 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:09.165055 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1058/2130] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:51:09.169120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd81a3a-9ead-4dd1-9859-49d572221440 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:09.186679 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd81a3a-9ead-4dd1-9859-49d572221440 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:09.192601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e56ddb-17ba-451b-8edf-041a4ba48720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:09.193325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e56ddb-17ba-451b-8edf-041a4ba48720 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:09.193705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e56ddb-17ba-451b-8edf-041a4ba48720 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:09.193977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e56ddb-17ba-451b-8edf-041a4ba48720 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:09.194720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e56ddb-17ba-451b-8edf-041a4ba48720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:09.196455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e56ddb-17ba-451b-8edf-041a4ba48720 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:09.213748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cca3f-ec4a-424a-8caf-0a08ec47f455 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:09.215652 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-f03cca3f-ec4a-424a-8caf-0a08ec47f455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:09.216260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1073/2131] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:09.223577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e56ddb-17ba-451b-8edf-041a4ba48720 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:09.231089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cca3f-ec4a-424a-8caf-0a08ec47f455 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:09.240683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e56ddb-17ba-451b-8edf-041a4ba48720 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:09.241028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e7a5e-62d4-4334-a9f7-e14b87ee6c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:09.242018 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e7a5e-62d4-4334-a9f7-e14b87ee6c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:09.242302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e7a5e-62d4-4334-a9f7-e14b87ee6c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:09.242575 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e7a5e-62d4-4334-a9f7-e14b87ee6c28 admin admin] PATH_INFO: `/v3/users/c0e395655fb14e3b92ed88eb3ea231db` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:09.244076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e7a5e-62d4-4334-a9f7-e14b87ee6c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e395655fb14e3b92ed88eb3ea231db)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:09.246080 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706021e-cb4a-4b65-8007-243482d64824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:09.246203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e7a5e-62d4-4334-a9f7-e14b87ee6c28 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:09.247191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706021e-cb4a-4b65-8007-243482d64824 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:09.247578 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706021e-cb4a-4b65-8007-243482d64824 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:09.248543 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706021e-cb4a-4b65-8007-243482d64824 admin admin] PATH_INFO: `/v3/projects/ced4d5f781094e20a8622363a8c0dfe7/users/6ed6769d2b054d3b94d4817065e060e0/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:09.270435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706021e-cb4a-4b65-8007-243482d64824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced4d5f781094e20a8622363a8c0dfe7, user_id=6ed6769d2b054d3b94d4817065e060e0, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:09.275904 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706021e-cb4a-4b65-8007-243482d64824 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:09.290495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1074/2132] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:09 2022] PUT /identity/v3/projects/ced4d5f781094e20a8622363a8c0dfe7/users/6ed6769d2b054d3b94d4817065e060e0/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:09.301098 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d05f5-9f52-4c9b-9026-95dd11e98fa4 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:09.301385 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d05f5-9f52-4c9b-9026-95dd11e98fa4 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:09.301666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d05f5-9f52-4c9b-9026-95dd11e98fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:09.331020 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d25e7a5e-62d4-4334-a9f7-e14b87ee6c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e395655fb14e3b92ed88eb3ea231db'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:09.356185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-444d05f5-9f52-4c9b-9026-95dd11e98fa4 None None] MFA Rules not processed for user `6ed6769d2b054d3b94d4817065e060e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:09.357170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-444d05f5-9f52-4c9b-9026-95dd11e98fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:09.363880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d25e7a5e-62d4-4334-a9f7-e14b87ee6c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e395655fb14e3b92ed88eb3ea231db'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:09.365429 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d25e7a5e-62d4-4334-a9f7-e14b87ee6c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e395655fb14e3b92ed88eb3ea231db'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:09.366963 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d25e7a5e-62d4-4334-a9f7-e14b87ee6c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e395655fb14e3b92ed88eb3ea231db'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:09.383701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d25e7a5e-62d4-4334-a9f7-e14b87ee6c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e395655fb14e3b92ed88eb3ea231db'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:09.436847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1059/2133] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:51:09 2022] DELETE /identity/v3/users/c0e395655fb14e3b92ed88eb3ea231db => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:09.499445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:09.518510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1075/2134] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:09.700113 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e7a5e-62d4-4334-a9f7-e14b87ee6c28 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:09.702562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d25e7a5e-62d4-4334-a9f7-e14b87ee6c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:09.782171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:09.790006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e7a5e-62d4-4334-a9f7-e14b87ee6c28 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:09.797862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:09.798935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:09.799392 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:09.799677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7 admin admin] PATH_INFO: `/v3/projects/bf151ebb2425421d8cdc3e2773fbd558` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:09.801162 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf151ebb2425421d8cdc3e2773fbd558)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:09.803095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:09.853279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf151ebb2425421d8cdc3e2773fbd558', 'request_id': 'req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:09.859315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf151ebb2425421d8cdc3e2773fbd558', 'request_id': 'req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:09.865706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf151ebb2425421d8cdc3e2773fbd558', 'request_id': 'req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:09.878646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7 admin admin] The token cache is being invalidate because project bf151ebb2425421d8cdc3e2773fbd558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:51:09.878932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:09.879546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f324b9a5-5110-470e-bff6-d07ce8a0e4b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:09.881172 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1060/2135] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:51:09 2022] DELETE /identity/v3/projects/bf151ebb2425421d8cdc3e2773fbd558 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:09.886168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3295d-de1c-4551-8056-73709ea661e1 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:09.886651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3295d-de1c-4551-8056-73709ea661e1 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:09.886772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3295d-de1c-4551-8056-73709ea661e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:09.909906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-30c3295d-de1c-4551-8056-73709ea661e1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:09.911137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-30c3295d-de1c-4551-8056-73709ea661e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:09.976183 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1076/2136] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:09.982197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825197-d374-43b3-ab12-9565025d2250 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:09.982437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825197-d374-43b3-ab12-9565025d2250 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:09.982743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825197-d374-43b3-ab12-9565025d2250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:10.001787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-59825197-d374-43b3-ab12-9565025d2250 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:10.002993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-59825197-d374-43b3-ab12-9565025d2250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:10.013997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1061/2137] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:10.018250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3295d-de1c-4551-8056-73709ea661e1 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:10.028187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3295d-de1c-4551-8056-73709ea661e1 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:10.032864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbf6a3-7062-49bd-806a-4e32a81221a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:10.033526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbf6a3-7062-49bd-806a-4e32a81221a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:10.033808 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbf6a3-7062-49bd-806a-4e32a81221a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:10.034081 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbf6a3-7062-49bd-806a-4e32a81221a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:10.034848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbf6a3-7062-49bd-806a-4e32a81221a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:51:10.035126 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbf6a3-7062-49bd-806a-4e32a81221a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:10.036803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbf6a3-7062-49bd-806a-4e32a81221a7 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:10.049088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1077/2138] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:51:10.053586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825197-d374-43b3-ab12-9565025d2250 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:10.063680 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825197-d374-43b3-ab12-9565025d2250 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:10.068809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee951-69f3-4376-8036-9d8121b66e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:10.069469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee951-69f3-4376-8036-9d8121b66e34 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:10.069753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee951-69f3-4376-8036-9d8121b66e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:10.070027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee951-69f3-4376-8036-9d8121b66e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:10.070731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ee951-69f3-4376-8036-9d8121b66e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:10.072714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ee951-69f3-4376-8036-9d8121b66e34 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:10.106568 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1062/2139] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:51:10 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:10.112772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbf6a3-7062-49bd-806a-4e32a81221a7 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:10.123307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbf6a3-7062-49bd-806a-4e32a81221a7 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:10.184074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa73c4f-20f3-4dae-8679-a4ce3b4bce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:10.184816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa73c4f-20f3-4dae-8679-a4ce3b4bce94 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:10.185095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa73c4f-20f3-4dae-8679-a4ce3b4bce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:10.185376 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa73c4f-20f3-4dae-8679-a4ce3b4bce94 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:10.186153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa73c4f-20f3-4dae-8679-a4ce3b4bce94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:10.188091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa73c4f-20f3-4dae-8679-a4ce3b4bce94 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:10.210493 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1078/2140] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:51:10 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:10.214769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee951-69f3-4376-8036-9d8121b66e34 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:10.226773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee951-69f3-4376-8036-9d8121b66e34 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:10.232410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67942b61-3234-4dde-bd1b-32453df2be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:10.233713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942b61-3234-4dde-bd1b-32453df2be56 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:10.234022 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942b61-3234-4dde-bd1b-32453df2be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:10.234313 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942b61-3234-4dde-bd1b-32453df2be56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:10.235093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67942b61-3234-4dde-bd1b-32453df2be56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:10.236815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67942b61-3234-4dde-bd1b-32453df2be56 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:10.248522 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1063/2141] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:10.252721 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa73c4f-20f3-4dae-8679-a4ce3b4bce94 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:10.263637 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa73c4f-20f3-4dae-8679-a4ce3b4bce94 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:10.269083 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395b027-0b6d-4a40-af08-3bb351249f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:10.269678 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395b027-0b6d-4a40-af08-3bb351249f36 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:10.269936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395b027-0b6d-4a40-af08-3bb351249f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:10.270227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395b027-0b6d-4a40-af08-3bb351249f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:10.270956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395b027-0b6d-4a40-af08-3bb351249f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:10.272586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395b027-0b6d-4a40-af08-3bb351249f36 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:10.283403 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1079/2142] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:10.287904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67942b61-3234-4dde-bd1b-32453df2be56 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:10.298958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67942b61-3234-4dde-bd1b-32453df2be56 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:10.304220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4ff63-29e4-457d-9e00-3143ea27466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:10.305197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4ff63-29e4-457d-9e00-3143ea27466e admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:10.305476 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4ff63-29e4-457d-9e00-3143ea27466e admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:10.305732 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4ff63-29e4-457d-9e00-3143ea27466e admin admin] PATH_INFO: `/v3/projects/8e5aad4353bf4dc2ba841d971f7212f2/users/046cf5e98eca41c0a532e84f777efaab/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:10.321229 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4ff63-29e4-457d-9e00-3143ea27466e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5aad4353bf4dc2ba841d971f7212f2, user_id=046cf5e98eca41c0a532e84f777efaab, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:10.323951 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4ff63-29e4-457d-9e00-3143ea27466e admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:10.339783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1064/2143] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:10 2022] PUT /identity/v3/projects/8e5aad4353bf4dc2ba841d971f7212f2/users/046cf5e98eca41c0a532e84f777efaab/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:10.345412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c4007-895c-4369-b8d4-a58726f45f2b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:10.345781 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c4007-895c-4369-b8d4-a58726f45f2b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:10.346121 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c4007-895c-4369-b8d4-a58726f45f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:10.365226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-373c4007-895c-4369-b8d4-a58726f45f2b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:10.366539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-373c4007-895c-4369-b8d4-a58726f45f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:10.426354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:10.431373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1080/2144] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:51:10.440824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4ff63-29e4-457d-9e00-3143ea27466e admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:10.442544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-feb4ff63-29e4-457d-9e00-3143ea27466e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:10.504031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4ff63-29e4-457d-9e00-3143ea27466e admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:10.507747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d254f-fdfb-4b0e-83d2-af4fd0ed8dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:10.508418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d254f-fdfb-4b0e-83d2-af4fd0ed8dfd service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:10.508702 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d254f-fdfb-4b0e-83d2-af4fd0ed8dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:10.508974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d254f-fdfb-4b0e-83d2-af4fd0ed8dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:10.518768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d254f-fdfb-4b0e-83d2-af4fd0ed8dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:10.520257 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d254f-fdfb-4b0e-83d2-af4fd0ed8dfd service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:10.537574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1065/2145] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:14.191224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c4007-895c-4369-b8d4-a58726f45f2b None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:14.197788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-373c4007-895c-4369-b8d4-a58726f45f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:14.223934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c4007-895c-4369-b8d4-a58726f45f2b None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:14.231786 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30425f83-4ff4-439e-bad1-063ba68bd068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:14.233609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30425f83-4ff4-439e-bad1-063ba68bd068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:14.233902 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30425f83-4ff4-439e-bad1-063ba68bd068 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:14.234180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30425f83-4ff4-439e-bad1-063ba68bd068 admin admin] PATH_INFO: `/v3/users/3249641be83f4e88b26b7a9df0020e99` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:14.235498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30425f83-4ff4-439e-bad1-063ba68bd068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3249641be83f4e88b26b7a9df0020e99)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:14.237498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30425f83-4ff4-439e-bad1-063ba68bd068 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:14.319254 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-30425f83-4ff4-439e-bad1-063ba68bd068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3249641be83f4e88b26b7a9df0020e99'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:14.334428 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-30425f83-4ff4-439e-bad1-063ba68bd068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3249641be83f4e88b26b7a9df0020e99'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:14.335636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-30425f83-4ff4-439e-bad1-063ba68bd068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3249641be83f4e88b26b7a9df0020e99'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:14.336527 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-30425f83-4ff4-439e-bad1-063ba68bd068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3249641be83f4e88b26b7a9df0020e99'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:14.349295 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-30425f83-4ff4-439e-bad1-063ba68bd068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3249641be83f4e88b26b7a9df0020e99'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:14.389552 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1081/2146] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:51:14 2022] DELETE /identity/v3/users/3249641be83f4e88b26b7a9df0020e99 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:14.818978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d254f-fdfb-4b0e-83d2-af4fd0ed8dfd service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:14.831728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d254f-fdfb-4b0e-83d2-af4fd0ed8dfd service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:14.856362 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:14.902619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324590bd-e7c8-4377-b6ea-0bd47b0daec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:14.903839 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324590bd-e7c8-4377-b6ea-0bd47b0daec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:14.904125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324590bd-e7c8-4377-b6ea-0bd47b0daec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:14.904498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324590bd-e7c8-4377-b6ea-0bd47b0daec1 admin admin] PATH_INFO: `/v3/projects/425e5ac970424075959424404dbb7bc3` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:14.909111 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324590bd-e7c8-4377-b6ea-0bd47b0daec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=425e5ac970424075959424404dbb7bc3)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:14.912353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324590bd-e7c8-4377-b6ea-0bd47b0daec1 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:14.995250 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-324590bd-e7c8-4377-b6ea-0bd47b0daec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425e5ac970424075959424404dbb7bc3', 'request_id': 'req-324590bd-e7c8-4377-b6ea-0bd47b0daec1'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.004109 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-324590bd-e7c8-4377-b6ea-0bd47b0daec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425e5ac970424075959424404dbb7bc3', 'request_id': 'req-324590bd-e7c8-4377-b6ea-0bd47b0daec1'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.014174 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-324590bd-e7c8-4377-b6ea-0bd47b0daec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425e5ac970424075959424404dbb7bc3', 'request_id': 'req-324590bd-e7c8-4377-b6ea-0bd47b0daec1'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.038776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-324590bd-e7c8-4377-b6ea-0bd47b0daec1 admin admin] The token cache is being invalidate because project 425e5ac970424075959424404dbb7bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:51:15.039454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-324590bd-e7c8-4377-b6ea-0bd47b0daec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.042559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-324590bd-e7c8-4377-b6ea-0bd47b0daec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.045500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1066/2147] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:51:14 2022] DELETE /identity/v3/projects/425e5ac970424075959424404dbb7bc3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:15.050067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30425f83-4ff4-439e-bad1-063ba68bd068 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:15.051710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-30425f83-4ff4-439e-bad1-063ba68bd068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:15.068644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30425f83-4ff4-439e-bad1-063ba68bd068 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:15.150532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192849d9-3f91-4b4a-b0ba-e2fc8611d4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:15.151448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192849d9-3f91-4b4a-b0ba-e2fc8611d4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:15.151735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192849d9-3f91-4b4a-b0ba-e2fc8611d4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:15.152071 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192849d9-3f91-4b4a-b0ba-e2fc8611d4ed admin admin] PATH_INFO: `/v3/users/b278e4c68f624eb5b29e0eb2f35f7322` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:15.153489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192849d9-3f91-4b4a-b0ba-e2fc8611d4ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b278e4c68f624eb5b29e0eb2f35f7322)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:15.162070 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192849d9-3f91-4b4a-b0ba-e2fc8611d4ed admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:15.216359 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffebd7-7697-466a-9d6f-0930b3cb099d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:15.216853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffebd7-7697-466a-9d6f-0930b3cb099d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:15.219851 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffebd7-7697-466a-9d6f-0930b3cb099d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:15.256002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-192849d9-3f91-4b4a-b0ba-e2fc8611d4ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b278e4c68f624eb5b29e0eb2f35f7322'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.267576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-192849d9-3f91-4b4a-b0ba-e2fc8611d4ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b278e4c68f624eb5b29e0eb2f35f7322'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.269071 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-192849d9-3f91-4b4a-b0ba-e2fc8611d4ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b278e4c68f624eb5b29e0eb2f35f7322'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.270091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-192849d9-3f91-4b4a-b0ba-e2fc8611d4ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b278e4c68f624eb5b29e0eb2f35f7322'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.285515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-192849d9-3f91-4b4a-b0ba-e2fc8611d4ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b278e4c68f624eb5b29e0eb2f35f7322'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.290088 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-bfffebd7-7697-466a-9d6f-0930b3cb099d None None] MFA Rules not processed for user `046cf5e98eca41c0a532e84f777efaab`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:15.291478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-bfffebd7-7697-466a-9d6f-0930b3cb099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:15.297683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:15.311672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1082/2148] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:51:15 2022] DELETE /identity/v3/users/b278e4c68f624eb5b29e0eb2f35f7322 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:15.378815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1067/2149] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:15.393705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192849d9-3f91-4b4a-b0ba-e2fc8611d4ed admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:15.395796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-192849d9-3f91-4b4a-b0ba-e2fc8611d4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:15.491594 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192849d9-3f91-4b4a-b0ba-e2fc8611d4ed admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:15.498340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311d72-48e4-477c-a3d7-65a5d4daa511 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:15.499082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311d72-48e4-477c-a3d7-65a5d4daa511 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:15.499332 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311d72-48e4-477c-a3d7-65a5d4daa511 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:15.499697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311d72-48e4-477c-a3d7-65a5d4daa511 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:15.523920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffebd7-7697-466a-9d6f-0930b3cb099d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:15.526015 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-bfffebd7-7697-466a-9d6f-0930b3cb099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:15.554808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffebd7-7697-466a-9d6f-0930b3cb099d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:15.576099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311d72-48e4-477c-a3d7-65a5d4daa511 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:15.578457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311d72-48e4-477c-a3d7-65a5d4daa511 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:15.588811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1083/2150] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:15.609234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:15.632582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e54cfd-c99c-46c8-ad65-c9ea24c74427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:15.633633 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e54cfd-c99c-46c8-ad65-c9ea24c74427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:15.634058 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e54cfd-c99c-46c8-ad65-c9ea24c74427 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:15.634310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e54cfd-c99c-46c8-ad65-c9ea24c74427 admin admin] PATH_INFO: `/v3/projects/5e5e497a889d4b828e39378c8920aa58` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:15.636331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e54cfd-c99c-46c8-ad65-c9ea24c74427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5e497a889d4b828e39378c8920aa58)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:15.643340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e54cfd-c99c-46c8-ad65-c9ea24c74427 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:15.707210 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-02e54cfd-c99c-46c8-ad65-c9ea24c74427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5e497a889d4b828e39378c8920aa58', 'request_id': 'req-02e54cfd-c99c-46c8-ad65-c9ea24c74427'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.719709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-02e54cfd-c99c-46c8-ad65-c9ea24c74427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5e497a889d4b828e39378c8920aa58', 'request_id': 'req-02e54cfd-c99c-46c8-ad65-c9ea24c74427'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.727140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-02e54cfd-c99c-46c8-ad65-c9ea24c74427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5e497a889d4b828e39378c8920aa58', 'request_id': 'req-02e54cfd-c99c-46c8-ad65-c9ea24c74427'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.743188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-02e54cfd-c99c-46c8-ad65-c9ea24c74427 admin admin] The token cache is being invalidate because project 5e5e497a889d4b828e39378c8920aa58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:51:15.743492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-02e54cfd-c99c-46c8-ad65-c9ea24c74427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.744160 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-02e54cfd-c99c-46c8-ad65-c9ea24c74427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:15.746044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1068/2151] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:51:15 2022] DELETE /identity/v3/projects/5e5e497a889d4b828e39378c8920aa58 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:15.751165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511fec6-b360-46f7-8005-ccaa7d6d9d72 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:15.751456 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511fec6-b360-46f7-8005-ccaa7d6d9d72 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:15.752232 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511fec6-b360-46f7-8005-ccaa7d6d9d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:15.776447 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-7511fec6-b360-46f7-8005-ccaa7d6d9d72 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:15.777767 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7511fec6-b360-46f7-8005-ccaa7d6d9d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:15.885519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1084/2152] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:15.893820 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09233bc4-2acf-4d25-b0c1-239e7f5b0afc None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:15.895136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09233bc4-2acf-4d25-b0c1-239e7f5b0afc None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:15.895688 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09233bc4-2acf-4d25-b0c1-239e7f5b0afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:15.920219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-09233bc4-2acf-4d25-b0c1-239e7f5b0afc None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:15.921716 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-09233bc4-2acf-4d25-b0c1-239e7f5b0afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:15.936225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1069/2153] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:15.937764 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511fec6-b360-46f7-8005-ccaa7d6d9d72 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:15.947981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511fec6-b360-46f7-8005-ccaa7d6d9d72 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:15.953848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc1479-e24e-4a09-9386-349b1813cd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:15.955130 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc1479-e24e-4a09-9386-349b1813cd56 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:15.957609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc1479-e24e-4a09-9386-349b1813cd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:15.957927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc1479-e24e-4a09-9386-349b1813cd56 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:15.958718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc1479-e24e-4a09-9386-349b1813cd56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:51:15.959343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc1479-e24e-4a09-9386-349b1813cd56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:15.961032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc1479-e24e-4a09-9386-349b1813cd56 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:15.991812 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1085/2154] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:51:15.996427 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09233bc4-2acf-4d25-b0c1-239e7f5b0afc None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:16.014284 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09233bc4-2acf-4d25-b0c1-239e7f5b0afc None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:16.023319 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f1135-ba44-4987-b78a-ac2c6304aaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:16.023987 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f1135-ba44-4987-b78a-ac2c6304aaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:16.024272 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f1135-ba44-4987-b78a-ac2c6304aaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:16.024634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f1135-ba44-4987-b78a-ac2c6304aaf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:16.025308 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f1135-ba44-4987-b78a-ac2c6304aaf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:16.029311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f1135-ba44-4987-b78a-ac2c6304aaf0 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:16.090783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1070/2155] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:51:15 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:16.096257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc1479-e24e-4a09-9386-349b1813cd56 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:16.108048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc1479-e24e-4a09-9386-349b1813cd56 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:16.125683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:16.224784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d29de-8240-4737-8b39-73cdcb9a9a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:16.225541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d29de-8240-4737-8b39-73cdcb9a9a66 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:16.226056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d29de-8240-4737-8b39-73cdcb9a9a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:16.226754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d29de-8240-4737-8b39-73cdcb9a9a66 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:16.227492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d29de-8240-4737-8b39-73cdcb9a9a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:16.230807 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d29de-8240-4737-8b39-73cdcb9a9a66 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:16.260197 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1086/2156] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:51:16 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:16.265602 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f1135-ba44-4987-b78a-ac2c6304aaf0 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:16.290346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f1135-ba44-4987-b78a-ac2c6304aaf0 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:16.298385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddf918-6ac8-4726-9090-127c69939a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:16.299246 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddf918-6ac8-4726-9090-127c69939a41 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:16.299534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddf918-6ac8-4726-9090-127c69939a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:16.299819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddf918-6ac8-4726-9090-127c69939a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:16.300628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddf918-6ac8-4726-9090-127c69939a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:16.303593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddf918-6ac8-4726-9090-127c69939a41 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:16.322931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1071/2157] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:51:16.327497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d29de-8240-4737-8b39-73cdcb9a9a66 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:16.341525 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d29de-8240-4737-8b39-73cdcb9a9a66 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:16.351175 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dd992-aff0-4516-a1de-d6ce208695fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:16.351925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dd992-aff0-4516-a1de-d6ce208695fb admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:16.352216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dd992-aff0-4516-a1de-d6ce208695fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:16.352649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dd992-aff0-4516-a1de-d6ce208695fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:16.353569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239dd992-aff0-4516-a1de-d6ce208695fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:16.355235 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239dd992-aff0-4516-a1de-d6ce208695fb admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:16.367661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1087/2158] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:16.372096 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddf918-6ac8-4726-9090-127c69939a41 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:16.386478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddf918-6ac8-4726-9090-127c69939a41 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:16.397898 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08261d2-86a6-4a55-a7bc-f8b91e88e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:16.399153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08261d2-86a6-4a55-a7bc-f8b91e88e795 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:16.399430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08261d2-86a6-4a55-a7bc-f8b91e88e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:16.399789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08261d2-86a6-4a55-a7bc-f8b91e88e795 admin admin] PATH_INFO: `/v3/projects/60c08f6a2729499ab9cc058c93902292/users/6ed26090856a480daa50ed2101c5ac99/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:16.418818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08261d2-86a6-4a55-a7bc-f8b91e88e795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c08f6a2729499ab9cc058c93902292, user_id=6ed26090856a480daa50ed2101c5ac99, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:16.421943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08261d2-86a6-4a55-a7bc-f8b91e88e795 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:16.438363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1072/2159] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:16 2022] PUT /identity/v3/projects/60c08f6a2729499ab9cc058c93902292/users/6ed26090856a480daa50ed2101c5ac99/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:16.450627 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467f938-4d1f-4925-96ad-e8e65da50922 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:16.450938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467f938-4d1f-4925-96ad-e8e65da50922 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:16.451192 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467f938-4d1f-4925-96ad-e8e65da50922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:16.493726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3467f938-4d1f-4925-96ad-e8e65da50922 None None] MFA Rules not processed for user `6ed26090856a480daa50ed2101c5ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:16.494973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3467f938-4d1f-4925-96ad-e8e65da50922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:16.574915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1088/2160] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:16.579622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08261d2-86a6-4a55-a7bc-f8b91e88e795 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:16.654044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08261d2-86a6-4a55-a7bc-f8b91e88e795 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:16.658971 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b3ee1-f40f-42c6-b083-f15ad934009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:16.659596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3ee1-f40f-42c6-b083-f15ad934009a admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:16.659874 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3ee1-f40f-42c6-b083-f15ad934009a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:16.660146 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3ee1-f40f-42c6-b083-f15ad934009a admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:16.660926 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b3ee1-f40f-42c6-b083-f15ad934009a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:16.662847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b3ee1-f40f-42c6-b083-f15ad934009a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:16.679737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:16.693387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1073/2161] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:51:16 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:51:16.697696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467f938-4d1f-4925-96ad-e8e65da50922 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:16.708907 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467f938-4d1f-4925-96ad-e8e65da50922 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:16.770655 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4184e9-d673-4b69-b744-4bbc188242ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:16.771417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4184e9-d673-4b69-b744-4bbc188242ed admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:16.771788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4184e9-d673-4b69-b744-4bbc188242ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:16.772124 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4184e9-d673-4b69-b744-4bbc188242ed admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:16.772944 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4184e9-d673-4b69-b744-4bbc188242ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:16.774964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4184e9-d673-4b69-b744-4bbc188242ed admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:16.801798 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1089/2162] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:51:16 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:16.806379 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b3ee1-f40f-42c6-b083-f15ad934009a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:16.818223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b3ee1-f40f-42c6-b083-f15ad934009a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:16.824010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da4d13-ef0c-47e4-8774-ea36f96562c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:16.825217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da4d13-ef0c-47e4-8774-ea36f96562c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:16.825562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da4d13-ef0c-47e4-8774-ea36f96562c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:16.826036 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da4d13-ef0c-47e4-8774-ea36f96562c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:16.826957 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da4d13-ef0c-47e4-8774-ea36f96562c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:16.837576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da4d13-ef0c-47e4-8774-ea36f96562c5 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:16.854184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1074/2163] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:16.855490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4184e9-d673-4b69-b744-4bbc188242ed admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:16.866220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4184e9-d673-4b69-b744-4bbc188242ed admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:16.871162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6518d4-10da-4a12-9e62-68697b08412d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:16.872027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6518d4-10da-4a12-9e62-68697b08412d admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:16.872329 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6518d4-10da-4a12-9e62-68697b08412d admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:16.872607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6518d4-10da-4a12-9e62-68697b08412d admin admin] PATH_INFO: `/v3/projects/3a4d5d49d0174e9db496a52c3b237813/users/0cfea9479a9b4c8aaacbf3f7bf8b0d78/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:16.884462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:16.889002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6518d4-10da-4a12-9e62-68697b08412d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4d5d49d0174e9db496a52c3b237813, user_id=0cfea9479a9b4c8aaacbf3f7bf8b0d78, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:16.892353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6518d4-10da-4a12-9e62-68697b08412d admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:16.911304 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1090/2164] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:16 2022] PUT /identity/v3/projects/3a4d5d49d0174e9db496a52c3b237813/users/0cfea9479a9b4c8aaacbf3f7bf8b0d78/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:51:16.915296 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da4d13-ef0c-47e4-8774-ea36f96562c5 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:16.926223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da4d13-ef0c-47e4-8774-ea36f96562c5 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:16.993572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49368d-45a5-4e4f-828a-4e2e7a9a3238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:16.994469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49368d-45a5-4e4f-828a-4e2e7a9a3238 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:16.994936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49368d-45a5-4e4f-828a-4e2e7a9a3238 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:16.995278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49368d-45a5-4e4f-828a-4e2e7a9a3238 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:16.996112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49368d-45a5-4e4f-828a-4e2e7a9a3238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:16.997763 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49368d-45a5-4e4f-828a-4e2e7a9a3238 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:17.011491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1075/2165] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:51:17.012785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6518d4-10da-4a12-9e62-68697b08412d admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:17.028917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6518d4-10da-4a12-9e62-68697b08412d admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:17.034491 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28a014-fac8-482c-b425-19f8a14ecbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:17.035410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28a014-fac8-482c-b425-19f8a14ecbbf admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:17.035688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28a014-fac8-482c-b425-19f8a14ecbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:17.035966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28a014-fac8-482c-b425-19f8a14ecbbf admin admin] PATH_INFO: `/v3/projects/3a4d5d49d0174e9db496a52c3b237813/users/0cfea9479a9b4c8aaacbf3f7bf8b0d78/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:17.038304 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28a014-fac8-482c-b425-19f8a14ecbbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4d5d49d0174e9db496a52c3b237813, user_id=0cfea9479a9b4c8aaacbf3f7bf8b0d78, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:17.041724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28a014-fac8-482c-b425-19f8a14ecbbf admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:17.058149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1091/2166] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:17 2022] PUT /identity/v3/projects/3a4d5d49d0174e9db496a52c3b237813/users/0cfea9479a9b4c8aaacbf3f7bf8b0d78/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:17.069610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815998d-42a1-4cf0-a691-2510f9d2de47 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:17.069928 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815998d-42a1-4cf0-a691-2510f9d2de47 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:17.070209 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815998d-42a1-4cf0-a691-2510f9d2de47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:17.121699 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-3815998d-42a1-4cf0-a691-2510f9d2de47 None None] MFA Rules not processed for user `0cfea9479a9b4c8aaacbf3f7bf8b0d78`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:17.123146 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3815998d-42a1-4cf0-a691-2510f9d2de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:17.232769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1076/2167] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:17.243659 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28a014-fac8-482c-b425-19f8a14ecbbf admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:17.245467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6d28a014-fac8-482c-b425-19f8a14ecbbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:17.317575 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28a014-fac8-482c-b425-19f8a14ecbbf admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:17.321315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd08d-6c3e-4bcc-a945-2bfb22b5d72b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:17.322055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd08d-6c3e-4bcc-a945-2bfb22b5d72b service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:17.322422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd08d-6c3e-4bcc-a945-2bfb22b5d72b service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:17.322757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd08d-6c3e-4bcc-a945-2bfb22b5d72b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:17.391824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bd08d-6c3e-4bcc-a945-2bfb22b5d72b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:17.393484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bd08d-6c3e-4bcc-a945-2bfb22b5d72b service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:17.403795 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1092/2168] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:17.629001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc622376-40e1-404a-9c3d-d72be40a991b None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:17.629342 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc622376-40e1-404a-9c3d-d72be40a991b None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:17.629595 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc622376-40e1-404a-9c3d-d72be40a991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:17.654029 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-fc622376-40e1-404a-9c3d-d72be40a991b None None] MFA Rules not processed for user `046cf5e98eca41c0a532e84f777efaab`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:17.655750 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fc622376-40e1-404a-9c3d-d72be40a991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:17.737116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1077/2169] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:51:21.193399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd08d-6c3e-4bcc-a945-2bfb22b5d72b service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:21.194993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-606bd08d-6c3e-4bcc-a945-2bfb22b5d72b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:21.255788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd08d-6c3e-4bcc-a945-2bfb22b5d72b service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:21.259865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cb51b-d07b-42d9-956c-6af2c1192922 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be29cfa76174b44b99ddaf3d293ead1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:21.260553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cb51b-d07b-42d9-956c-6af2c1192922 service glance] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:21.260830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cb51b-d07b-42d9-956c-6af2c1192922 service glance] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:21.261111 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cb51b-d07b-42d9-956c-6af2c1192922 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:21.263017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1c0cb51b-d07b-42d9-956c-6af2c1192922 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:21.309986 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:21.326074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cb51b-d07b-42d9-956c-6af2c1192922 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:21.328253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cb51b-d07b-42d9-956c-6af2c1192922 service glance] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:21.338118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1093/2170] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:21.793029 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc622376-40e1-404a-9c3d-d72be40a991b None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:21.806952 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc622376-40e1-404a-9c3d-d72be40a991b None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:21.820326 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b661f-607c-4af1-8175-aaea9ab5386f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:21.821565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b661f-607c-4af1-8175-aaea9ab5386f service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:21.821934 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b661f-607c-4af1-8175-aaea9ab5386f service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:21.822798 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b661f-607c-4af1-8175-aaea9ab5386f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:21.843909 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b661f-607c-4af1-8175-aaea9ab5386f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:21.848470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b661f-607c-4af1-8175-aaea9ab5386f service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:21.854858 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:21.863410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1078/2171] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:26.915005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cb51b-d07b-42d9-956c-6af2c1192922 service glance] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:26.980212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cb51b-d07b-42d9-956c-6af2c1192922 service glance] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:26.987741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847d576-e3f6-488d-b8b1-47fbcff5143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:26.988701 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847d576-e3f6-488d-b8b1-47fbcff5143a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:26.988985 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847d576-e3f6-488d-b8b1-47fbcff5143a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:26.989261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847d576-e3f6-488d-b8b1-47fbcff5143a admin admin] PATH_INFO: `/v3/users/6ed26090856a480daa50ed2101c5ac99` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:26.990473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847d576-e3f6-488d-b8b1-47fbcff5143a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed26090856a480daa50ed2101c5ac99)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:26.992507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847d576-e3f6-488d-b8b1-47fbcff5143a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:27.050768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-1847d576-e3f6-488d-b8b1-47fbcff5143a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed26090856a480daa50ed2101c5ac99'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.058392 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-1847d576-e3f6-488d-b8b1-47fbcff5143a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed26090856a480daa50ed2101c5ac99'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.059082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-1847d576-e3f6-488d-b8b1-47fbcff5143a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed26090856a480daa50ed2101c5ac99'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.059690 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-1847d576-e3f6-488d-b8b1-47fbcff5143a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed26090856a480daa50ed2101c5ac99'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.071501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-1847d576-e3f6-488d-b8b1-47fbcff5143a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed26090856a480daa50ed2101c5ac99'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.094553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1094/2172] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:51:26 2022] DELETE /identity/v3/users/6ed26090856a480daa50ed2101c5ac99 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:27.098820 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f3215-70e2-4c15-a4ad-3d3123004ea7 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:27.099345 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f3215-70e2-4c15-a4ad-3d3123004ea7 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:27.099432 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f3215-70e2-4c15-a4ad-3d3123004ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:27.118038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e43f3215-70e2-4c15-a4ad-3d3123004ea7 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:27.120320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e43f3215-70e2-4c15-a4ad-3d3123004ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:27.203018 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1079/2173] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:27.214692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847d576-e3f6-488d-b8b1-47fbcff5143a admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:27.216370 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1847d576-e3f6-488d-b8b1-47fbcff5143a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:27.278509 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847d576-e3f6-488d-b8b1-47fbcff5143a admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:27.283067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cf013-f7dc-47f0-ae5c-acbd07e96288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:27.283718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cf013-f7dc-47f0-ae5c-acbd07e96288 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:27.284003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cf013-f7dc-47f0-ae5c-acbd07e96288 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:27.284279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cf013-f7dc-47f0-ae5c-acbd07e96288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:27.293567 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cf013-f7dc-47f0-ae5c-acbd07e96288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:27.295406 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cf013-f7dc-47f0-ae5c-acbd07e96288 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:27.305420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1095/2174] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:27.601687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f3215-70e2-4c15-a4ad-3d3123004ea7 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:27.603373 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e43f3215-70e2-4c15-a4ad-3d3123004ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:27.621868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f3215-70e2-4c15-a4ad-3d3123004ea7 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:27.630071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:27.631253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:27.631543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:27.631844 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] PATH_INFO: `/v3/projects/60c08f6a2729499ab9cc058c93902292` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:27.633085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c08f6a2729499ab9cc058c93902292)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:27.635126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:27.684258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c08f6a2729499ab9cc058c93902292', 'request_id': 'req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.689704 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c08f6a2729499ab9cc058c93902292', 'request_id': 'req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.695716 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c08f6a2729499ab9cc058c93902292', 'request_id': 'req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.709331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] The token cache is being invalidate because project 60c08f6a2729499ab9cc058c93902292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:51:27.709631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.710396 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.712112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1080/2175] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:51:27 2022] DELETE /identity/v3/projects/60c08f6a2729499ab9cc058c93902292 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:27.716256 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cf013-f7dc-47f0-ae5c-acbd07e96288 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:27.726591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cf013-f7dc-47f0-ae5c-acbd07e96288 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:27.730264 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:27.791977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51224077-0acb-4a51-a99f-85226708d174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:27.793026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51224077-0acb-4a51-a99f-85226708d174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:27.793311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51224077-0acb-4a51-a99f-85226708d174 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:27.793606 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51224077-0acb-4a51-a99f-85226708d174 admin admin] PATH_INFO: `/v3/users/0cfea9479a9b4c8aaacbf3f7bf8b0d78` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:27.794905 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51224077-0acb-4a51-a99f-85226708d174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cfea9479a9b4c8aaacbf3f7bf8b0d78)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:27.797041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51224077-0acb-4a51-a99f-85226708d174 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:27.856090 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-51224077-0acb-4a51-a99f-85226708d174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cfea9479a9b4c8aaacbf3f7bf8b0d78'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.863441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-51224077-0acb-4a51-a99f-85226708d174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cfea9479a9b4c8aaacbf3f7bf8b0d78'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.864437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-51224077-0acb-4a51-a99f-85226708d174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cfea9479a9b4c8aaacbf3f7bf8b0d78'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.864785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-51224077-0acb-4a51-a99f-85226708d174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cfea9479a9b4c8aaacbf3f7bf8b0d78'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.874054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-51224077-0acb-4a51-a99f-85226708d174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cfea9479a9b4c8aaacbf3f7bf8b0d78'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:27.892917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1096/2176] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:51:27 2022] DELETE /identity/v3/users/0cfea9479a9b4c8aaacbf3f7bf8b0d78 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:28.209470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:28.211164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:28.233868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ebdf9-e711-4728-b0c8-dab4e2e8d2a9 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:28.308514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fe54f-54ba-43c8-b2db-b24970b9e857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:28.308514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe54f-54ba-43c8-b2db-b24970b9e857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:28.308514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe54f-54ba-43c8-b2db-b24970b9e857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:28.308514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe54f-54ba-43c8-b2db-b24970b9e857 admin admin] PATH_INFO: `/v3/projects/3a4d5d49d0174e9db496a52c3b237813` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:28.308851 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fe54f-54ba-43c8-b2db-b24970b9e857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4d5d49d0174e9db496a52c3b237813)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:28.308851 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fe54f-54ba-43c8-b2db-b24970b9e857 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:28.336101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:28.362764 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4c4fe54f-54ba-43c8-b2db-b24970b9e857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4d5d49d0174e9db496a52c3b237813', 'request_id': 'req-4c4fe54f-54ba-43c8-b2db-b24970b9e857'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:28.374077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4c4fe54f-54ba-43c8-b2db-b24970b9e857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4d5d49d0174e9db496a52c3b237813', 'request_id': 'req-4c4fe54f-54ba-43c8-b2db-b24970b9e857'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:28.380658 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4c4fe54f-54ba-43c8-b2db-b24970b9e857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4d5d49d0174e9db496a52c3b237813', 'request_id': 'req-4c4fe54f-54ba-43c8-b2db-b24970b9e857'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:28.396929 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4c4fe54f-54ba-43c8-b2db-b24970b9e857 admin admin] The token cache is being invalidate because project 3a4d5d49d0174e9db496a52c3b237813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:51:28.397262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4c4fe54f-54ba-43c8-b2db-b24970b9e857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:28.398020 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4c4fe54f-54ba-43c8-b2db-b24970b9e857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:28.399938 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1081/2177] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:51:28 2022] DELETE /identity/v3/projects/3a4d5d49d0174e9db496a52c3b237813 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:28.406450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b681-9774-46ef-b54f-1e0543e9203f None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:28.406940 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b681-9774-46ef-b54f-1e0543e9203f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:28.407027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7b681-9774-46ef-b54f-1e0543e9203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:28.435128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-9ec7b681-9774-46ef-b54f-1e0543e9203f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:28.436524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9ec7b681-9774-46ef-b54f-1e0543e9203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:28.499180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1097/2178] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:28.507461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ee08c-4797-4fd2-a636-d9519aa21f14 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:28.507873 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ee08c-4797-4fd2-a636-d9519aa21f14 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:28.508129 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ee08c-4797-4fd2-a636-d9519aa21f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:28.527473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-3c8ee08c-4797-4fd2-a636-d9519aa21f14 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:28.528749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3c8ee08c-4797-4fd2-a636-d9519aa21f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:28.537476 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1082/2179] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:28.541982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7b681-9774-46ef-b54f-1e0543e9203f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:28.553185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7b681-9774-46ef-b54f-1e0543e9203f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:28.560775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c335d14-377d-437e-a8a2-117bb118be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:28.561486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c335d14-377d-437e-a8a2-117bb118be56 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:28.561770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c335d14-377d-437e-a8a2-117bb118be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:28.562042 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c335d14-377d-437e-a8a2-117bb118be56 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:28.562790 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c335d14-377d-437e-a8a2-117bb118be56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:51:28.563097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c335d14-377d-437e-a8a2-117bb118be56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:28.565573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c335d14-377d-437e-a8a2-117bb118be56 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:28.583305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1098/2180] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:51:28.588496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ee08c-4797-4fd2-a636-d9519aa21f14 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:28.599036 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ee08c-4797-4fd2-a636-d9519aa21f14 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:28.604976 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed14f5-ce0d-401e-b17b-f35150b2310d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:28.605672 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed14f5-ce0d-401e-b17b-f35150b2310d admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:28.606003 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed14f5-ce0d-401e-b17b-f35150b2310d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:28.606278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed14f5-ce0d-401e-b17b-f35150b2310d admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:28.606978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed14f5-ce0d-401e-b17b-f35150b2310d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:28.608984 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed14f5-ce0d-401e-b17b-f35150b2310d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:28.636498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1083/2181] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:51:28 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:28.640863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c335d14-377d-437e-a8a2-117bb118be56 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:28.651976 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c335d14-377d-437e-a8a2-117bb118be56 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:28.660930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:28.715367 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff647ec-ab1b-45f0-9320-f616303c3ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:28.716045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff647ec-ab1b-45f0-9320-f616303c3ecc admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:28.716357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff647ec-ab1b-45f0-9320-f616303c3ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:28.716772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff647ec-ab1b-45f0-9320-f616303c3ecc admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:28.717484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff647ec-ab1b-45f0-9320-f616303c3ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:28.719429 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff647ec-ab1b-45f0-9320-f616303c3ecc admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:28.739925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1099/2182] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:51:28 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:28.744801 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed14f5-ce0d-401e-b17b-f35150b2310d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:28.756571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed14f5-ce0d-401e-b17b-f35150b2310d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:28.761814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f1387-66ee-47c6-bccc-7a8e1a7ee5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:28.762503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f1387-66ee-47c6-bccc-7a8e1a7ee5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:28.762771 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f1387-66ee-47c6-bccc-7a8e1a7ee5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:28.763046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f1387-66ee-47c6-bccc-7a8e1a7ee5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:28.764234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f1387-66ee-47c6-bccc-7a8e1a7ee5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:28.765915 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f1387-66ee-47c6-bccc-7a8e1a7ee5e2 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:28.776651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1084/2183] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:28.782224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff647ec-ab1b-45f0-9320-f616303c3ecc admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:28.797421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff647ec-ab1b-45f0-9320-f616303c3ecc admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:28.806584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16913ce1-0948-4249-93c3-64b714e5dc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:28.807524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16913ce1-0948-4249-93c3-64b714e5dc77 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:28.807926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16913ce1-0948-4249-93c3-64b714e5dc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:28.808355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16913ce1-0948-4249-93c3-64b714e5dc77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:28.809466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16913ce1-0948-4249-93c3-64b714e5dc77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:28.811597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16913ce1-0948-4249-93c3-64b714e5dc77 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:28.822382 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1100/2184] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:28.827570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f1387-66ee-47c6-bccc-7a8e1a7ee5e2 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:28.838240 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f1387-66ee-47c6-bccc-7a8e1a7ee5e2 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:28.843599 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769eb1e-eabd-4130-b7d5-4368d2d33792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:28.844532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769eb1e-eabd-4130-b7d5-4368d2d33792 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:28.844816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769eb1e-eabd-4130-b7d5-4368d2d33792 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:28.845091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769eb1e-eabd-4130-b7d5-4368d2d33792 admin admin] PATH_INFO: `/v3/projects/555e746025854bb893d27c4290879488/users/df945355f9c74b19874f9aa124c5bf4a/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:28.860134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769eb1e-eabd-4130-b7d5-4368d2d33792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555e746025854bb893d27c4290879488, user_id=df945355f9c74b19874f9aa124c5bf4a, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:28.862838 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769eb1e-eabd-4130-b7d5-4368d2d33792 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:28.879491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1085/2185] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:28 2022] PUT /identity/v3/projects/555e746025854bb893d27c4290879488/users/df945355f9c74b19874f9aa124c5bf4a/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:28.953183 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf84a67-1927-405d-a6b7-28ec55274718 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:28.953744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf84a67-1927-405d-a6b7-28ec55274718 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:28.954186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf84a67-1927-405d-a6b7-28ec55274718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:28.997045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-bbf84a67-1927-405d-a6b7-28ec55274718 None None] MFA Rules not processed for user `df945355f9c74b19874f9aa124c5bf4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:28.998297 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-bbf84a67-1927-405d-a6b7-28ec55274718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:29.072328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1101/2186] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:29.076218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769eb1e-eabd-4130-b7d5-4368d2d33792 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:29.160601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769eb1e-eabd-4130-b7d5-4368d2d33792 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:29.166038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f23a4-aef5-4f8a-a03b-bd09cca91204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:29.166992 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f23a4-aef5-4f8a-a03b-bd09cca91204 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:29.167231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f23a4-aef5-4f8a-a03b-bd09cca91204 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:29.167509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f23a4-aef5-4f8a-a03b-bd09cca91204 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:29.168218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f23a4-aef5-4f8a-a03b-bd09cca91204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:29.171125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f23a4-aef5-4f8a-a03b-bd09cca91204 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:29.199891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1086/2187] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:51:29 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:29.208713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf84a67-1927-405d-a6b7-28ec55274718 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:29.220822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf84a67-1927-405d-a6b7-28ec55274718 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:29.290647 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027a3ab-1bf2-4a6c-b8d9-702c2358b573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:29.291321 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027a3ab-1bf2-4a6c-b8d9-702c2358b573 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:29.291599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027a3ab-1bf2-4a6c-b8d9-702c2358b573 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:29.291870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027a3ab-1bf2-4a6c-b8d9-702c2358b573 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:29.292592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027a3ab-1bf2-4a6c-b8d9-702c2358b573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:29.294551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027a3ab-1bf2-4a6c-b8d9-702c2358b573 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:29.321939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1102/2188] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:51:29 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:29.328223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f23a4-aef5-4f8a-a03b-bd09cca91204 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:29.345339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f23a4-aef5-4f8a-a03b-bd09cca91204 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:29.351134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1ddb6-7808-45b2-bbf4-d03c809b6c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:29.351801 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1ddb6-7808-45b2-bbf4-d03c809b6c49 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:29.352081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1ddb6-7808-45b2-bbf4-d03c809b6c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:29.352355 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1ddb6-7808-45b2-bbf4-d03c809b6c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:29.353093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1ddb6-7808-45b2-bbf4-d03c809b6c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:29.354724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1ddb6-7808-45b2-bbf4-d03c809b6c49 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:29.365727 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1087/2189] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:29.370487 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027a3ab-1bf2-4a6c-b8d9-702c2358b573 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:29.382354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027a3ab-1bf2-4a6c-b8d9-702c2358b573 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:29.387174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5aef5-3ed9-40a0-a25d-dd263962ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:29.388061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5aef5-3ed9-40a0-a25d-dd263962ee91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:29.388376 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5aef5-3ed9-40a0-a25d-dd263962ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:29.388972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5aef5-3ed9-40a0-a25d-dd263962ee91 admin admin] PATH_INFO: `/v3/projects/1a8b94e6c148424da71488387b279b9b/users/ed4c97e5a065477eb420731596ad1081/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:29.397975 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:29.406489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5aef5-3ed9-40a0-a25d-dd263962ee91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8b94e6c148424da71488387b279b9b, user_id=ed4c97e5a065477eb420731596ad1081, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:29.409459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5aef5-3ed9-40a0-a25d-dd263962ee91 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:29.425330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1103/2190] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:29 2022] PUT /identity/v3/projects/1a8b94e6c148424da71488387b279b9b/users/ed4c97e5a065477eb420731596ad1081/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:29.429534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1ddb6-7808-45b2-bbf4-d03c809b6c49 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:29.440130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1ddb6-7808-45b2-bbf4-d03c809b6c49 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:29.459776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:29.506646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39df1e3-1714-43ce-b7a7-20382623136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:29.507235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39df1e3-1714-43ce-b7a7-20382623136f admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:29.507511 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39df1e3-1714-43ce-b7a7-20382623136f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:29.507769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39df1e3-1714-43ce-b7a7-20382623136f admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:29.508748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39df1e3-1714-43ce-b7a7-20382623136f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:29.510674 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39df1e3-1714-43ce-b7a7-20382623136f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:29.525999 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1088/2191] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:29.529223 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5aef5-3ed9-40a0-a25d-dd263962ee91 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:29.541249 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5aef5-3ed9-40a0-a25d-dd263962ee91 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:29.546986 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540a8f4-13d1-4711-9a8f-fe495f8b0f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:29.548033 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540a8f4-13d1-4711-9a8f-fe495f8b0f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:29.548502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540a8f4-13d1-4711-9a8f-fe495f8b0f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:29.548878 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540a8f4-13d1-4711-9a8f-fe495f8b0f52 admin admin] PATH_INFO: `/v3/projects/1a8b94e6c148424da71488387b279b9b/users/ed4c97e5a065477eb420731596ad1081/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:29.551151 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540a8f4-13d1-4711-9a8f-fe495f8b0f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8b94e6c148424da71488387b279b9b, user_id=ed4c97e5a065477eb420731596ad1081, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:29.554327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540a8f4-13d1-4711-9a8f-fe495f8b0f52 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:29.566171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1104/2192] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:29 2022] PUT /identity/v3/projects/1a8b94e6c148424da71488387b279b9b/users/ed4c97e5a065477eb420731596ad1081/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:29.579281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ad4f6-05a7-4503-b008-eac7910ce9d7 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:29.579866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ad4f6-05a7-4503-b008-eac7910ce9d7 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:29.580093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ad4f6-05a7-4503-b008-eac7910ce9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:29.607114 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-343ad4f6-05a7-4503-b008-eac7910ce9d7 None None] MFA Rules not processed for user `ed4c97e5a065477eb420731596ad1081`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:29.608642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-343ad4f6-05a7-4503-b008-eac7910ce9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:29.676545 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1089/2193] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:51:29.688713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540a8f4-13d1-4711-9a8f-fe495f8b0f52 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:29.691188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e540a8f4-13d1-4711-9a8f-fe495f8b0f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:29.752445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540a8f4-13d1-4711-9a8f-fe495f8b0f52 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:29.756161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c263793-1def-470b-afeb-26174650619d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:29.756847 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c263793-1def-470b-afeb-26174650619d service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:29.757133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c263793-1def-470b-afeb-26174650619d service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:29.757411 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c263793-1def-470b-afeb-26174650619d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:29.815857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c263793-1def-470b-afeb-26174650619d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:29.817430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c263793-1def-470b-afeb-26174650619d service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:29.827695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1105/2194] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:31.726943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ad4f6-05a7-4503-b008-eac7910ce9d7 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:31.728792 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-343ad4f6-05a7-4503-b008-eac7910ce9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:31.802981 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ad4f6-05a7-4503-b008-eac7910ce9d7 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:31.808494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee8d7a-96b6-4bf5-a8ba-040b00349282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:31.809383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee8d7a-96b6-4bf5-a8ba-040b00349282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:31.809666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee8d7a-96b6-4bf5-a8ba-040b00349282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:31.809939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee8d7a-96b6-4bf5-a8ba-040b00349282 admin admin] PATH_INFO: `/v3/users/5c352608271b4fcf97ccd8ddf2b1ac38` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:31.811695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee8d7a-96b6-4bf5-a8ba-040b00349282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c352608271b4fcf97ccd8ddf2b1ac38)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:31.813721 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee8d7a-96b6-4bf5-a8ba-040b00349282 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:31.872571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:31.874502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e4ee8d7a-96b6-4bf5-a8ba-040b00349282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c352608271b4fcf97ccd8ddf2b1ac38'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:31.883753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e4ee8d7a-96b6-4bf5-a8ba-040b00349282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c352608271b4fcf97ccd8ddf2b1ac38'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:31.884473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e4ee8d7a-96b6-4bf5-a8ba-040b00349282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c352608271b4fcf97ccd8ddf2b1ac38'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:31.885092 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e4ee8d7a-96b6-4bf5-a8ba-040b00349282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c352608271b4fcf97ccd8ddf2b1ac38'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:31.896145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e4ee8d7a-96b6-4bf5-a8ba-040b00349282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c352608271b4fcf97ccd8ddf2b1ac38'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:31.924645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1090/2195] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:51:31 2022] DELETE /identity/v3/users/5c352608271b4fcf97ccd8ddf2b1ac38 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:31.929482 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70552f0-3684-442c-a12c-51218e676119 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:31.929973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70552f0-3684-442c-a12c-51218e676119 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:31.930085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70552f0-3684-442c-a12c-51218e676119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:31.949292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-c70552f0-3684-442c-a12c-51218e676119 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:31.950543 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c70552f0-3684-442c-a12c-51218e676119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:32.016593 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1106/2196] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:32.026877 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee8d7a-96b6-4bf5-a8ba-040b00349282 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:32.028387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e4ee8d7a-96b6-4bf5-a8ba-040b00349282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:32.091364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee8d7a-96b6-4bf5-a8ba-040b00349282 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:32.095474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472d374-340c-4b4c-b99f-7bf5470d6933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:32.096127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472d374-340c-4b4c-b99f-7bf5470d6933 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:32.096442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472d374-340c-4b4c-b99f-7bf5470d6933 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:32.096715 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472d374-340c-4b4c-b99f-7bf5470d6933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:32.106118 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472d374-340c-4b4c-b99f-7bf5470d6933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:32.107923 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472d374-340c-4b4c-b99f-7bf5470d6933 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:32.117705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1091/2197] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:32.389450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70552f0-3684-442c-a12c-51218e676119 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:32.390906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c70552f0-3684-442c-a12c-51218e676119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:32.406296 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70552f0-3684-442c-a12c-51218e676119 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:32.410261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472d374-340c-4b4c-b99f-7bf5470d6933 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:32.411696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-0472d374-340c-4b4c-b99f-7bf5470d6933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:32.421059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04b216-dfa4-4fc0-8923-9225bf59fa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:32.421193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04b216-dfa4-4fc0-8923-9225bf59fa70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:32.421359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04b216-dfa4-4fc0-8923-9225bf59fa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:32.421636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04b216-dfa4-4fc0-8923-9225bf59fa70 admin admin] PATH_INFO: `/v3/users/df945355f9c74b19874f9aa124c5bf4a` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:32.423199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04b216-dfa4-4fc0-8923-9225bf59fa70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df945355f9c74b19874f9aa124c5bf4a)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:32.425715 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04b216-dfa4-4fc0-8923-9225bf59fa70 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:32.426012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472d374-340c-4b4c-b99f-7bf5470d6933 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:32.434724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:32.436006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:32.436537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:32.436828 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad admin admin] PATH_INFO: `/v3/projects/90e763cc27b94cb5a027c643ccd0cdee` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:32.438199 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e763cc27b94cb5a027c643ccd0cdee)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:32.440281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:32.455304 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:32.485859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0c04b216-dfa4-4fc0-8923-9225bf59fa70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df945355f9c74b19874f9aa124c5bf4a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:32.497625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0c04b216-dfa4-4fc0-8923-9225bf59fa70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df945355f9c74b19874f9aa124c5bf4a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:32.499475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0c04b216-dfa4-4fc0-8923-9225bf59fa70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df945355f9c74b19874f9aa124c5bf4a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:32.500277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0c04b216-dfa4-4fc0-8923-9225bf59fa70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df945355f9c74b19874f9aa124c5bf4a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:32.503000 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e763cc27b94cb5a027c643ccd0cdee', 'request_id': 'req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:32.510467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0c04b216-dfa4-4fc0-8923-9225bf59fa70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df945355f9c74b19874f9aa124c5bf4a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:32.522072 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e763cc27b94cb5a027c643ccd0cdee', 'request_id': 'req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:32.530631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e763cc27b94cb5a027c643ccd0cdee', 'request_id': 'req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:32.538082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1107/2198] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:51:32 2022] DELETE /identity/v3/users/df945355f9c74b19874f9aa124c5bf4a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:51:32.543310 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c0ccf-b568-428c-a423-23b2c1237b63 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:32.543731 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c0ccf-b568-428c-a423-23b2c1237b63 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:32.544080 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c0ccf-b568-428c-a423-23b2c1237b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:32.548985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad admin admin] The token cache is being invalidate because project 90e763cc27b94cb5a027c643ccd0cdee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:51:32.549325 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:32.549978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6e3cecd6-623b-4cfc-a417-9ce5f702e0ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:32.555224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1092/2199] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:51:32 2022] DELETE /identity/v3/projects/90e763cc27b94cb5a027c643ccd0cdee => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:32.556773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe02259-2a01-4829-9f68-ac32032151a1 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:32.557061 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe02259-2a01-4829-9f68-ac32032151a1 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:32.557353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe02259-2a01-4829-9f68-ac32032151a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:32.566657 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-a43c0ccf-b568-428c-a423-23b2c1237b63 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:32.568903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a43c0ccf-b568-428c-a423-23b2c1237b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:32.581964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-abe02259-2a01-4829-9f68-ac32032151a1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:32.583201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-abe02259-2a01-4829-9f68-ac32032151a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:32.641638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1108/2200] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:51:32.642173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:32.655540 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c0ccf-b568-428c-a423-23b2c1237b63 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:32.658136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a43c0ccf-b568-428c-a423-23b2c1237b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:32.674593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1093/2201] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:32.684282 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3fdc4-1fa1-4678-932b-3931d84bde11 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:32.684609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3fdc4-1fa1-4678-932b-3931d84bde11 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:32.684886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3fdc4-1fa1-4678-932b-3931d84bde11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:32.721505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-1af3fdc4-1fa1-4678-932b-3931d84bde11 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:32.723117 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1af3fdc4-1fa1-4678-932b-3931d84bde11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:32.738455 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1094/2202] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:32.745876 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c0ccf-b568-428c-a423-23b2c1237b63 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:32.747378 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3fdc4-1fa1-4678-932b-3931d84bde11 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:32.751818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6355d-51e6-434e-92a7-8fe004f5e22c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:32.752850 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6355d-51e6-434e-92a7-8fe004f5e22c service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:32.753295 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6355d-51e6-434e-92a7-8fe004f5e22c service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:32.753728 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6355d-51e6-434e-92a7-8fe004f5e22c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:32.758548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3fdc4-1fa1-4678-932b-3931d84bde11 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:32.767291 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df371b49-0fa2-40b6-9f61-c96b0639c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:32.768341 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371b49-0fa2-40b6-9f61-c96b0639c80d admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:32.768741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6355d-51e6-434e-92a7-8fe004f5e22c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:32.769013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371b49-0fa2-40b6-9f61-c96b0639c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:32.769437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371b49-0fa2-40b6-9f61-c96b0639c80d admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:32.770209 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6355d-51e6-434e-92a7-8fe004f5e22c service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:32.770496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df371b49-0fa2-40b6-9f61-c96b0639c80d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:51:32.770991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df371b49-0fa2-40b6-9f61-c96b0639c80d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:32.772906 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df371b49-0fa2-40b6-9f61-c96b0639c80d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:32.780565 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1109/2203] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:32.792349 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1095/2204] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 15:51:32.797003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6355d-51e6-434e-92a7-8fe004f5e22c service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:32.807181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6355d-51e6-434e-92a7-8fe004f5e22c service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:32.813132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028d4bd-1336-443f-8ce5-045139d648e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:32.813906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028d4bd-1336-443f-8ce5-045139d648e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:32.814255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028d4bd-1336-443f-8ce5-045139d648e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:32.814592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028d4bd-1336-443f-8ce5-045139d648e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:32.815351 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028d4bd-1336-443f-8ce5-045139d648e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:32.817887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028d4bd-1336-443f-8ce5-045139d648e1 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:32.851505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1110/2205] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:51:32 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:51:32.856044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df371b49-0fa2-40b6-9f61-c96b0639c80d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:32.868182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df371b49-0fa2-40b6-9f61-c96b0639c80d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:32.937647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb34422-8b6f-4989-9528-3150ed48ab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:32.938317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb34422-8b6f-4989-9528-3150ed48ab25 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:32.938733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb34422-8b6f-4989-9528-3150ed48ab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:32.939014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb34422-8b6f-4989-9528-3150ed48ab25 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:32.939902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb34422-8b6f-4989-9528-3150ed48ab25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:32.942317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb34422-8b6f-4989-9528-3150ed48ab25 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:32.972440 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1096/2206] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:51:32 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:32.973951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028d4bd-1336-443f-8ce5-045139d648e1 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:32.984646 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028d4bd-1336-443f-8ce5-045139d648e1 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:32.990191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266914ef-382e-429e-889e-cfa2b2d7326a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:32.990959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266914ef-382e-429e-889e-cfa2b2d7326a admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:32.991307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266914ef-382e-429e-889e-cfa2b2d7326a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:32.991583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266914ef-382e-429e-889e-cfa2b2d7326a admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:32.992363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266914ef-382e-429e-889e-cfa2b2d7326a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:32.994020 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266914ef-382e-429e-889e-cfa2b2d7326a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:33.008337 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1111/2207] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:33.011794 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb34422-8b6f-4989-9528-3150ed48ab25 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:33.023202 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb34422-8b6f-4989-9528-3150ed48ab25 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:33.028732 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad4a06-576f-4958-9cb6-334d945f3f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:33.029506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad4a06-576f-4958-9cb6-334d945f3f18 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:33.029976 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad4a06-576f-4958-9cb6-334d945f3f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:33.030254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad4a06-576f-4958-9cb6-334d945f3f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:33.031030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad4a06-576f-4958-9cb6-334d945f3f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:33.032684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad4a06-576f-4958-9cb6-334d945f3f18 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:33.046890 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1097/2208] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:33.048482 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266914ef-382e-429e-889e-cfa2b2d7326a admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:33.058515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266914ef-382e-429e-889e-cfa2b2d7326a admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:33.065774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79e228-77c3-4966-98ec-c34628369e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:33.066669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79e228-77c3-4966-98ec-c34628369e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:33.066947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79e228-77c3-4966-98ec-c34628369e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:33.067293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79e228-77c3-4966-98ec-c34628369e82 admin admin] PATH_INFO: `/v3/projects/34616afcc7d2411992085fbb829ec4d8/users/0c2fbf5d3064479a909e7547a050ef5e/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:33.077315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:33.081431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad4a06-576f-4958-9cb6-334d945f3f18 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:33.083431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-59ad4a06-576f-4958-9cb6-334d945f3f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:33.093721 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79e228-77c3-4966-98ec-c34628369e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34616afcc7d2411992085fbb829ec4d8, user_id=0c2fbf5d3064479a909e7547a050ef5e, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:33.096993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79e228-77c3-4966-98ec-c34628369e82 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:33.103614 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad4a06-576f-4958-9cb6-334d945f3f18 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:33.109435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:33.110271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:33.110557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:33.110835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] PATH_INFO: `/v3/projects/555e746025854bb893d27c4290879488` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:33.112048 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=555e746025854bb893d27c4290879488)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:33.114149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1112/2209] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:33 2022] PUT /identity/v3/projects/34616afcc7d2411992085fbb829ec4d8/users/0c2fbf5d3064479a909e7547a050ef5e/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:33.114284 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:33.118908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e4663-66d3-4cc8-aee3-eeeb16065fc6 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:33.119205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e4663-66d3-4cc8-aee3-eeeb16065fc6 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:33.119488 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e4663-66d3-4cc8-aee3-eeeb16065fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:33.140583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-7e5e4663-66d3-4cc8-aee3-eeeb16065fc6 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:33.141811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7e5e4663-66d3-4cc8-aee3-eeeb16065fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:33.167696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555e746025854bb893d27c4290879488', 'request_id': 'req-483c3981-f1c7-414e-97df-7903a49096d2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:33.173689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555e746025854bb893d27c4290879488', 'request_id': 'req-483c3981-f1c7-414e-97df-7903a49096d2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:33.182013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555e746025854bb893d27c4290879488', 'request_id': 'req-483c3981-f1c7-414e-97df-7903a49096d2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:33.198356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] The token cache is being invalidate because project 555e746025854bb893d27c4290879488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:51:33.198658 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:33.199326 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:33.201179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1098/2210] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:51:33 2022] DELETE /identity/v3/projects/555e746025854bb893d27c4290879488 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:51:33.205070 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:33.206412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:33.210739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1113/2211] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:51:33.224212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e4663-66d3-4cc8-aee3-eeeb16065fc6 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:33.225782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7e5e4663-66d3-4cc8-aee3-eeeb16065fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:33.249991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:33.281964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c3981-f1c7-414e-97df-7903a49096d2 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:33.283727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e4663-66d3-4cc8-aee3-eeeb16065fc6 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:33.286482 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3234ab-15b9-46dc-9ea3-850f2be87c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:33.287375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3234ab-15b9-46dc-9ea3-850f2be87c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:33.287653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3234ab-15b9-46dc-9ea3-850f2be87c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:33.287925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3234ab-15b9-46dc-9ea3-850f2be87c2c admin admin] PATH_INFO: `/v3/users/ed4c97e5a065477eb420731596ad1081` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:33.289174 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3234ab-15b9-46dc-9ea3-850f2be87c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4c97e5a065477eb420731596ad1081)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:33.291116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3234ab-15b9-46dc-9ea3-850f2be87c2c admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:33.342103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a453181-e299-441f-95ca-aad56d39d025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:33.342768 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a453181-e299-441f-95ca-aad56d39d025 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:33.343072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a453181-e299-441f-95ca-aad56d39d025 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:33.343348 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a453181-e299-441f-95ca-aad56d39d025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:33.349328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2b3234ab-15b9-46dc-9ea3-850f2be87c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4c97e5a065477eb420731596ad1081'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:33.352577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a453181-e299-441f-95ca-aad56d39d025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:33.354031 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a453181-e299-441f-95ca-aad56d39d025 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:33.356532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2b3234ab-15b9-46dc-9ea3-850f2be87c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4c97e5a065477eb420731596ad1081'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:33.357407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2b3234ab-15b9-46dc-9ea3-850f2be87c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4c97e5a065477eb420731596ad1081'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:33.358178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2b3234ab-15b9-46dc-9ea3-850f2be87c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4c97e5a065477eb420731596ad1081'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:33.366680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1114/2212] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:51:33.367143 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2b3234ab-15b9-46dc-9ea3-850f2be87c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4c97e5a065477eb420731596ad1081'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:33.385938 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1099/2213] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:51:33 2022] DELETE /identity/v3/users/ed4c97e5a065477eb420731596ad1081 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:51:33.794855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a453181-e299-441f-95ca-aad56d39d025 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:33.843220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a453181-e299-441f-95ca-aad56d39d025 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:33.931438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:33.951988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:33.952995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:33.954114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:33.954114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] PATH_INFO: `/v3/projects/1a8b94e6c148424da71488387b279b9b` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:33.955147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8b94e6c148424da71488387b279b9b)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:33.957939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:34.018482 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8b94e6c148424da71488387b279b9b', 'request_id': 'req-e8407bc9-92c6-4577-af6a-9a203b0389c9'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:34.027712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8b94e6c148424da71488387b279b9b', 'request_id': 'req-e8407bc9-92c6-4577-af6a-9a203b0389c9'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:34.034386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8b94e6c148424da71488387b279b9b', 'request_id': 'req-e8407bc9-92c6-4577-af6a-9a203b0389c9'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:34.056733 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] The token cache is being invalidate because project 1a8b94e6c148424da71488387b279b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:51:34.057026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:34.057685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:34.059384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1115/2214] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:51:33 2022] DELETE /identity/v3/projects/1a8b94e6c148424da71488387b279b9b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:38.474478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe516fa-9910-4670-932f-39a33723f605 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:38.491960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe516fa-9910-4670-932f-39a33723f605 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:38.492670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe516fa-9910-4670-932f-39a33723f605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:38.536469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-ebe516fa-9910-4670-932f-39a33723f605 None None] MFA Rules not processed for user `0c2fbf5d3064479a909e7547a050ef5e`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:38.537956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ebe516fa-9910-4670-932f-39a33723f605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:38.607509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1100/2215] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:38.612312 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:38.613771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:38.680819 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8407bc9-92c6-4577-af6a-9a203b0389c9 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:38.687417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01135f-19a7-4961-a774-1d1ea0505c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:38.688180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01135f-19a7-4961-a774-1d1ea0505c33 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:38.688556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01135f-19a7-4961-a774-1d1ea0505c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:38.688832 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01135f-19a7-4961-a774-1d1ea0505c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:38.689613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01135f-19a7-4961-a774-1d1ea0505c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:38.691706 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01135f-19a7-4961-a774-1d1ea0505c33 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:38.729309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1116/2216] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:51:38 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:38.730578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe516fa-9910-4670-932f-39a33723f605 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:38.743895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe516fa-9910-4670-932f-39a33723f605 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:38.788265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:38.816032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902f2cf-8eda-474e-b050-8c9c8c7513b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:38.816760 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902f2cf-8eda-474e-b050-8c9c8c7513b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:38.817043 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902f2cf-8eda-474e-b050-8c9c8c7513b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:38.817318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902f2cf-8eda-474e-b050-8c9c8c7513b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:38.818022 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902f2cf-8eda-474e-b050-8c9c8c7513b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:38.819997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902f2cf-8eda-474e-b050-8c9c8c7513b1 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:38.845940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1101/2217] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:51:38 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:38.847130 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01135f-19a7-4961-a774-1d1ea0505c33 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:38.858072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01135f-19a7-4961-a774-1d1ea0505c33 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:38.862834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726db79-0342-4fbd-84b4-582931459607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:38.863529 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726db79-0342-4fbd-84b4-582931459607 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:38.863815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726db79-0342-4fbd-84b4-582931459607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:38.864181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726db79-0342-4fbd-84b4-582931459607 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:38.865046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726db79-0342-4fbd-84b4-582931459607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:38.866681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726db79-0342-4fbd-84b4-582931459607 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:38.878589 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1117/2218] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:51:38.882481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902f2cf-8eda-474e-b050-8c9c8c7513b1 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:38.893658 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902f2cf-8eda-474e-b050-8c9c8c7513b1 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:38.898833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c45256-0c2e-4ccd-a703-cec595646872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:38.899736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c45256-0c2e-4ccd-a703-cec595646872 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:38.900017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c45256-0c2e-4ccd-a703-cec595646872 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:38.900339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c45256-0c2e-4ccd-a703-cec595646872 admin admin] PATH_INFO: `/v3/projects/56cdda7c64754dfc82af9067e447e6e5/users/d38617657600492e9887791c690620a7/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:38.931947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c45256-0c2e-4ccd-a703-cec595646872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cdda7c64754dfc82af9067e447e6e5, user_id=d38617657600492e9887791c690620a7, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:38.935083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c45256-0c2e-4ccd-a703-cec595646872 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:38.953581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1102/2219] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:38 2022] PUT /identity/v3/projects/56cdda7c64754dfc82af9067e447e6e5/users/d38617657600492e9887791c690620a7/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:51:38.961082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726db79-0342-4fbd-84b4-582931459607 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:38.974450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726db79-0342-4fbd-84b4-582931459607 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:39.029683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:39.043623 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde896c-43ab-4134-bdcd-8b3a203d4e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:39.045128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde896c-43ab-4134-bdcd-8b3a203d4e74 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:39.045325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde896c-43ab-4134-bdcd-8b3a203d4e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:39.045851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde896c-43ab-4134-bdcd-8b3a203d4e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:39.046747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde896c-43ab-4134-bdcd-8b3a203d4e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:39.048613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde896c-43ab-4134-bdcd-8b3a203d4e74 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:39.062648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1118/2220] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:39.064637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c45256-0c2e-4ccd-a703-cec595646872 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:39.075590 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c45256-0c2e-4ccd-a703-cec595646872 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:39.080576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185474e-97ba-4e5e-b144-34b307700018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:39.081490 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185474e-97ba-4e5e-b144-34b307700018 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:39.081813 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185474e-97ba-4e5e-b144-34b307700018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:39.082093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185474e-97ba-4e5e-b144-34b307700018 admin admin] PATH_INFO: `/v3/projects/56cdda7c64754dfc82af9067e447e6e5/users/d38617657600492e9887791c690620a7/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:39.084609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185474e-97ba-4e5e-b144-34b307700018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cdda7c64754dfc82af9067e447e6e5, user_id=d38617657600492e9887791c690620a7, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:39.087319 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185474e-97ba-4e5e-b144-34b307700018 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:39.099798 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1103/2221] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:39 2022] PUT /identity/v3/projects/56cdda7c64754dfc82af9067e447e6e5/users/d38617657600492e9887791c690620a7/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:45.281750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760586a-91e5-4b92-9b3a-1ebd4449f327 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:45.282609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760586a-91e5-4b92-9b3a-1ebd4449f327 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:45.283029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760586a-91e5-4b92-9b3a-1ebd4449f327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:45.313398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-2760586a-91e5-4b92-9b3a-1ebd4449f327 None None] MFA Rules not processed for user `d38617657600492e9887791c690620a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:45.314898 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2760586a-91e5-4b92-9b3a-1ebd4449f327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:45.398243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1119/2222] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:45.415807 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185474e-97ba-4e5e-b144-34b307700018 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:45.425836 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8185474e-97ba-4e5e-b144-34b307700018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:45.524654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185474e-97ba-4e5e-b144-34b307700018 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:45.530690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b2b44-6bdf-491e-808a-e084508bfbb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:45.531379 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b2b44-6bdf-491e-808a-e084508bfbb8 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:45.531660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b2b44-6bdf-491e-808a-e084508bfbb8 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:45.531985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b2b44-6bdf-491e-808a-e084508bfbb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:45.597933 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b2b44-6bdf-491e-808a-e084508bfbb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:45.599753 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b2b44-6bdf-491e-808a-e084508bfbb8 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:45.611532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1104/2223] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:52.469588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760586a-91e5-4b92-9b3a-1ebd4449f327 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:52.471648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2760586a-91e5-4b92-9b3a-1ebd4449f327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:52.554383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760586a-91e5-4b92-9b3a-1ebd4449f327 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:52.559192 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403f41a-fb08-4aa6-96c8-c444e4a21d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:52.561597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403f41a-fb08-4aa6-96c8-c444e4a21d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:52.561926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403f41a-fb08-4aa6-96c8-c444e4a21d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:52.562200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403f41a-fb08-4aa6-96c8-c444e4a21d83 admin admin] PATH_INFO: `/v3/users/c2ce871916fb4e2b924c3dffd1c6d98a` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:52.563513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403f41a-fb08-4aa6-96c8-c444e4a21d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ce871916fb4e2b924c3dffd1c6d98a)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:52.566056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403f41a-fb08-4aa6-96c8-c444e4a21d83 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:52.621797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d403f41a-fb08-4aa6-96c8-c444e4a21d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ce871916fb4e2b924c3dffd1c6d98a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:52.629897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d403f41a-fb08-4aa6-96c8-c444e4a21d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ce871916fb4e2b924c3dffd1c6d98a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:52.630738 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d403f41a-fb08-4aa6-96c8-c444e4a21d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ce871916fb4e2b924c3dffd1c6d98a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:52.631480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d403f41a-fb08-4aa6-96c8-c444e4a21d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ce871916fb4e2b924c3dffd1c6d98a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:52.642754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d403f41a-fb08-4aa6-96c8-c444e4a21d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ce871916fb4e2b924c3dffd1c6d98a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:52.658722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:52.678850 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1120/2224] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:51:52 2022] DELETE /identity/v3/users/c2ce871916fb4e2b924c3dffd1c6d98a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:52.683307 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42106b48-1e79-46f6-90e4-f5d66ff8146a None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:52.683838 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42106b48-1e79-46f6-90e4-f5d66ff8146a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:52.683838 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42106b48-1e79-46f6-90e4-f5d66ff8146a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:52.702852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-42106b48-1e79-46f6-90e4-f5d66ff8146a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:52.704174 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-42106b48-1e79-46f6-90e4-f5d66ff8146a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:52.750749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:52.814700 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1105/2225] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:52.823632 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403f41a-fb08-4aa6-96c8-c444e4a21d83 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:52.827086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d403f41a-fb08-4aa6-96c8-c444e4a21d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:52.930523 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403f41a-fb08-4aa6-96c8-c444e4a21d83 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:52.940867 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1af2-db76-4049-bd23-b895917360c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:52.941818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1af2-db76-4049-bd23-b895917360c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:52.942166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1af2-db76-4049-bd23-b895917360c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:52.942504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1af2-db76-4049-bd23-b895917360c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:52.958510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee1af2-db76-4049-bd23-b895917360c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:52.960531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee1af2-db76-4049-bd23-b895917360c6 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:52.973919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1121/2226] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:53.659513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42106b48-1e79-46f6-90e4-f5d66ff8146a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:53.661166 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-42106b48-1e79-46f6-90e4-f5d66ff8146a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:53.682619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42106b48-1e79-46f6-90e4-f5d66ff8146a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:53.691326 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:53.693167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:53.693638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:53.694114 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4 admin admin] PATH_INFO: `/v3/projects/8a69cfb9a7074932af6246fa3746a04b` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:53.695998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a69cfb9a7074932af6246fa3746a04b)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:53.698497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:53.764999 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a69cfb9a7074932af6246fa3746a04b', 'request_id': 'req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:53.771219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a69cfb9a7074932af6246fa3746a04b', 'request_id': 'req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:53.779795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a69cfb9a7074932af6246fa3746a04b', 'request_id': 'req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:53.799507 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4 admin admin] The token cache is being invalidate because project 8a69cfb9a7074932af6246fa3746a04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:51:53.799862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:53.800511 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f3072cec-7e1f-4fa1-9f02-67d9850b7bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:53.802462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1106/2227] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:51:53 2022] DELETE /identity/v3/projects/8a69cfb9a7074932af6246fa3746a04b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:53.807406 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ce94f-953a-42c6-9867-b39211e0bb6a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:53.807920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ce94f-953a-42c6-9867-b39211e0bb6a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:53.808453 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ce94f-953a-42c6-9867-b39211e0bb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:53.837561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-ad2ce94f-953a-42c6-9867-b39211e0bb6a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:53.838789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ad2ce94f-953a-42c6-9867-b39211e0bb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:53.921271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1122/2228] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:53.929751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bb341-cbc5-41ba-a872-fb996eb8ca38 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:53.930057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bb341-cbc5-41ba-a872-fb996eb8ca38 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:53.930353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bb341-cbc5-41ba-a872-fb996eb8ca38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:53.953236 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-867bb341-cbc5-41ba-a872-fb996eb8ca38 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:53.954450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-867bb341-cbc5-41ba-a872-fb996eb8ca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:53.963814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1107/2229] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:53.973445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ce94f-953a-42c6-9867-b39211e0bb6a None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:53.987948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ce94f-953a-42c6-9867-b39211e0bb6a None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:53.993852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52cbd7-205c-46f7-8d70-c7a73e1b7175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:53.994734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52cbd7-205c-46f7-8d70-c7a73e1b7175 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:53.995180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52cbd7-205c-46f7-8d70-c7a73e1b7175 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:53.995459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52cbd7-205c-46f7-8d70-c7a73e1b7175 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:53.996202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52cbd7-205c-46f7-8d70-c7a73e1b7175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:51:53.996559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52cbd7-205c-46f7-8d70-c7a73e1b7175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:53.998603 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52cbd7-205c-46f7-8d70-c7a73e1b7175 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:54.015268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1123/2230] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:51:54.016207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bb341-cbc5-41ba-a872-fb996eb8ca38 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:54.026534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bb341-cbc5-41ba-a872-fb996eb8ca38 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:54.032875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c0a33-15ed-45fe-8783-c2bfada0bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:54.033550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c0a33-15ed-45fe-8783-c2bfada0bc6c admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:54.033829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c0a33-15ed-45fe-8783-c2bfada0bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:54.034100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c0a33-15ed-45fe-8783-c2bfada0bc6c admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:54.034806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c0a33-15ed-45fe-8783-c2bfada0bc6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:54.036750 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c0a33-15ed-45fe-8783-c2bfada0bc6c admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:54.074566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1108/2231] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:51:54 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:51:54.078980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52cbd7-205c-46f7-8d70-c7a73e1b7175 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:54.090749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52cbd7-205c-46f7-8d70-c7a73e1b7175 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:54.161442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef9bcd-734e-4f6d-bb17-5ad8fa87a34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:54.162132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef9bcd-734e-4f6d-bb17-5ad8fa87a34b admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:54.162416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef9bcd-734e-4f6d-bb17-5ad8fa87a34b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:54.162696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef9bcd-734e-4f6d-bb17-5ad8fa87a34b admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:54.163390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef9bcd-734e-4f6d-bb17-5ad8fa87a34b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:54.165410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef9bcd-734e-4f6d-bb17-5ad8fa87a34b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:54.212628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1124/2232] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:51:54 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:54.216969 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c0a33-15ed-45fe-8783-c2bfada0bc6c admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:54.227668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c0a33-15ed-45fe-8783-c2bfada0bc6c admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:54.232965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b10085-1521-41f3-8d17-dcf2241dfa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:54.233724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b10085-1521-41f3-8d17-dcf2241dfa67 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:54.234075 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b10085-1521-41f3-8d17-dcf2241dfa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:54.234419 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b10085-1521-41f3-8d17-dcf2241dfa67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:54.235232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b10085-1521-41f3-8d17-dcf2241dfa67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:54.236993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b10085-1521-41f3-8d17-dcf2241dfa67 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:54.249282 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1109/2233] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:51:54.253374 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef9bcd-734e-4f6d-bb17-5ad8fa87a34b admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:54.266061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef9bcd-734e-4f6d-bb17-5ad8fa87a34b admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:54.271792 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cba1c-8770-482d-ad37-f84188e6e960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:54.272504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cba1c-8770-482d-ad37-f84188e6e960 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:54.272782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cba1c-8770-482d-ad37-f84188e6e960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:54.273054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cba1c-8770-482d-ad37-f84188e6e960 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:54.273798 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6cba1c-8770-482d-ad37-f84188e6e960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:54.275414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6cba1c-8770-482d-ad37-f84188e6e960 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:54.281771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:54.291317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1125/2234] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:54.292883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b10085-1521-41f3-8d17-dcf2241dfa67 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:54.306842 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b10085-1521-41f3-8d17-dcf2241dfa67 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:54.312149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13912ade-b7ce-4c33-ba49-3f2bc7cb6a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:54.313090 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13912ade-b7ce-4c33-ba49-3f2bc7cb6a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:54.313370 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13912ade-b7ce-4c33-ba49-3f2bc7cb6a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:54.313641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13912ade-b7ce-4c33-ba49-3f2bc7cb6a1d admin admin] PATH_INFO: `/v3/projects/2bf56fbc8675443b9b4fbfc57bc8d3bd/users/979358bb932847b48a62abcc53913f61/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:54.332052 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13912ade-b7ce-4c33-ba49-3f2bc7cb6a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf56fbc8675443b9b4fbfc57bc8d3bd, user_id=979358bb932847b48a62abcc53913f61, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:54.335222 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13912ade-b7ce-4c33-ba49-3f2bc7cb6a1d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:54.350139 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1110/2235] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:54 2022] PUT /identity/v3/projects/2bf56fbc8675443b9b4fbfc57bc8d3bd/users/979358bb932847b48a62abcc53913f61/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:54.361529 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794ca5b-c2b3-4e71-aa72-ade2725aed40 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:54.361861 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794ca5b-c2b3-4e71-aa72-ade2725aed40 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:54.362122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794ca5b-c2b3-4e71-aa72-ade2725aed40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:54.392414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-1794ca5b-c2b3-4e71-aa72-ade2725aed40 None None] MFA Rules not processed for user `979358bb932847b48a62abcc53913f61`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:54.393747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1794ca5b-c2b3-4e71-aa72-ade2725aed40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:54.475159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1126/2236] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:54.487047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13912ade-b7ce-4c33-ba49-3f2bc7cb6a1d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:54.488994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-13912ade-b7ce-4c33-ba49-3f2bc7cb6a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:54.542996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:54.546937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13912ade-b7ce-4c33-ba49-3f2bc7cb6a1d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:54.551649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab3630-0a70-4735-a218-83a79de27460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:54.552403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab3630-0a70-4735-a218-83a79de27460 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:54.552904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab3630-0a70-4735-a218-83a79de27460 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:54.553201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab3630-0a70-4735-a218-83a79de27460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:54.563189 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab3630-0a70-4735-a218-83a79de27460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:54.564672 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab3630-0a70-4735-a218-83a79de27460 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:54.573785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1111/2237] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:55.538864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794ca5b-c2b3-4e71-aa72-ade2725aed40 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:55.540612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1794ca5b-c2b3-4e71-aa72-ade2725aed40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:55.611186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794ca5b-c2b3-4e71-aa72-ade2725aed40 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:55.616696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb84af1-8bc9-4c41-9445-4a874e0531f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:55.617598 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84af1-8bc9-4c41-9445-4a874e0531f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:55.617879 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84af1-8bc9-4c41-9445-4a874e0531f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:55.618150 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84af1-8bc9-4c41-9445-4a874e0531f1 admin admin] PATH_INFO: `/v3/users/6ed6769d2b054d3b94d4817065e060e0` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:55.619410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb84af1-8bc9-4c41-9445-4a874e0531f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed6769d2b054d3b94d4817065e060e0)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:55.621551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb84af1-8bc9-4c41-9445-4a874e0531f1 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:55.684376 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0fb84af1-8bc9-4c41-9445-4a874e0531f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed6769d2b054d3b94d4817065e060e0'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:55.691987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0fb84af1-8bc9-4c41-9445-4a874e0531f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed6769d2b054d3b94d4817065e060e0'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:55.692752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0fb84af1-8bc9-4c41-9445-4a874e0531f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed6769d2b054d3b94d4817065e060e0'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:55.693463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0fb84af1-8bc9-4c41-9445-4a874e0531f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed6769d2b054d3b94d4817065e060e0'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:55.702931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0fb84af1-8bc9-4c41-9445-4a874e0531f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed6769d2b054d3b94d4817065e060e0'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:55.721268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1127/2238] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:51:55 2022] DELETE /identity/v3/users/6ed6769d2b054d3b94d4817065e060e0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:55.725882 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f74a7-aad4-45d3-a3c0-43baf923c22f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:55.726357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f74a7-aad4-45d3-a3c0-43baf923c22f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:55.726449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f74a7-aad4-45d3-a3c0-43baf923c22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:55.745142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e48f74a7-aad4-45d3-a3c0-43baf923c22f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:55.746339 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e48f74a7-aad4-45d3-a3c0-43baf923c22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:55.824653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1112/2239] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:55.835187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb84af1-8bc9-4c41-9445-4a874e0531f1 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:55.836795 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-0fb84af1-8bc9-4c41-9445-4a874e0531f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:55.848811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:55.900888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb84af1-8bc9-4c41-9445-4a874e0531f1 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:55.905356 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e642e-01ea-42ea-b23a-c8b61cbcf5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:55.906020 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e642e-01ea-42ea-b23a-c8b61cbcf5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:55.906307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e642e-01ea-42ea-b23a-c8b61cbcf5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:55.906586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e642e-01ea-42ea-b23a-c8b61cbcf5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:55.917282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e642e-01ea-42ea-b23a-c8b61cbcf5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:55.918734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e642e-01ea-42ea-b23a-c8b61cbcf5d0 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:55.930000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1128/2240] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:56.277135 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f74a7-aad4-45d3-a3c0-43baf923c22f None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:56.278838 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e48f74a7-aad4-45d3-a3c0-43baf923c22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:56.293846 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f74a7-aad4-45d3-a3c0-43baf923c22f None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:56.308217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88d7f0-cde4-4f41-b766-43f350839fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:56.309237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88d7f0-cde4-4f41-b766-43f350839fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:56.309536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88d7f0-cde4-4f41-b766-43f350839fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:56.310090 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88d7f0-cde4-4f41-b766-43f350839fd5 admin admin] PATH_INFO: `/v3/projects/ced4d5f781094e20a8622363a8c0dfe7` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:56.311359 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88d7f0-cde4-4f41-b766-43f350839fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced4d5f781094e20a8622363a8c0dfe7)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:56.313458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88d7f0-cde4-4f41-b766-43f350839fd5 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:56.389193 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2c88d7f0-cde4-4f41-b766-43f350839fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced4d5f781094e20a8622363a8c0dfe7', 'request_id': 'req-2c88d7f0-cde4-4f41-b766-43f350839fd5'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:56.395436 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2c88d7f0-cde4-4f41-b766-43f350839fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced4d5f781094e20a8622363a8c0dfe7', 'request_id': 'req-2c88d7f0-cde4-4f41-b766-43f350839fd5'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:56.404700 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2c88d7f0-cde4-4f41-b766-43f350839fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced4d5f781094e20a8622363a8c0dfe7', 'request_id': 'req-2c88d7f0-cde4-4f41-b766-43f350839fd5'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:56.421988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2c88d7f0-cde4-4f41-b766-43f350839fd5 admin admin] The token cache is being invalidate because project ced4d5f781094e20a8622363a8c0dfe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:51:56.422438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2c88d7f0-cde4-4f41-b766-43f350839fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:56.423205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2c88d7f0-cde4-4f41-b766-43f350839fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:56.425324 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1113/2241] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:51:56 2022] DELETE /identity/v3/projects/ced4d5f781094e20a8622363a8c0dfe7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:56.432370 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917fbbd-5b51-4b53-b5ff-38d50da810af None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:56.432370 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917fbbd-5b51-4b53-b5ff-38d50da810af None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:56.432370 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917fbbd-5b51-4b53-b5ff-38d50da810af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:56.450820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-d917fbbd-5b51-4b53-b5ff-38d50da810af None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:56.452123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d917fbbd-5b51-4b53-b5ff-38d50da810af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:56.544339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1129/2242] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:56.551101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d5df7-9a29-44a0-8114-bf20b895817a None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:56.551418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d5df7-9a29-44a0-8114-bf20b895817a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:56.551695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d5df7-9a29-44a0-8114-bf20b895817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:56.579748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-5f9d5df7-9a29-44a0-8114-bf20b895817a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:56.581013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5f9d5df7-9a29-44a0-8114-bf20b895817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:56.589404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1114/2243] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:56.594916 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917fbbd-5b51-4b53-b5ff-38d50da810af None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:56.604953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917fbbd-5b51-4b53-b5ff-38d50da810af None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:56.610625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335095d-39d7-4bc7-9ae8-12f03af7550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:56.611350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335095d-39d7-4bc7-9ae8-12f03af7550e admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:56.611694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335095d-39d7-4bc7-9ae8-12f03af7550e admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:56.612027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335095d-39d7-4bc7-9ae8-12f03af7550e admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:56.612874 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335095d-39d7-4bc7-9ae8-12f03af7550e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:51:56.613243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335095d-39d7-4bc7-9ae8-12f03af7550e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:56.615189 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335095d-39d7-4bc7-9ae8-12f03af7550e admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:56.634854 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1130/2244] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:51:56.640856 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d5df7-9a29-44a0-8114-bf20b895817a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:56.653553 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d5df7-9a29-44a0-8114-bf20b895817a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:56.659216 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658c0e9-eb15-4d70-a846-dfac7cfc11dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:56.659945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658c0e9-eb15-4d70-a846-dfac7cfc11dd admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:56.660222 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658c0e9-eb15-4d70-a846-dfac7cfc11dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:56.660528 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658c0e9-eb15-4d70-a846-dfac7cfc11dd admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:56.661217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658c0e9-eb15-4d70-a846-dfac7cfc11dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:56.663166 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658c0e9-eb15-4d70-a846-dfac7cfc11dd admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:56.689679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1115/2245] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:51:56 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:56.694089 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335095d-39d7-4bc7-9ae8-12f03af7550e admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:56.704643 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335095d-39d7-4bc7-9ae8-12f03af7550e admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:56.765125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6b69e-0fec-4378-bf8b-eb50814f2df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:56.766156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b69e-0fec-4378-bf8b-eb50814f2df3 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:56.766490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b69e-0fec-4378-bf8b-eb50814f2df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:56.766810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b69e-0fec-4378-bf8b-eb50814f2df3 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:56.767597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6b69e-0fec-4378-bf8b-eb50814f2df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:56.769652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6b69e-0fec-4378-bf8b-eb50814f2df3 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:56.791806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1131/2246] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:51:56 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:56.795468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658c0e9-eb15-4d70-a846-dfac7cfc11dd admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:56.811551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658c0e9-eb15-4d70-a846-dfac7cfc11dd admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:56.816842 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa1525-6991-4173-b63d-766a5e1b63f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:56.817528 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa1525-6991-4173-b63d-766a5e1b63f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:56.817809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa1525-6991-4173-b63d-766a5e1b63f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:56.818083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa1525-6991-4173-b63d-766a5e1b63f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:56.818995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa1525-6991-4173-b63d-766a5e1b63f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:56.820636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa1525-6991-4173-b63d-766a5e1b63f8 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:56.833140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1116/2247] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:56.839358 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6b69e-0fec-4378-bf8b-eb50814f2df3 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:56.851648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6b69e-0fec-4378-bf8b-eb50814f2df3 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:56.857769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa24cf-4b8e-4470-b18c-60ba0ed68943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:56.858496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa24cf-4b8e-4470-b18c-60ba0ed68943 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:56.858781 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa24cf-4b8e-4470-b18c-60ba0ed68943 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:56.859092 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa24cf-4b8e-4470-b18c-60ba0ed68943 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:56.859904 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa24cf-4b8e-4470-b18c-60ba0ed68943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:56.861790 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa24cf-4b8e-4470-b18c-60ba0ed68943 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:56.873326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1132/2248] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:56.877729 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa1525-6991-4173-b63d-766a5e1b63f8 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:56.888472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa1525-6991-4173-b63d-766a5e1b63f8 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:56.893744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7383e-12ae-4486-a73c-d74409aab7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:56.894619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7383e-12ae-4486-a73c-d74409aab7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:56.894910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7383e-12ae-4486-a73c-d74409aab7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:56.895186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7383e-12ae-4486-a73c-d74409aab7fe admin admin] PATH_INFO: `/v3/projects/b853f66216b84232827e359d2e6cedef/users/a04b380d16f241f088c7cba22df6e419/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:56.910885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7383e-12ae-4486-a73c-d74409aab7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b853f66216b84232827e359d2e6cedef, user_id=a04b380d16f241f088c7cba22df6e419, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:56.913610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7383e-12ae-4486-a73c-d74409aab7fe admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:56.929010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1117/2249] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:56 2022] PUT /identity/v3/projects/b853f66216b84232827e359d2e6cedef/users/a04b380d16f241f088c7cba22df6e419/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:51:56.945126 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bee3e-0d58-408f-8c91-4e3a9e32d0e5 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:56.945563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bee3e-0d58-408f-8c91-4e3a9e32d0e5 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:56.945949 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bee3e-0d58-408f-8c91-4e3a9e32d0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:56.977459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-ca9bee3e-0d58-408f-8c91-4e3a9e32d0e5 None None] MFA Rules not processed for user `a04b380d16f241f088c7cba22df6e419`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:56.978650 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ca9bee3e-0d58-408f-8c91-4e3a9e32d0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:56.984702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:57.055924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1133/2250] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:57.066904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7383e-12ae-4486-a73c-d74409aab7fe admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:57.068965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2da7383e-12ae-4486-a73c-d74409aab7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:57.084346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:57.131216 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7383e-12ae-4486-a73c-d74409aab7fe admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:57.135357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb29e90-8543-4487-902c-892d61a0721f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:57.136082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb29e90-8543-4487-902c-892d61a0721f service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:57.136586 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb29e90-8543-4487-902c-892d61a0721f service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:57.136894 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb29e90-8543-4487-902c-892d61a0721f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:57.149183 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb29e90-8543-4487-902c-892d61a0721f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:57.150568 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb29e90-8543-4487-902c-892d61a0721f service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:57.160692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1118/2251] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:57.657582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9bee3e-0d58-408f-8c91-4e3a9e32d0e5 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:57.659149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ca9bee3e-0d58-408f-8c91-4e3a9e32d0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:57.727502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9bee3e-0d58-408f-8c91-4e3a9e32d0e5 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:57.734724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397606dc-dce7-4839-81f8-94723e6ed70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:57.735584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397606dc-dce7-4839-81f8-94723e6ed70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:57.735867 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397606dc-dce7-4839-81f8-94723e6ed70a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:57.736141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397606dc-dce7-4839-81f8-94723e6ed70a admin admin] PATH_INFO: `/v3/users/979358bb932847b48a62abcc53913f61` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:57.737583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397606dc-dce7-4839-81f8-94723e6ed70a admin admin] RBAC: Authorizing `identity:delete_user(user_id=979358bb932847b48a62abcc53913f61)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:57.739495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397606dc-dce7-4839-81f8-94723e6ed70a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:57.789481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-397606dc-dce7-4839-81f8-94723e6ed70a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '979358bb932847b48a62abcc53913f61'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:57.796666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-397606dc-dce7-4839-81f8-94723e6ed70a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '979358bb932847b48a62abcc53913f61'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:57.797332 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-397606dc-dce7-4839-81f8-94723e6ed70a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '979358bb932847b48a62abcc53913f61'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:57.797934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-397606dc-dce7-4839-81f8-94723e6ed70a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '979358bb932847b48a62abcc53913f61'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:57.805850 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-397606dc-dce7-4839-81f8-94723e6ed70a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '979358bb932847b48a62abcc53913f61'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:57.823729 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1134/2252] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:51:57 2022] DELETE /identity/v3/users/979358bb932847b48a62abcc53913f61 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:57.829765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8c40d-1f00-4148-b0d0-b804658537e5 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:57.830289 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8c40d-1f00-4148-b0d0-b804658537e5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:57.830385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8c40d-1f00-4148-b0d0-b804658537e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:57.852016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-12e8c40d-1f00-4148-b0d0-b804658537e5 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:57.853254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-12e8c40d-1f00-4148-b0d0-b804658537e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:57.911935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1119/2253] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:57.921648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397606dc-dce7-4839-81f8-94723e6ed70a admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:57.923080 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-397606dc-dce7-4839-81f8-94723e6ed70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:57.970231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:58.000672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397606dc-dce7-4839-81f8-94723e6ed70a admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:58.004625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45217c83-715f-4480-8ded-2c1c5f728c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:58.005322 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45217c83-715f-4480-8ded-2c1c5f728c4b service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:58.005608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45217c83-715f-4480-8ded-2c1c5f728c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:58.005914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45217c83-715f-4480-8ded-2c1c5f728c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:58.015729 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45217c83-715f-4480-8ded-2c1c5f728c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:58.017221 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45217c83-715f-4480-8ded-2c1c5f728c4b service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:58.027024 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1135/2254] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:51:58.312714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8c40d-1f00-4148-b0d0-b804658537e5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:58.314185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-12e8c40d-1f00-4148-b0d0-b804658537e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:58.328948 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8c40d-1f00-4148-b0d0-b804658537e5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:58.334177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717aebec-43d0-4a91-8141-65099ce39690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:58.335059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aebec-43d0-4a91-8141-65099ce39690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:58.335371 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aebec-43d0-4a91-8141-65099ce39690 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:58.335644 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aebec-43d0-4a91-8141-65099ce39690 admin admin] PATH_INFO: `/v3/projects/2bf56fbc8675443b9b4fbfc57bc8d3bd` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:58.336917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717aebec-43d0-4a91-8141-65099ce39690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf56fbc8675443b9b4fbfc57bc8d3bd)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:58.338815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717aebec-43d0-4a91-8141-65099ce39690 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:58.389717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-717aebec-43d0-4a91-8141-65099ce39690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf56fbc8675443b9b4fbfc57bc8d3bd', 'request_id': 'req-717aebec-43d0-4a91-8141-65099ce39690'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:58.395830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-717aebec-43d0-4a91-8141-65099ce39690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf56fbc8675443b9b4fbfc57bc8d3bd', 'request_id': 'req-717aebec-43d0-4a91-8141-65099ce39690'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:58.402261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-717aebec-43d0-4a91-8141-65099ce39690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf56fbc8675443b9b4fbfc57bc8d3bd', 'request_id': 'req-717aebec-43d0-4a91-8141-65099ce39690'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:58.417175 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-717aebec-43d0-4a91-8141-65099ce39690 admin admin] The token cache is being invalidate because project 2bf56fbc8675443b9b4fbfc57bc8d3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:51:58.417461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-717aebec-43d0-4a91-8141-65099ce39690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:58.418167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-717aebec-43d0-4a91-8141-65099ce39690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:51:58.420077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1120/2255] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:51:58 2022] DELETE /identity/v3/projects/2bf56fbc8675443b9b4fbfc57bc8d3bd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:58.425076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882fec3-5e7f-470f-891c-57e40a7f3f14 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:58.425355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882fec3-5e7f-470f-891c-57e40a7f3f14 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:58.425631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882fec3-5e7f-470f-891c-57e40a7f3f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:58.445191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-e882fec3-5e7f-470f-891c-57e40a7f3f14 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:58.446381 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e882fec3-5e7f-470f-891c-57e40a7f3f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:58.524956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1136/2256] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:58.532902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2722f-bcc3-4485-b2cb-1e2d5efb30ee None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:58.533268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2722f-bcc3-4485-b2cb-1e2d5efb30ee None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:58.533620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2722f-bcc3-4485-b2cb-1e2d5efb30ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:58.553925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-74d2722f-bcc3-4485-b2cb-1e2d5efb30ee None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:58.555284 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-74d2722f-bcc3-4485-b2cb-1e2d5efb30ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:58.565122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1121/2257] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:58.569080 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882fec3-5e7f-470f-891c-57e40a7f3f14 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:58.579893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882fec3-5e7f-470f-891c-57e40a7f3f14 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:58.586880 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04606f7-c2a4-4fff-8e84-81d4bbf0a9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:58.587864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04606f7-c2a4-4fff-8e84-81d4bbf0a9ee admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:58.588887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04606f7-c2a4-4fff-8e84-81d4bbf0a9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:58.588887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04606f7-c2a4-4fff-8e84-81d4bbf0a9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:58.589509 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04606f7-c2a4-4fff-8e84-81d4bbf0a9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:51:58.589933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04606f7-c2a4-4fff-8e84-81d4bbf0a9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:58.592208 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04606f7-c2a4-4fff-8e84-81d4bbf0a9ee admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:58.604887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1137/2258] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:51:58.610831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2722f-bcc3-4485-b2cb-1e2d5efb30ee None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:58.621078 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2722f-bcc3-4485-b2cb-1e2d5efb30ee None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:58.627714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533ba59-f6e3-42c3-9ece-a6e4a910667a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:58.628560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533ba59-f6e3-42c3-9ece-a6e4a910667a admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:58.629221 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533ba59-f6e3-42c3-9ece-a6e4a910667a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:58.629709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533ba59-f6e3-42c3-9ece-a6e4a910667a admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:58.630829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533ba59-f6e3-42c3-9ece-a6e4a910667a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:58.633128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533ba59-f6e3-42c3-9ece-a6e4a910667a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:58.670098 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1122/2259] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:51:58 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:51:58.674710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04606f7-c2a4-4fff-8e84-81d4bbf0a9ee admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:58.685673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04606f7-c2a4-4fff-8e84-81d4bbf0a9ee admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:58.774796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de5e2b-8117-4cf3-9526-c48677123445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:58.775470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de5e2b-8117-4cf3-9526-c48677123445 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:58.775866 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de5e2b-8117-4cf3-9526-c48677123445 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:58.776174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de5e2b-8117-4cf3-9526-c48677123445 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:58.776905 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de5e2b-8117-4cf3-9526-c48677123445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:58.779232 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de5e2b-8117-4cf3-9526-c48677123445 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:58.800608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1138/2260] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:51:58 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:58.804837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533ba59-f6e3-42c3-9ece-a6e4a910667a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:58.815182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533ba59-f6e3-42c3-9ece-a6e4a910667a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:58.820557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cba81-6929-4ea2-ae6e-926dc5340440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:58.821335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cba81-6929-4ea2-ae6e-926dc5340440 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:58.821685 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cba81-6929-4ea2-ae6e-926dc5340440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:58.822025 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cba81-6929-4ea2-ae6e-926dc5340440 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:58.822861 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cba81-6929-4ea2-ae6e-926dc5340440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:58.824583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cba81-6929-4ea2-ae6e-926dc5340440 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:58.827157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:58.841067 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1123/2261] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:58.842415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de5e2b-8117-4cf3-9526-c48677123445 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:58.853702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de5e2b-8117-4cf3-9526-c48677123445 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:58.860402 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546086f-c887-4ae4-8d2c-74ebcc551f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:58.861254 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546086f-c887-4ae4-8d2c-74ebcc551f1b admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:58.861534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546086f-c887-4ae4-8d2c-74ebcc551f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:58.861817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546086f-c887-4ae4-8d2c-74ebcc551f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:58.862560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546086f-c887-4ae4-8d2c-74ebcc551f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:58.864165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546086f-c887-4ae4-8d2c-74ebcc551f1b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:58.875074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1139/2262] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:51:58.879196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cba81-6929-4ea2-ae6e-926dc5340440 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:58.889840 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cba81-6929-4ea2-ae6e-926dc5340440 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:58.894637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e3004-b753-480a-a3d2-10e9d2c09642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:58.895528 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e3004-b753-480a-a3d2-10e9d2c09642 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:58.895819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e3004-b753-480a-a3d2-10e9d2c09642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:58.896076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e3004-b753-480a-a3d2-10e9d2c09642 admin admin] PATH_INFO: `/v3/projects/2120bd5387434a68adecff9da0c6a503/users/d327e005d8ca4b06a5f3f99a67d59586/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:58.911464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e3004-b753-480a-a3d2-10e9d2c09642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2120bd5387434a68adecff9da0c6a503, user_id=d327e005d8ca4b06a5f3f99a67d59586, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:58.914190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e3004-b753-480a-a3d2-10e9d2c09642 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:58.927945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1124/2263] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:58 2022] PUT /identity/v3/projects/2120bd5387434a68adecff9da0c6a503/users/d327e005d8ca4b06a5f3f99a67d59586/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:58.938801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cce1e-6064-4ed1-b04c-9056a125b036 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:58.939096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cce1e-6064-4ed1-b04c-9056a125b036 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:58.939394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cce1e-6064-4ed1-b04c-9056a125b036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:58.970378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-db1cce1e-6064-4ed1-b04c-9056a125b036 None None] MFA Rules not processed for user `d327e005d8ca4b06a5f3f99a67d59586`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:58.971612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-db1cce1e-6064-4ed1-b04c-9056a125b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:58.998036 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:59.049342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1140/2264] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:59.054068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e3004-b753-480a-a3d2-10e9d2c09642 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:59.121355 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e3004-b753-480a-a3d2-10e9d2c09642 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:59.128831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287741b-91fe-45a2-b553-9c032d915696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:59.129463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287741b-91fe-45a2-b553-9c032d915696 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:59.129770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287741b-91fe-45a2-b553-9c032d915696 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:59.130050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287741b-91fe-45a2-b553-9c032d915696 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:59.130725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287741b-91fe-45a2-b553-9c032d915696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:59.132648 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287741b-91fe-45a2-b553-9c032d915696 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:59.166808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1125/2265] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:51:59 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:59.171807 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cce1e-6064-4ed1-b04c-9056a125b036 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:59.183088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cce1e-6064-4ed1-b04c-9056a125b036 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:59.250697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f92dc0-94f6-46b6-8698-59a30b12c4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:59.251388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f92dc0-94f6-46b6-8698-59a30b12c4ec admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:59.251673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f92dc0-94f6-46b6-8698-59a30b12c4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:59.251949 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f92dc0-94f6-46b6-8698-59a30b12c4ec admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:59.252685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f92dc0-94f6-46b6-8698-59a30b12c4ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:59.254659 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f92dc0-94f6-46b6-8698-59a30b12c4ec admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:59.282984 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1141/2266] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:51:59 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:59.287615 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287741b-91fe-45a2-b553-9c032d915696 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:59.300697 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287741b-91fe-45a2-b553-9c032d915696 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:59.306078 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29815b0d-f333-4b14-a661-fc5e7404f180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:59.306738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29815b0d-f333-4b14-a661-fc5e7404f180 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:59.307035 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29815b0d-f333-4b14-a661-fc5e7404f180 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:59.307306 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29815b0d-f333-4b14-a661-fc5e7404f180 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:59.308050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29815b0d-f333-4b14-a661-fc5e7404f180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:59.309904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29815b0d-f333-4b14-a661-fc5e7404f180 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:59.321008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1126/2267] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:59.325065 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f92dc0-94f6-46b6-8698-59a30b12c4ec admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:59.335711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f92dc0-94f6-46b6-8698-59a30b12c4ec admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:59.340615 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0a696-3087-4424-a0ad-943baf179e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:59.341433 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0a696-3087-4424-a0ad-943baf179e10 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:59.341683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0a696-3087-4424-a0ad-943baf179e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:59.341959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0a696-3087-4424-a0ad-943baf179e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:59.342704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0a696-3087-4424-a0ad-943baf179e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:59.344335 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0a696-3087-4424-a0ad-943baf179e10 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:59.354514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1142/2268] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:59.358625 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29815b0d-f333-4b14-a661-fc5e7404f180 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:59.368652 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29815b0d-f333-4b14-a661-fc5e7404f180 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:59.373946 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae37806-391c-47b0-a18f-c9d7d531ea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:59.374832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae37806-391c-47b0-a18f-c9d7d531ea9d admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:59.375108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae37806-391c-47b0-a18f-c9d7d531ea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:59.375340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae37806-391c-47b0-a18f-c9d7d531ea9d admin admin] PATH_INFO: `/v3/projects/6fa10dea1ee6441f9af1ffa9969b5130/users/650c3b963b7f42e38f780636a606780d/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:59.391120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae37806-391c-47b0-a18f-c9d7d531ea9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa10dea1ee6441f9af1ffa9969b5130, user_id=650c3b963b7f42e38f780636a606780d, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:59.393833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae37806-391c-47b0-a18f-c9d7d531ea9d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:59.408963 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1127/2269] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:59 2022] PUT /identity/v3/projects/6fa10dea1ee6441f9af1ffa9969b5130/users/650c3b963b7f42e38f780636a606780d/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:51:59.420695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093ee1d-543b-4544-839d-93315ec91f7e None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:59.420989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093ee1d-543b-4544-839d-93315ec91f7e None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:59.421268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093ee1d-543b-4544-839d-93315ec91f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:59.449372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-a093ee1d-543b-4544-839d-93315ec91f7e None None] MFA Rules not processed for user `650c3b963b7f42e38f780636a606780d`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:51:59.450533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a093ee1d-543b-4544-839d-93315ec91f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:51:59.521506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1143/2270] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:51:59.526676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae37806-391c-47b0-a18f-c9d7d531ea9d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:59.595885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae37806-391c-47b0-a18f-c9d7d531ea9d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:59.603101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e94f9-58dc-44b2-9c0d-c38e1e82ff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:59.604067 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e94f9-58dc-44b2-9c0d-c38e1e82ff25 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:59.604518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e94f9-58dc-44b2-9c0d-c38e1e82ff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:59.604916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e94f9-58dc-44b2-9c0d-c38e1e82ff25 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:59.606084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e94f9-58dc-44b2-9c0d-c38e1e82ff25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:59.608404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e94f9-58dc-44b2-9c0d-c38e1e82ff25 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:59.636407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1128/2271] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:51:59 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:51:59.641473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093ee1d-543b-4544-839d-93315ec91f7e None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:59.652316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093ee1d-543b-4544-839d-93315ec91f7e None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:59.682029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:59.713064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648446d5-af9d-4b55-bec1-4a0657845dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:59.713748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648446d5-af9d-4b55-bec1-4a0657845dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:59.714035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648446d5-af9d-4b55-bec1-4a0657845dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:59.714314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648446d5-af9d-4b55-bec1-4a0657845dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:59.715015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648446d5-af9d-4b55-bec1-4a0657845dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:59.717307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648446d5-af9d-4b55-bec1-4a0657845dc2 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:59.739711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1144/2272] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:51:59 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 15:51:59.743965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e94f9-58dc-44b2-9c0d-c38e1e82ff25 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:59.756096 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e94f9-58dc-44b2-9c0d-c38e1e82ff25 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:59.760920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6910ff3-b09e-406b-9540-0f6331cad39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:59.761774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6910ff3-b09e-406b-9540-0f6331cad39d admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:59.762171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6910ff3-b09e-406b-9540-0f6331cad39d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:59.762540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6910ff3-b09e-406b-9540-0f6331cad39d admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:59.763437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6910ff3-b09e-406b-9540-0f6331cad39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:59.765180 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6910ff3-b09e-406b-9540-0f6331cad39d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:59.767824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:51:59.783675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1129/2273] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:59.784537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648446d5-af9d-4b55-bec1-4a0657845dc2 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:59.794584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648446d5-af9d-4b55-bec1-4a0657845dc2 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:59.799508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a5e78-8726-4f03-9275-2cba2d62a3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:59.800439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a5e78-8726-4f03-9275-2cba2d62a3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:59.800719 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a5e78-8726-4f03-9275-2cba2d62a3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:59.800992 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a5e78-8726-4f03-9275-2cba2d62a3f7 admin admin] PATH_INFO: `/v3/projects/7a7be0662ba6441fbed35eb6bdea89d6/users/42fee25ee60a476caeef7d315617043c/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:59.816532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a5e78-8726-4f03-9275-2cba2d62a3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7be0662ba6441fbed35eb6bdea89d6, user_id=42fee25ee60a476caeef7d315617043c, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:59.819212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a5e78-8726-4f03-9275-2cba2d62a3f7 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:59.833518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1145/2274] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:59 2022] PUT /identity/v3/projects/7a7be0662ba6441fbed35eb6bdea89d6/users/42fee25ee60a476caeef7d315617043c/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:51:59.837834 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6910ff3-b09e-406b-9540-0f6331cad39d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:59.848084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6910ff3-b09e-406b-9540-0f6331cad39d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:59.914650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0dbb2-d22f-41f7-b647-2e72ea4f576f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:59.915563 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0dbb2-d22f-41f7-b647-2e72ea4f576f admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:59.916076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0dbb2-d22f-41f7-b647-2e72ea4f576f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:59.916510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0dbb2-d22f-41f7-b647-2e72ea4f576f admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:59.917624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0dbb2-d22f-41f7-b647-2e72ea4f576f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:59.919975 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0dbb2-d22f-41f7-b647-2e72ea4f576f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:59.931102 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1130/2275] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:51:59.935128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a5e78-8726-4f03-9275-2cba2d62a3f7 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:51:59.947646 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a5e78-8726-4f03-9275-2cba2d62a3f7 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:51:59.954213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e7487-b076-42a6-a052-f743c4a2f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:51:59.955259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e7487-b076-42a6-a052-f743c4a2f32f admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:59.955603 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e7487-b076-42a6-a052-f743c4a2f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:59.955915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e7487-b076-42a6-a052-f743c4a2f32f admin admin] PATH_INFO: `/v3/projects/7a7be0662ba6441fbed35eb6bdea89d6/users/42fee25ee60a476caeef7d315617043c/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:51:59.958467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e7487-b076-42a6-a052-f743c4a2f32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7be0662ba6441fbed35eb6bdea89d6, user_id=42fee25ee60a476caeef7d315617043c, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:51:59.961959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e7487-b076-42a6-a052-f743c4a2f32f admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:51:59.975680 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1146/2276] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:51:59 2022] PUT /identity/v3/projects/7a7be0662ba6441fbed35eb6bdea89d6/users/42fee25ee60a476caeef7d315617043c/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:51:59.986425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b7555-ea75-4acc-870f-bd426ad41596 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:51:59.986705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b7555-ea75-4acc-870f-bd426ad41596 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:51:59.987197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b7555-ea75-4acc-870f-bd426ad41596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:00.015468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-335b7555-ea75-4acc-870f-bd426ad41596 None None] MFA Rules not processed for user `42fee25ee60a476caeef7d315617043c`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:00.016823 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-335b7555-ea75-4acc-870f-bd426ad41596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:00.090166 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1131/2277] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:00.101804 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e7487-b076-42a6-a052-f743c4a2f32f admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:00.103627 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8a9e7487-b076-42a6-a052-f743c4a2f32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:00.163840 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e7487-b076-42a6-a052-f743c4a2f32f admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:00.167875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d11d81-fdcb-4609-aee1-39f46e9cb5d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:00.172565 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d11d81-fdcb-4609-aee1-39f46e9cb5d2 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:00.172851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d11d81-fdcb-4609-aee1-39f46e9cb5d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:00.173163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d11d81-fdcb-4609-aee1-39f46e9cb5d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:00.248250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d11d81-fdcb-4609-aee1-39f46e9cb5d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:00.249778 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d11d81-fdcb-4609-aee1-39f46e9cb5d2 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:00.259084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1147/2278] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:52:02.804439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b7555-ea75-4acc-870f-bd426ad41596 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:02.814675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b7555-ea75-4acc-870f-bd426ad41596 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:02.818510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6840e3-8e4b-4ebe-8aac-d8273103aa92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:02.819153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6840e3-8e4b-4ebe-8aac-d8273103aa92 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:02.819437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6840e3-8e4b-4ebe-8aac-d8273103aa92 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:02.819715 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6840e3-8e4b-4ebe-8aac-d8273103aa92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:02.879469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6840e3-8e4b-4ebe-8aac-d8273103aa92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:02.881032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6840e3-8e4b-4ebe-8aac-d8273103aa92 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:02.891188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1132/2279] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:52:03.444177 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d11d81-fdcb-4609-aee1-39f46e9cb5d2 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:03.453233 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d11d81-fdcb-4609-aee1-39f46e9cb5d2 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:03.457367 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6c158-8654-4f2d-991b-bec740eebc73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:03.457994 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6c158-8654-4f2d-991b-bec740eebc73 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:03.458271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6c158-8654-4f2d-991b-bec740eebc73 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:03.458536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6c158-8654-4f2d-991b-bec740eebc73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:03.468361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6c158-8654-4f2d-991b-bec740eebc73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:03.469783 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6c158-8654-4f2d-991b-bec740eebc73 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:03.480038 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1148/2280] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:52:12.633169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6840e3-8e4b-4ebe-8aac-d8273103aa92 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:12.656265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:12.711043 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6840e3-8e4b-4ebe-8aac-d8273103aa92 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:12.717028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f315-5f9f-4215-a29c-7d1e559414c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:12.717901 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f315-5f9f-4215-a29c-7d1e559414c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:12.718182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f315-5f9f-4215-a29c-7d1e559414c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:12.718454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f315-5f9f-4215-a29c-7d1e559414c3 admin admin] PATH_INFO: `/v3/users/d327e005d8ca4b06a5f3f99a67d59586` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:12.719775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4f315-5f9f-4215-a29c-7d1e559414c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d327e005d8ca4b06a5f3f99a67d59586)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:12.724142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4f315-5f9f-4215-a29c-7d1e559414c3 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:12.774986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-64b4f315-5f9f-4215-a29c-7d1e559414c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd327e005d8ca4b06a5f3f99a67d59586'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:12.782774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-64b4f315-5f9f-4215-a29c-7d1e559414c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd327e005d8ca4b06a5f3f99a67d59586'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:12.783471 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-64b4f315-5f9f-4215-a29c-7d1e559414c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd327e005d8ca4b06a5f3f99a67d59586'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:12.784085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-64b4f315-5f9f-4215-a29c-7d1e559414c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd327e005d8ca4b06a5f3f99a67d59586'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:12.794034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-64b4f315-5f9f-4215-a29c-7d1e559414c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd327e005d8ca4b06a5f3f99a67d59586'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:12.812658 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1133/2281] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:52:12 2022] DELETE /identity/v3/users/d327e005d8ca4b06a5f3f99a67d59586 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:52:12.817481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddb2a0-688e-42d7-8f49-69ce945baa6a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:12.817959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddb2a0-688e-42d7-8f49-69ce945baa6a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:12.818073 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddb2a0-688e-42d7-8f49-69ce945baa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:12.836423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-6eddb2a0-688e-42d7-8f49-69ce945baa6a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:12.837633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6eddb2a0-688e-42d7-8f49-69ce945baa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:12.859326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:12.908995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1149/2282] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:12.918836 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f315-5f9f-4215-a29c-7d1e559414c3 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:12.920508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-64b4f315-5f9f-4215-a29c-7d1e559414c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:12.980205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f315-5f9f-4215-a29c-7d1e559414c3 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:12.984430 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c538ec-7d0b-4bc2-a5a7-de3883523568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:12.985075 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c538ec-7d0b-4bc2-a5a7-de3883523568 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:12.985341 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c538ec-7d0b-4bc2-a5a7-de3883523568 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:12.985595 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c538ec-7d0b-4bc2-a5a7-de3883523568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:12.995220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c538ec-7d0b-4bc2-a5a7-de3883523568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:12.996695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c538ec-7d0b-4bc2-a5a7-de3883523568 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:13.006847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1134/2283] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:52:13.086066 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aad36-4be9-44b4-9886-4a4825daec4d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:13.086412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aad36-4be9-44b4-9886-4a4825daec4d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:13.086695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aad36-4be9-44b4-9886-4a4825daec4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:13.106328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-243aad36-4be9-44b4-9886-4a4825daec4d None None] MFA Rules not processed for user `0c2fbf5d3064479a909e7547a050ef5e`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:13.107682 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-243aad36-4be9-44b4-9886-4a4825daec4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:13.188944 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1150/2284] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:13.567125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c538ec-7d0b-4bc2-a5a7-de3883523568 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:13.568660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-60c538ec-7d0b-4bc2-a5a7-de3883523568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:13.588598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c538ec-7d0b-4bc2-a5a7-de3883523568 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:13.595111 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:13.596220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:13.596649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:13.598448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] PATH_INFO: `/v3/projects/2120bd5387434a68adecff9da0c6a503` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:13.598448 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2120bd5387434a68adecff9da0c6a503)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:13.600534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:13.647801 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:13.659019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2120bd5387434a68adecff9da0c6a503', 'request_id': 'req-88421730-73d2-4a77-819e-d66c52ecbd9b'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:13.665188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2120bd5387434a68adecff9da0c6a503', 'request_id': 'req-88421730-73d2-4a77-819e-d66c52ecbd9b'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:13.674437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2120bd5387434a68adecff9da0c6a503', 'request_id': 'req-88421730-73d2-4a77-819e-d66c52ecbd9b'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:13.691008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] The token cache is being invalidate because project 2120bd5387434a68adecff9da0c6a503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:52:13.691295 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:13.691940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:13.693584 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1135/2285] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:52:13 2022] DELETE /identity/v3/projects/2120bd5387434a68adecff9da0c6a503 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:52:13.697806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aad36-4be9-44b4-9886-4a4825daec4d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:13.709739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aad36-4be9-44b4-9886-4a4825daec4d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:13.768706 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0526a54-2382-4cd9-b929-f217e07a1fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:13.769610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0526a54-2382-4cd9-b929-f217e07a1fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:13.770554 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0526a54-2382-4cd9-b929-f217e07a1fee admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:13.770962 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0526a54-2382-4cd9-b929-f217e07a1fee admin admin] PATH_INFO: `/v3/users/650c3b963b7f42e38f780636a606780d` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:13.772204 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0526a54-2382-4cd9-b929-f217e07a1fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=650c3b963b7f42e38f780636a606780d)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:13.774420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0526a54-2382-4cd9-b929-f217e07a1fee admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:13.823950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d0526a54-2382-4cd9-b929-f217e07a1fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650c3b963b7f42e38f780636a606780d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:13.831277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d0526a54-2382-4cd9-b929-f217e07a1fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650c3b963b7f42e38f780636a606780d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:13.831978 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d0526a54-2382-4cd9-b929-f217e07a1fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650c3b963b7f42e38f780636a606780d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:13.832647 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d0526a54-2382-4cd9-b929-f217e07a1fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650c3b963b7f42e38f780636a606780d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:13.841935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d0526a54-2382-4cd9-b929-f217e07a1fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650c3b963b7f42e38f780636a606780d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:13.850536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:13.862674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1151/2286] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:52:13 2022] DELETE /identity/v3/users/650c3b963b7f42e38f780636a606780d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:52:14.155323 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:14.156990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:14.191570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88421730-73d2-4a77-819e-d66c52ecbd9b admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:14.266247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:14.267167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:14.267420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:14.267695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] PATH_INFO: `/v3/projects/6fa10dea1ee6441f9af1ffa9969b5130` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:14.268954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa10dea1ee6441f9af1ffa9969b5130)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:14.271022 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:14.328481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa10dea1ee6441f9af1ffa9969b5130', 'request_id': 'req-5aa2ff50-830a-4b87-b5bc-af2599c13f89'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:14.334476 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa10dea1ee6441f9af1ffa9969b5130', 'request_id': 'req-5aa2ff50-830a-4b87-b5bc-af2599c13f89'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:14.344754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa10dea1ee6441f9af1ffa9969b5130', 'request_id': 'req-5aa2ff50-830a-4b87-b5bc-af2599c13f89'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:14.364352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] The token cache is being invalidate because project 6fa10dea1ee6441f9af1ffa9969b5130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:52:14.365111 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:14.365473 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:14.368316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1136/2287] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:52:14 2022] DELETE /identity/v3/projects/6fa10dea1ee6441f9af1ffa9969b5130 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:52:14.372622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0526a54-2382-4cd9-b929-f217e07a1fee admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:14.374502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d0526a54-2382-4cd9-b929-f217e07a1fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:14.394626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0526a54-2382-4cd9-b929-f217e07a1fee admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:14.472692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740bfa7-bb5c-499f-926f-cbe7e7de3e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:14.473724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740bfa7-bb5c-499f-926f-cbe7e7de3e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:14.474012 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740bfa7-bb5c-499f-926f-cbe7e7de3e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:14.474289 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740bfa7-bb5c-499f-926f-cbe7e7de3e50 admin admin] PATH_INFO: `/v3/users/42fee25ee60a476caeef7d315617043c` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:14.475676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740bfa7-bb5c-499f-926f-cbe7e7de3e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42fee25ee60a476caeef7d315617043c)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:14.478586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740bfa7-bb5c-499f-926f-cbe7e7de3e50 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:14.535988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3740bfa7-bb5c-499f-926f-cbe7e7de3e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42fee25ee60a476caeef7d315617043c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:14.550949 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3740bfa7-bb5c-499f-926f-cbe7e7de3e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42fee25ee60a476caeef7d315617043c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:14.551727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3740bfa7-bb5c-499f-926f-cbe7e7de3e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42fee25ee60a476caeef7d315617043c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:14.552392 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3740bfa7-bb5c-499f-926f-cbe7e7de3e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42fee25ee60a476caeef7d315617043c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:14.562611 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-3740bfa7-bb5c-499f-926f-cbe7e7de3e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42fee25ee60a476caeef7d315617043c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:14.585690 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1152/2288] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:52:14 2022] DELETE /identity/v3/users/42fee25ee60a476caeef7d315617043c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:52:14.981492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:14.983705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:15.000915 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2ff50-830a-4b87-b5bc-af2599c13f89 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:15.069227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:15.084137 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:15.086457 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:15.086799 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:15.087259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8 admin admin] PATH_INFO: `/v3/projects/7a7be0662ba6441fbed35eb6bdea89d6` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:15.088543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a7be0662ba6441fbed35eb6bdea89d6)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:15.092417 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:15.152685 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a7be0662ba6441fbed35eb6bdea89d6', 'request_id': 'req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:15.159133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a7be0662ba6441fbed35eb6bdea89d6', 'request_id': 'req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:15.165208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a7be0662ba6441fbed35eb6bdea89d6', 'request_id': 'req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:15.179474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8 admin admin] The token cache is being invalidate because project 7a7be0662ba6441fbed35eb6bdea89d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:52:15.179768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:15.180622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7a605707-8e8a-47bc-8c0f-ab449da7cfa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:15.182743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1137/2289] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:52:14 2022] DELETE /identity/v3/projects/7a7be0662ba6441fbed35eb6bdea89d6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:52:15.187903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8929cb5-d025-4928-9d49-765c87e67eaa None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:15.188441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8929cb5-d025-4928-9d49-765c87e67eaa None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:15.188635 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8929cb5-d025-4928-9d49-765c87e67eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:15.216136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-a8929cb5-d025-4928-9d49-765c87e67eaa None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:15.217461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a8929cb5-d025-4928-9d49-765c87e67eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:15.279285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1153/2290] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:15.288481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103fef-c1cb-4a8c-9ac3-862d9a3e7f9f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:15.288843 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103fef-c1cb-4a8c-9ac3-862d9a3e7f9f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:15.289181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103fef-c1cb-4a8c-9ac3-862d9a3e7f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:15.309249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-a0103fef-c1cb-4a8c-9ac3-862d9a3e7f9f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:15.310550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a0103fef-c1cb-4a8c-9ac3-862d9a3e7f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:15.320316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1138/2291] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:15.324724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8929cb5-d025-4928-9d49-765c87e67eaa None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:15.335215 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8929cb5-d025-4928-9d49-765c87e67eaa None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:15.340044 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5381fb3-d63a-4c66-8532-8730850df0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:15.340756 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381fb3-d63a-4c66-8532-8730850df0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:15.341173 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381fb3-d63a-4c66-8532-8730850df0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:15.341566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381fb3-d63a-4c66-8532-8730850df0e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:15.342310 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5381fb3-d63a-4c66-8532-8730850df0e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:52:15.342616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5381fb3-d63a-4c66-8532-8730850df0e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:15.344427 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5381fb3-d63a-4c66-8532-8730850df0e2 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:15.351897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:15.359182 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1154/2292] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:52:15.363680 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103fef-c1cb-4a8c-9ac3-862d9a3e7f9f None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:15.373345 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103fef-c1cb-4a8c-9ac3-862d9a3e7f9f None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:15.379326 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2206c29-89ad-4a94-a58a-1828a3926c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:15.380014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2206c29-89ad-4a94-a58a-1828a3926c70 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:15.380316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2206c29-89ad-4a94-a58a-1828a3926c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:15.380594 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2206c29-89ad-4a94-a58a-1828a3926c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:15.381279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2206c29-89ad-4a94-a58a-1828a3926c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:15.383239 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2206c29-89ad-4a94-a58a-1828a3926c70 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:15.415693 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1139/2293] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:52:15 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:52:15.420070 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5381fb3-d63a-4c66-8532-8730850df0e2 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:15.430401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5381fb3-d63a-4c66-8532-8730850df0e2 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:15.490518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f230c17-6eed-4c72-8116-7560ba5a29a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:15.491193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f230c17-6eed-4c72-8116-7560ba5a29a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:15.491473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f230c17-6eed-4c72-8116-7560ba5a29a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:15.491741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f230c17-6eed-4c72-8116-7560ba5a29a6 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:15.492465 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f230c17-6eed-4c72-8116-7560ba5a29a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:15.494384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f230c17-6eed-4c72-8116-7560ba5a29a6 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:15.515081 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1155/2294] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:52:15 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:52:15.519556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2206c29-89ad-4a94-a58a-1828a3926c70 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:15.530596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2206c29-89ad-4a94-a58a-1828a3926c70 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:15.536846 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6d28b-9236-45a7-81c4-134a8c686e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:15.537614 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6d28b-9236-45a7-81c4-134a8c686e33 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:15.538041 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6d28b-9236-45a7-81c4-134a8c686e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:15.538388 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6d28b-9236-45a7-81c4-134a8c686e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:15.539353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6d28b-9236-45a7-81c4-134a8c686e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:15.541522 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6d28b-9236-45a7-81c4-134a8c686e33 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:15.554626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1140/2295] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:52:15.563601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f230c17-6eed-4c72-8116-7560ba5a29a6 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:15.583506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f230c17-6eed-4c72-8116-7560ba5a29a6 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:15.593745 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee0625-7e31-4674-8ac4-fa3e93643f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:15.594646 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0625-7e31-4674-8ac4-fa3e93643f6c admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:15.594982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0625-7e31-4674-8ac4-fa3e93643f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:15.595317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0625-7e31-4674-8ac4-fa3e93643f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:15.596163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee0625-7e31-4674-8ac4-fa3e93643f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:15.597874 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee0625-7e31-4674-8ac4-fa3e93643f6c admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:15.609614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1156/2296] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:52:15.613889 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6d28b-9236-45a7-81c4-134a8c686e33 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:15.624268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6d28b-9236-45a7-81c4-134a8c686e33 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:15.628952 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b31a2-bddf-4310-b7c0-161cc3e6344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:15.629849 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b31a2-bddf-4310-b7c0-161cc3e6344c admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:15.630130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b31a2-bddf-4310-b7c0-161cc3e6344c admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:15.630404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b31a2-bddf-4310-b7c0-161cc3e6344c admin admin] PATH_INFO: `/v3/projects/e1d330b93b494e66a42c8179fe479b11/users/f21e115769624d058954f373ecee906d/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:15.646461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b31a2-bddf-4310-b7c0-161cc3e6344c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d330b93b494e66a42c8179fe479b11, user_id=f21e115769624d058954f373ecee906d, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:15.649170 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b31a2-bddf-4310-b7c0-161cc3e6344c admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:15.667518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1141/2297] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:52:15 2022] PUT /identity/v3/projects/e1d330b93b494e66a42c8179fe479b11/users/f21e115769624d058954f373ecee906d/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:52:15.677810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b13a-7fb4-43ca-bed0-868f6e437d7a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:15.678102 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b13a-7fb4-43ca-bed0-868f6e437d7a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:15.678385 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b13a-7fb4-43ca-bed0-868f6e437d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:15.706851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-d5a9b13a-7fb4-43ca-bed0-868f6e437d7a None None] MFA Rules not processed for user `f21e115769624d058954f373ecee906d`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:15.708114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d5a9b13a-7fb4-43ca-bed0-868f6e437d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:15.794224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1157/2298] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:15.805197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b31a2-bddf-4310-b7c0-161cc3e6344c admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:15.807402 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5a3b31a2-bddf-4310-b7c0-161cc3e6344c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:15.873974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b31a2-bddf-4310-b7c0-161cc3e6344c admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:15.878271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd041c1-fda4-419c-b90f-cc5a6736b804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:15.878995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd041c1-fda4-419c-b90f-cc5a6736b804 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:15.879265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd041c1-fda4-419c-b90f-cc5a6736b804 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:15.879544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd041c1-fda4-419c-b90f-cc5a6736b804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:15.889663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd041c1-fda4-419c-b90f-cc5a6736b804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:15.891116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd041c1-fda4-419c-b90f-cc5a6736b804 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:15.900928 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1142/2299] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:52:16.622000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9b13a-7fb4-43ca-bed0-868f6e437d7a None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:16.623691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d5a9b13a-7fb4-43ca-bed0-868f6e437d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:16.699372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9b13a-7fb4-43ca-bed0-868f6e437d7a None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:16.706877 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e5b1-ff21-43b8-9f38-7b0c9da9ebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:16.707960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e5b1-ff21-43b8-9f38-7b0c9da9ebed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:16.708342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e5b1-ff21-43b8-9f38-7b0c9da9ebed admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:16.708561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e5b1-ff21-43b8-9f38-7b0c9da9ebed admin admin] PATH_INFO: `/v3/users/a04b380d16f241f088c7cba22df6e419` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:16.710342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9e5b1-ff21-43b8-9f38-7b0c9da9ebed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04b380d16f241f088c7cba22df6e419)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:16.712363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9e5b1-ff21-43b8-9f38-7b0c9da9ebed admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:16.719907 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:16.774045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f4b9e5b1-ff21-43b8-9f38-7b0c9da9ebed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04b380d16f241f088c7cba22df6e419'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:16.782403 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f4b9e5b1-ff21-43b8-9f38-7b0c9da9ebed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04b380d16f241f088c7cba22df6e419'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:16.783060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f4b9e5b1-ff21-43b8-9f38-7b0c9da9ebed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04b380d16f241f088c7cba22df6e419'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:16.783679 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f4b9e5b1-ff21-43b8-9f38-7b0c9da9ebed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04b380d16f241f088c7cba22df6e419'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:16.793430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f4b9e5b1-ff21-43b8-9f38-7b0c9da9ebed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04b380d16f241f088c7cba22df6e419'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:16.816148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1158/2300] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:52:16 2022] DELETE /identity/v3/users/a04b380d16f241f088c7cba22df6e419 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:52:16.820783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb4f99-9040-46d2-9fc6-f907097891fd None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:16.821297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb4f99-9040-46d2-9fc6-f907097891fd None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:16.821431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb4f99-9040-46d2-9fc6-f907097891fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:16.839910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-06eb4f99-9040-46d2-9fc6-f907097891fd None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:16.841335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-06eb4f99-9040-46d2-9fc6-f907097891fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:16.867603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:16.948761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1143/2301] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:16.955644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e5b1-ff21-43b8-9f38-7b0c9da9ebed admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:16.957390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f4b9e5b1-ff21-43b8-9f38-7b0c9da9ebed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:17.020923 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e5b1-ff21-43b8-9f38-7b0c9da9ebed admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:17.025117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd90a21-6747-44cd-aa18-adb368480d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:17.025896 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd90a21-6747-44cd-aa18-adb368480d27 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:17.026189 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd90a21-6747-44cd-aa18-adb368480d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:17.026663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd90a21-6747-44cd-aa18-adb368480d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:17.048334 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd90a21-6747-44cd-aa18-adb368480d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:17.050101 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd90a21-6747-44cd-aa18-adb368480d27 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:17.063182 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1159/2302] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:52:17.296832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4c6df-67e1-4646-996f-81714a732278 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:17.297232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4c6df-67e1-4646-996f-81714a732278 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:17.297510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4c6df-67e1-4646-996f-81714a732278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:17.315630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-27e4c6df-67e1-4646-996f-81714a732278 None None] MFA Rules not processed for user `f21e115769624d058954f373ecee906d`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:17.316852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-27e4c6df-67e1-4646-996f-81714a732278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:17.345713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd90a21-6747-44cd-aa18-adb368480d27 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:17.347213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1dd90a21-6747-44cd-aa18-adb368480d27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:17.365997 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd90a21-6747-44cd-aa18-adb368480d27 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:17.380271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1144/2303] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:17.391828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f37e24-e042-465c-8f8c-4e97c91d190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:17.392906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f37e24-e042-465c-8f8c-4e97c91d190a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:17.393600 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f37e24-e042-465c-8f8c-4e97c91d190a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:17.394018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f37e24-e042-465c-8f8c-4e97c91d190a admin admin] PATH_INFO: `/v3/projects/b853f66216b84232827e359d2e6cedef` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:17.397641 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f37e24-e042-465c-8f8c-4e97c91d190a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b853f66216b84232827e359d2e6cedef)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:17.401279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f37e24-e042-465c-8f8c-4e97c91d190a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:17.483096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-c6f37e24-e042-465c-8f8c-4e97c91d190a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b853f66216b84232827e359d2e6cedef', 'request_id': 'req-c6f37e24-e042-465c-8f8c-4e97c91d190a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:17.490440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-c6f37e24-e042-465c-8f8c-4e97c91d190a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b853f66216b84232827e359d2e6cedef', 'request_id': 'req-c6f37e24-e042-465c-8f8c-4e97c91d190a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:17.496368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-c6f37e24-e042-465c-8f8c-4e97c91d190a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b853f66216b84232827e359d2e6cedef', 'request_id': 'req-c6f37e24-e042-465c-8f8c-4e97c91d190a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:17.513102 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-c6f37e24-e042-465c-8f8c-4e97c91d190a admin admin] The token cache is being invalidate because project b853f66216b84232827e359d2e6cedef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:52:17.513473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-c6f37e24-e042-465c-8f8c-4e97c91d190a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:17.514252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-c6f37e24-e042-465c-8f8c-4e97c91d190a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:17.515907 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1160/2304] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:52:17 2022] DELETE /identity/v3/projects/b853f66216b84232827e359d2e6cedef => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:52:17.520914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45140b-457a-4d80-9b69-fdc1b6ec6cc1 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:17.521181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45140b-457a-4d80-9b69-fdc1b6ec6cc1 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:17.521450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45140b-457a-4d80-9b69-fdc1b6ec6cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:17.542613 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-7e45140b-457a-4d80-9b69-fdc1b6ec6cc1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:17.545247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7e45140b-457a-4d80-9b69-fdc1b6ec6cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:17.621402 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1145/2305] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:17.629376 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56714d7-4b89-41df-ae16-9b11c260b944 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:17.629895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56714d7-4b89-41df-ae16-9b11c260b944 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:17.630005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56714d7-4b89-41df-ae16-9b11c260b944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:17.648982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-d56714d7-4b89-41df-ae16-9b11c260b944 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:17.650207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d56714d7-4b89-41df-ae16-9b11c260b944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:17.658230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1161/2306] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:17.663044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45140b-457a-4d80-9b69-fdc1b6ec6cc1 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:17.673467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45140b-457a-4d80-9b69-fdc1b6ec6cc1 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:17.678028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87499d8a-34d6-4bc9-a805-fe805ffe2a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:17.678695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499d8a-34d6-4bc9-a805-fe805ffe2a9f admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:17.678978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499d8a-34d6-4bc9-a805-fe805ffe2a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:17.679253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499d8a-34d6-4bc9-a805-fe805ffe2a9f admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:17.680261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87499d8a-34d6-4bc9-a805-fe805ffe2a9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:52:17.680392 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87499d8a-34d6-4bc9-a805-fe805ffe2a9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:17.681953 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87499d8a-34d6-4bc9-a805-fe805ffe2a9f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:17.694682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1146/2307] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:52:17.699075 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56714d7-4b89-41df-ae16-9b11c260b944 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:17.705019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:17.710317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56714d7-4b89-41df-ae16-9b11c260b944 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:17.733428 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bbdb1-14f0-4b5a-8d83-25057f1f4333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:17.734119 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bbdb1-14f0-4b5a-8d83-25057f1f4333 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:17.734398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bbdb1-14f0-4b5a-8d83-25057f1f4333 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:17.734664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bbdb1-14f0-4b5a-8d83-25057f1f4333 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:17.735387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bbdb1-14f0-4b5a-8d83-25057f1f4333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:17.737377 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bbdb1-14f0-4b5a-8d83-25057f1f4333 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:17.769685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1162/2308] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:52:17 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:52:17.773649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87499d8a-34d6-4bc9-a805-fe805ffe2a9f admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:17.785962 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87499d8a-34d6-4bc9-a805-fe805ffe2a9f admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:17.841955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:17.849238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e76ee9-c1fa-416b-8692-43725528a61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:17.849947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e76ee9-c1fa-416b-8692-43725528a61e admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:17.850225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e76ee9-c1fa-416b-8692-43725528a61e admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:17.850497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e76ee9-c1fa-416b-8692-43725528a61e admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:17.851212 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e76ee9-c1fa-416b-8692-43725528a61e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:17.853171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e76ee9-c1fa-416b-8692-43725528a61e admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:17.877967 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1147/2309] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:52:17 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:52:17.879159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bbdb1-14f0-4b5a-8d83-25057f1f4333 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:17.889827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bbdb1-14f0-4b5a-8d83-25057f1f4333 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:17.894576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e29cd-1d7e-4a58-a460-36f22a6edf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:17.895241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e29cd-1d7e-4a58-a460-36f22a6edf2a admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:17.895522 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e29cd-1d7e-4a58-a460-36f22a6edf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:17.895824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e29cd-1d7e-4a58-a460-36f22a6edf2a admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:17.896592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e29cd-1d7e-4a58-a460-36f22a6edf2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:17.898191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e29cd-1d7e-4a58-a460-36f22a6edf2a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:17.909867 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1163/2310] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 15:52:17.913910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e76ee9-c1fa-416b-8692-43725528a61e admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:17.924504 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e76ee9-c1fa-416b-8692-43725528a61e admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:17.929362 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a5a26-8158-4ad4-938f-fc21baf1b510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:17.930029 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a5a26-8158-4ad4-938f-fc21baf1b510 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:17.930305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a5a26-8158-4ad4-938f-fc21baf1b510 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:17.930561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a5a26-8158-4ad4-938f-fc21baf1b510 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:17.931307 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a5a26-8158-4ad4-938f-fc21baf1b510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:17.932943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a5a26-8158-4ad4-938f-fc21baf1b510 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:17.944056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1148/2311] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:52:17.948175 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e29cd-1d7e-4a58-a460-36f22a6edf2a admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:17.968871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e29cd-1d7e-4a58-a460-36f22a6edf2a admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:17.994672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e7fa3-f906-4409-8e0b-dfec9113a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:17.995617 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e7fa3-f906-4409-8e0b-dfec9113a7cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:17.995893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e7fa3-f906-4409-8e0b-dfec9113a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:17.996164 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e7fa3-f906-4409-8e0b-dfec9113a7cb admin admin] PATH_INFO: `/v3/projects/e28a535e7b6044daa85fa92c799f6069/users/726afc5bae8a405bb182f9ed67122d3c/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:18.012436 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e7fa3-f906-4409-8e0b-dfec9113a7cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28a535e7b6044daa85fa92c799f6069, user_id=726afc5bae8a405bb182f9ed67122d3c, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:18.015390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e7fa3-f906-4409-8e0b-dfec9113a7cb admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:18.030844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1164/2312] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:52:17 2022] PUT /identity/v3/projects/e28a535e7b6044daa85fa92c799f6069/users/726afc5bae8a405bb182f9ed67122d3c/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:52:18.036347 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94134f7-4c41-4f4f-9495-f559caff4a67 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:18.036642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94134f7-4c41-4f4f-9495-f559caff4a67 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:18.037988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94134f7-4c41-4f4f-9495-f559caff4a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:18.060936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-b94134f7-4c41-4f4f-9495-f559caff4a67 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:18.062172 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b94134f7-4c41-4f4f-9495-f559caff4a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:18.133759 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1149/2313] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:18.143526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e7fa3-f906-4409-8e0b-dfec9113a7cb admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:18.145343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9d8e7fa3-f906-4409-8e0b-dfec9113a7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:18.230930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e7fa3-f906-4409-8e0b-dfec9113a7cb admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:18.234939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facde53-93ce-44d5-a76f-581e97a358cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:18.235663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facde53-93ce-44d5-a76f-581e97a358cc service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:18.236021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facde53-93ce-44d5-a76f-581e97a358cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:18.236430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facde53-93ce-44d5-a76f-581e97a358cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:18.246181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facde53-93ce-44d5-a76f-581e97a358cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:18.247867 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facde53-93ce-44d5-a76f-581e97a358cc service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:18.257908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1165/2314] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:52:24.174108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aed59-d57e-4da8-a8f3-e13b1b0565f4 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:24.176778 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aed59-d57e-4da8-a8f3-e13b1b0565f4 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:24.178962 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aed59-d57e-4da8-a8f3-e13b1b0565f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:24.208567 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-7e8aed59-d57e-4da8-a8f3-e13b1b0565f4 None None] MFA Rules not processed for user `9d44f1f434534cc0b373943d48d672df`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:24.210322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7e8aed59-d57e-4da8-a8f3-e13b1b0565f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:24.258755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6ec2-68e0-4990-8e46-aa9d3d03f33f None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:24.259622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6ec2-68e0-4990-8e46-aa9d3d03f33f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:24.260098 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6ec2-68e0-4990-8e46-aa9d3d03f33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:24.310756 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-870d6ec2-68e0-4990-8e46-aa9d3d03f33f None None] MFA Rules not processed for user `726afc5bae8a405bb182f9ed67122d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:24.312466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-870d6ec2-68e0-4990-8e46-aa9d3d03f33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:24.340500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1150/2315] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:24.398711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1166/2316] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:24.405233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aed59-d57e-4da8-a8f3-e13b1b0565f4 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:24.420331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aed59-d57e-4da8-a8f3-e13b1b0565f4 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:24.426159 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2ffef-c13c-4eb9-8744-31cd7777cd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:24.426834 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2ffef-c13c-4eb9-8744-31cd7777cd0b admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:24.427179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2ffef-c13c-4eb9-8744-31cd7777cd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:24.427447 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2ffef-c13c-4eb9-8744-31cd7777cd0b admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:24.428150 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2ffef-c13c-4eb9-8744-31cd7777cd0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:24.430260 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2ffef-c13c-4eb9-8744-31cd7777cd0b admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:24.459966 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1151/2317] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:52:24 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:52:24.464313 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d6ec2-68e0-4990-8e46-aa9d3d03f33f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:24.476713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d6ec2-68e0-4990-8e46-aa9d3d03f33f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:24.527677 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:24.548253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19896470-859c-4542-b8aa-fe53efa39967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:24.548966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896470-859c-4542-b8aa-fe53efa39967 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:24.549251 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896470-859c-4542-b8aa-fe53efa39967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:24.549528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896470-859c-4542-b8aa-fe53efa39967 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:24.550226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19896470-859c-4542-b8aa-fe53efa39967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:24.552530 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19896470-859c-4542-b8aa-fe53efa39967 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:24.576424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1167/2318] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:52:24 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:52:24.582618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2ffef-c13c-4eb9-8744-31cd7777cd0b admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:24.600517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2ffef-c13c-4eb9-8744-31cd7777cd0b admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:24.607087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c10404-b649-4bef-913f-9226f86a68f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:24.607732 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c10404-b649-4bef-913f-9226f86a68f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:24.608017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c10404-b649-4bef-913f-9226f86a68f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:24.608382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c10404-b649-4bef-913f-9226f86a68f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:24.609066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c10404-b649-4bef-913f-9226f86a68f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:24.610724 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c10404-b649-4bef-913f-9226f86a68f4 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:24.623599 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1152/2319] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:52:24.627628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19896470-859c-4542-b8aa-fe53efa39967 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:24.639056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19896470-859c-4542-b8aa-fe53efa39967 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:24.644451 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b22361-a978-4bbf-8530-d0165b272acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:24.645356 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b22361-a978-4bbf-8530-d0165b272acd admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:24.645640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b22361-a978-4bbf-8530-d0165b272acd admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:24.648583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b22361-a978-4bbf-8530-d0165b272acd admin admin] PATH_INFO: `/v3/projects/a3d8d4c718c94e68b9de916deef64f07/users/af100a69ffeb4839a836f4e3eca841c6/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:24.665300 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b22361-a978-4bbf-8530-d0165b272acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d8d4c718c94e68b9de916deef64f07, user_id=af100a69ffeb4839a836f4e3eca841c6, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:24.668002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b22361-a978-4bbf-8530-d0165b272acd admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:24.683836 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1168/2320] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:52:24 2022] PUT /identity/v3/projects/a3d8d4c718c94e68b9de916deef64f07/users/af100a69ffeb4839a836f4e3eca841c6/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:52:24.688038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c10404-b649-4bef-913f-9226f86a68f4 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:24.701075 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c10404-b649-4bef-913f-9226f86a68f4 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:24.758670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:24.775344 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680bf37-37d2-46ab-93e1-7e03879c12b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:24.777322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680bf37-37d2-46ab-93e1-7e03879c12b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:24.777442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680bf37-37d2-46ab-93e1-7e03879c12b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:24.777657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680bf37-37d2-46ab-93e1-7e03879c12b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:24.778464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680bf37-37d2-46ab-93e1-7e03879c12b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:24.780414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680bf37-37d2-46ab-93e1-7e03879c12b5 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:24.795787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1153/2321] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:52:24.797350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b22361-a978-4bbf-8530-d0165b272acd admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:24.813195 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b22361-a978-4bbf-8530-d0165b272acd admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:24.819413 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c70d6-0f33-4b76-b068-47aade88eebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:24.820437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c70d6-0f33-4b76-b068-47aade88eebf admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:24.820783 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c70d6-0f33-4b76-b068-47aade88eebf admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:24.821122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c70d6-0f33-4b76-b068-47aade88eebf admin admin] PATH_INFO: `/v3/projects/a3d8d4c718c94e68b9de916deef64f07/users/af100a69ffeb4839a836f4e3eca841c6/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:24.826419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c70d6-0f33-4b76-b068-47aade88eebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d8d4c718c94e68b9de916deef64f07, user_id=af100a69ffeb4839a836f4e3eca841c6, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:24.829565 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c70d6-0f33-4b76-b068-47aade88eebf admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:24.845398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1169/2322] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:52:24 2022] PUT /identity/v3/projects/a3d8d4c718c94e68b9de916deef64f07/users/af100a69ffeb4839a836f4e3eca841c6/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:52:31.817633 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739b0ce-ab4f-4db1-b75a-5fb9442f23cc None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:31.818154 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739b0ce-ab4f-4db1-b75a-5fb9442f23cc None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:31.818566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739b0ce-ab4f-4db1-b75a-5fb9442f23cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:31.852749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-1739b0ce-ab4f-4db1-b75a-5fb9442f23cc None None] MFA Rules not processed for user `af100a69ffeb4839a836f4e3eca841c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:31.854367 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1739b0ce-ab4f-4db1-b75a-5fb9442f23cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:31.944520 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1154/2323] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:31.952270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c70d6-0f33-4b76-b068-47aade88eebf admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:31.954043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-619c70d6-0f33-4b76-b068-47aade88eebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:32.030674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c70d6-0f33-4b76-b068-47aade88eebf admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:32.038352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2413e8-96f0-4113-9acd-100b6c28a286 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be29cfa76174b44b99ddaf3d293ead1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:32.039252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2413e8-96f0-4113-9acd-100b6c28a286 service glance] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:32.039610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2413e8-96f0-4113-9acd-100b6c28a286 service glance] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:32.039952 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2413e8-96f0-4113-9acd-100b6c28a286 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:32.107512 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2413e8-96f0-4113-9acd-100b6c28a286 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:32.109019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2413e8-96f0-4113-9acd-100b6c28a286 service glance] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:32.119461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1170/2324] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:52:32.270076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f1005-d65f-469c-ba25-b49f7f4676ea None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:32.270361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f1005-d65f-469c-ba25-b49f7f4676ea None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:32.270631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f1005-d65f-469c-ba25-b49f7f4676ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:32.289591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-904f1005-d65f-469c-ba25-b49f7f4676ea None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:32.290803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-904f1005-d65f-469c-ba25-b49f7f4676ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:32.351611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1155/2325] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Jul 11 15:52:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:32.394750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2413e8-96f0-4113-9acd-100b6c28a286 service glance] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:32.396228 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1c2413e8-96f0-4113-9acd-100b6c28a286 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:32.446633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:32.469770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2413e8-96f0-4113-9acd-100b6c28a286 service glance] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:32.474751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9efcf-8ba7-4792-8e9f-d9087a7a7cf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:32.475422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9efcf-8ba7-4792-8e9f-d9087a7a7cf1 service swift] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:32.475741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9efcf-8ba7-4792-8e9f-d9087a7a7cf1 service swift] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:32.476018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9efcf-8ba7-4792-8e9f-d9087a7a7cf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:32.485810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9efcf-8ba7-4792-8e9f-d9087a7a7cf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:32.487463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9efcf-8ba7-4792-8e9f-d9087a7a7cf1 service swift] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:32.496621 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1171/2326] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 15:52:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:52:36.327596 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f1005-d65f-469c-ba25-b49f7f4676ea None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:36.329361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-904f1005-d65f-469c-ba25-b49f7f4676ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:36.412214 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f1005-d65f-469c-ba25-b49f7f4676ea None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:36.415978 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bd995-7100-44b1-85cf-6bfb98541d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:36.416690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bd995-7100-44b1-85cf-6bfb98541d9c service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:36.417378 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bd995-7100-44b1-85cf-6bfb98541d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:36.417664 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bd995-7100-44b1-85cf-6bfb98541d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:36.419706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-965bd995-7100-44b1-85cf-6bfb98541d9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:36.457536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:36.517621 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bd995-7100-44b1-85cf-6bfb98541d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:36.519303 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bd995-7100-44b1-85cf-6bfb98541d9c service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:36.531196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1156/2327] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:52:36.848192 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c8abb-8d3c-4b9a-b8ed-3271a05a32de None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:36.848907 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c8abb-8d3c-4b9a-b8ed-3271a05a32de None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:36.848907 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c8abb-8d3c-4b9a-b8ed-3271a05a32de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:36.909087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-2a4c8abb-8d3c-4b9a-b8ed-3271a05a32de None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:36.910423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2a4c8abb-8d3c-4b9a-b8ed-3271a05a32de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:36.930101 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1172/2328] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Jul 11 15:52:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:36.964073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bd995-7100-44b1-85cf-6bfb98541d9c service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:36.980735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bd995-7100-44b1-85cf-6bfb98541d9c service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:36.997211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2fa77-af31-4965-a05d-03a2d23701c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:37.000195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2fa77-af31-4965-a05d-03a2d23701c1 service swift] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:37.000663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2fa77-af31-4965-a05d-03a2d23701c1 service swift] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:37.000944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2fa77-af31-4965-a05d-03a2d23701c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:37.025109 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2fa77-af31-4965-a05d-03a2d23701c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:37.029953 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2fa77-af31-4965-a05d-03a2d23701c1 service swift] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:37.064065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1157/2329] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 15:52:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:52:38.177254 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2886d3f-9ddf-4c68-a70c-8dda2e69d234 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:38.178175 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2886d3f-9ddf-4c68-a70c-8dda2e69d234 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:38.178693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2886d3f-9ddf-4c68-a70c-8dda2e69d234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:38.212046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-a2886d3f-9ddf-4c68-a70c-8dda2e69d234 None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:38.213775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a2886d3f-9ddf-4c68-a70c-8dda2e69d234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:38.224791 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1173/2330] 10.222.0.26 () {58 vars in 967 bytes} [Mon Jul 11 15:52:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:38.253460 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2fa77-af31-4965-a05d-03a2d23701c1 service swift] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:38.274261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2fa77-af31-4965-a05d-03a2d23701c1 service swift] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:38.291992 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e688a7-71c9-47cc-bb98-386550461170 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:38.292703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e688a7-71c9-47cc-bb98-386550461170 service swift] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:38.292991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e688a7-71c9-47cc-bb98-386550461170 service swift] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:38.293269 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e688a7-71c9-47cc-bb98-386550461170 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:38.313320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e688a7-71c9-47cc-bb98-386550461170 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:38.316576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e688a7-71c9-47cc-bb98-386550461170 service swift] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:38.334087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1158/2331] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 15:52:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:52:38.788305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dc7ae-0f71-427c-be6f-44c5ceb2edbe None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:38.788604 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dc7ae-0f71-427c-be6f-44c5ceb2edbe None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:38.788884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dc7ae-0f71-427c-be6f-44c5ceb2edbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:38.843607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-6a4dc7ae-0f71-427c-be6f-44c5ceb2edbe None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:38.844904 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6a4dc7ae-0f71-427c-be6f-44c5ceb2edbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:38.873669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1174/2332] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Jul 11 15:52:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:38.886212 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e688a7-71c9-47cc-bb98-386550461170 service swift] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:38.901579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e688a7-71c9-47cc-bb98-386550461170 service swift] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:38.909718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0610a3a-cdf2-46fd-8fe0-c2db3a52453f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:38.910401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0610a3a-cdf2-46fd-8fe0-c2db3a52453f service swift] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:38.910684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0610a3a-cdf2-46fd-8fe0-c2db3a52453f service swift] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:38.910964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0610a3a-cdf2-46fd-8fe0-c2db3a52453f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:38.924014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0610a3a-cdf2-46fd-8fe0-c2db3a52453f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:38.925694 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0610a3a-cdf2-46fd-8fe0-c2db3a52453f service swift] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:38.939774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1159/2333] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 15:52:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:52:39.484413 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf914fe-77ca-4a0b-a3cc-77c5a725473d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:39.485972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf914fe-77ca-4a0b-a3cc-77c5a725473d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:39.485972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf914fe-77ca-4a0b-a3cc-77c5a725473d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:39.505365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-7cf914fe-77ca-4a0b-a3cc-77c5a725473d None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:39.506968 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7cf914fe-77ca-4a0b-a3cc-77c5a725473d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:39.521343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1175/2334] 10.222.0.26 () {58 vars in 967 bytes} [Mon Jul 11 15:52:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:39.538913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0610a3a-cdf2-46fd-8fe0-c2db3a52453f service swift] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:39.552342 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0610a3a-cdf2-46fd-8fe0-c2db3a52453f service swift] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:39.567289 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57e692-7451-42bc-bd29-830463606d94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:39.570019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57e692-7451-42bc-bd29-830463606d94 service swift] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:39.570653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57e692-7451-42bc-bd29-830463606d94 service swift] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:39.571132 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57e692-7451-42bc-bd29-830463606d94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:39.581307 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57e692-7451-42bc-bd29-830463606d94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:39.583311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57e692-7451-42bc-bd29-830463606d94 service swift] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:39.597987 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1160/2335] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 15:52:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:52:42.703236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf914fe-77ca-4a0b-a3cc-77c5a725473d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:42.704717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7cf914fe-77ca-4a0b-a3cc-77c5a725473d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:42.797788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf914fe-77ca-4a0b-a3cc-77c5a725473d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:42.803188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120eba1-9366-4a2c-9682-860bce93c208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:42.804629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120eba1-9366-4a2c-9682-860bce93c208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:42.805038 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120eba1-9366-4a2c-9682-860bce93c208 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:42.805416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120eba1-9366-4a2c-9682-860bce93c208 admin admin] PATH_INFO: `/v3/users/f21e115769624d058954f373ecee906d` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:42.806766 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120eba1-9366-4a2c-9682-860bce93c208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21e115769624d058954f373ecee906d)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:42.808884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120eba1-9366-4a2c-9682-860bce93c208 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:42.878965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0120eba1-9366-4a2c-9682-860bce93c208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21e115769624d058954f373ecee906d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:42.887705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0120eba1-9366-4a2c-9682-860bce93c208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21e115769624d058954f373ecee906d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:42.888669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0120eba1-9366-4a2c-9682-860bce93c208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21e115769624d058954f373ecee906d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:42.889447 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0120eba1-9366-4a2c-9682-860bce93c208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21e115769624d058954f373ecee906d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:42.902624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-0120eba1-9366-4a2c-9682-860bce93c208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21e115769624d058954f373ecee906d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:42.936334 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1176/2336] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 15:52:42 2022] DELETE /identity/v3/users/f21e115769624d058954f373ecee906d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 15:52:42.938449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b15b-75f4-43a6-b65e-78e4a670308f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:42.938964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b15b-75f4-43a6-b65e-78e4a670308f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:42.939052 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b15b-75f4-43a6-b65e-78e4a670308f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:42.958215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-5d07b15b-75f4-43a6-b65e-78e4a670308f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:42.960902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5d07b15b-75f4-43a6-b65e-78e4a670308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:43.036181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1161/2337] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:52:43.049631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120eba1-9366-4a2c-9682-860bce93c208 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:43.051148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-0120eba1-9366-4a2c-9682-860bce93c208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:43.093875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:43.137658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120eba1-9366-4a2c-9682-860bce93c208 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:43.146538 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a32537-0e83-4da9-b9fd-8a4f4e2411ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:43.147229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a32537-0e83-4da9-b9fd-8a4f4e2411ed service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:43.147508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a32537-0e83-4da9-b9fd-8a4f4e2411ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:43.147894 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a32537-0e83-4da9-b9fd-8a4f4e2411ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:43.173524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a32537-0e83-4da9-b9fd-8a4f4e2411ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:43.174928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a32537-0e83-4da9-b9fd-8a4f4e2411ed service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:43.195652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1177/2338] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:52:43.508466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07b15b-75f4-43a6-b65e-78e4a670308f None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:43.510353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5d07b15b-75f4-43a6-b65e-78e4a670308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:43.555466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07b15b-75f4-43a6-b65e-78e4a670308f None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:43.562626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:43.566407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:43.566407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:43.566407 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea admin admin] PATH_INFO: `/v3/projects/e1d330b93b494e66a42c8179fe479b11` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:43.567911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1d330b93b494e66a42c8179fe479b11)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:43.570256 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:43.646182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1d330b93b494e66a42c8179fe479b11', 'request_id': 'req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:43.662772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1d330b93b494e66a42c8179fe479b11', 'request_id': 'req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:43.669868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1d330b93b494e66a42c8179fe479b11', 'request_id': 'req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:43.674879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:43.693657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea admin admin] The token cache is being invalidate because project e1d330b93b494e66a42c8179fe479b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 15:52:43.694029 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:43.695205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0dbd7a04-9fa6-4e84-b99d-cd9f58d119ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 15:52:43.697062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1162/2339] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 15:52:43 2022] DELETE /identity/v3/projects/e1d330b93b494e66a42c8179fe479b11 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:52:43.702125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab4bad-2787-4ba5-ad82-0898df7a5bc9 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:43.702415 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab4bad-2787-4ba5-ad82-0898df7a5bc9 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:43.702692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab4bad-2787-4ba5-ad82-0898df7a5bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:43.725371 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-ecab4bad-2787-4ba5-ad82-0898df7a5bc9 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:43.726742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ecab4bad-2787-4ba5-ad82-0898df7a5bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:43.799029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1178/2340] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:43.806775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505643e8-b22f-45f5-9586-f4eba161d343 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:43.807066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505643e8-b22f-45f5-9586-f4eba161d343 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:43.807338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505643e8-b22f-45f5-9586-f4eba161d343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:43.828834 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-505643e8-b22f-45f5-9586-f4eba161d343 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:43.830259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-505643e8-b22f-45f5-9586-f4eba161d343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:43.844377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1163/2341] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:43.845119 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab4bad-2787-4ba5-ad82-0898df7a5bc9 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:43.856159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab4bad-2787-4ba5-ad82-0898df7a5bc9 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:43.863029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82636d29-3551-485d-984d-c11e86ec948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:43.863029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82636d29-3551-485d-984d-c11e86ec948b admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:43.863029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82636d29-3551-485d-984d-c11e86ec948b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:43.863029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82636d29-3551-485d-984d-c11e86ec948b admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:43.863459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82636d29-3551-485d-984d-c11e86ec948b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 15:52:43.863459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82636d29-3551-485d-984d-c11e86ec948b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:43.865237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82636d29-3551-485d-984d-c11e86ec948b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:43.882515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1179/2342] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 15:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 15:52:43.883684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505643e8-b22f-45f5-9586-f4eba161d343 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:43.894967 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505643e8-b22f-45f5-9586-f4eba161d343 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:43.900078 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90501c51-d3dd-464f-96b6-9cbbb653904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:43.900927 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90501c51-d3dd-464f-96b6-9cbbb653904a admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:43.901356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90501c51-d3dd-464f-96b6-9cbbb653904a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:43.901638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90501c51-d3dd-464f-96b6-9cbbb653904a admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:43.902333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90501c51-d3dd-464f-96b6-9cbbb653904a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:43.904552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90501c51-d3dd-464f-96b6-9cbbb653904a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:43.943137 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1164/2343] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 15:52:43 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:52:43.944401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82636d29-3551-485d-984d-c11e86ec948b admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:43.955872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82636d29-3551-485d-984d-c11e86ec948b admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:44.039252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e62cdf-7607-473c-9583-a72b8f4d815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:44.042452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62cdf-7607-473c-9583-a72b8f4d815b admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:44.042866 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62cdf-7607-473c-9583-a72b8f4d815b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:44.043227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62cdf-7607-473c-9583-a72b8f4d815b admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:44.044210 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e62cdf-7607-473c-9583-a72b8f4d815b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:44.046682 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e62cdf-7607-473c-9583-a72b8f4d815b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:44.080022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1180/2344] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 15:52:43 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 15:52:44.090963 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90501c51-d3dd-464f-96b6-9cbbb653904a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:44.111875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90501c51-d3dd-464f-96b6-9cbbb653904a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:44.202143 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d16ac3-ba18-4814-a320-05fdb0eb6211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:44.205780 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d16ac3-ba18-4814-a320-05fdb0eb6211 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:44.206063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d16ac3-ba18-4814-a320-05fdb0eb6211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:44.206337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d16ac3-ba18-4814-a320-05fdb0eb6211 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:44.207115 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d16ac3-ba18-4814-a320-05fdb0eb6211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:44.209788 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d16ac3-ba18-4814-a320-05fdb0eb6211 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:44.222246 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1165/2345] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:52:44.226083 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e62cdf-7607-473c-9583-a72b8f4d815b admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:44.237698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e62cdf-7607-473c-9583-a72b8f4d815b admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:44.242849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3e5a0-58c1-4709-ab6a-d7be770a77a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:44.243653 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3e5a0-58c1-4709-ab6a-d7be770a77a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:44.244051 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3e5a0-58c1-4709-ab6a-d7be770a77a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:44.244573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3e5a0-58c1-4709-ab6a-d7be770a77a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:44.245392 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3e5a0-58c1-4709-ab6a-d7be770a77a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:44.247140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3e5a0-58c1-4709-ab6a-d7be770a77a0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:44.266676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1181/2346] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 15:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 15:52:44.267901 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d16ac3-ba18-4814-a320-05fdb0eb6211 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:44.280071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d16ac3-ba18-4814-a320-05fdb0eb6211 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:44.289046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe375b-536a-4be9-a5be-b56fd9e172d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:44.291751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe375b-536a-4be9-a5be-b56fd9e172d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:44.291751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe375b-536a-4be9-a5be-b56fd9e172d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:44.291751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe375b-536a-4be9-a5be-b56fd9e172d3 admin admin] PATH_INFO: `/v3/projects/6b09e1a0de62456d90789370bba74b53/users/99827ab52d9242f385177cada4335b38/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:44.307313 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe375b-536a-4be9-a5be-b56fd9e172d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b09e1a0de62456d90789370bba74b53, user_id=99827ab52d9242f385177cada4335b38, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:44.310254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe375b-536a-4be9-a5be-b56fd9e172d3 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:44.363827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1166/2347] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 15:52:44 2022] PUT /identity/v3/projects/6b09e1a0de62456d90789370bba74b53/users/99827ab52d9242f385177cada4335b38/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 15:52:44.368836 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c517-6a1f-467c-a445-59cf4ee695ce None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:44.369193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c517-6a1f-467c-a445-59cf4ee695ce None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:44.369613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c517-6a1f-467c-a445-59cf4ee695ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:44.390970 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-4a75c517-6a1f-467c-a445-59cf4ee695ce None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:44.392193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4a75c517-6a1f-467c-a445-59cf4ee695ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:44.449887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:44.499948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1182/2348] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:44.509299 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe375b-536a-4be9-a5be-b56fd9e172d3 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:44.511225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-94fe375b-536a-4be9-a5be-b56fd9e172d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:44.627990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe375b-536a-4be9-a5be-b56fd9e172d3 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:44.631490 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f39775-ca7c-4a12-9fd9-4b8f79d4d8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:44.632347 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f39775-ca7c-4a12-9fd9-4b8f79d4d8ae service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:44.632634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f39775-ca7c-4a12-9fd9-4b8f79d4d8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:44.632959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f39775-ca7c-4a12-9fd9-4b8f79d4d8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:44.643492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f39775-ca7c-4a12-9fd9-4b8f79d4d8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:44.645069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f39775-ca7c-4a12-9fd9-4b8f79d4d8ae service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:44.660449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1167/2349] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:52:45.159262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5411600-7b94-43af-b46c-b691569923ab None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:45.159910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5411600-7b94-43af-b46c-b691569923ab None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:45.159910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5411600-7b94-43af-b46c-b691569923ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:45.183195 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-a5411600-7b94-43af-b46c-b691569923ab None None] MFA Rules not processed for user `726afc5bae8a405bb182f9ed67122d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:45.184582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a5411600-7b94-43af-b46c-b691569923ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:45.258347 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1183/2350] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:52:45.429513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81235dc-28f7-4371-a58b-d478523692c8 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:45.430405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81235dc-28f7-4371-a58b-d478523692c8 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:45.430845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81235dc-28f7-4371-a58b-d478523692c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:45.465431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-a81235dc-28f7-4371-a58b-d478523692c8 None None] MFA Rules not processed for user `99827ab52d9242f385177cada4335b38`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:45.467484 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a81235dc-28f7-4371-a58b-d478523692c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:45.576919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1168/2351] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:45.597581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5411600-7b94-43af-b46c-b691569923ab None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:45.599043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a5411600-7b94-43af-b46c-b691569923ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:45.603551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81235dc-28f7-4371-a58b-d478523692c8 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:45.605176 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a81235dc-28f7-4371-a58b-d478523692c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:45.642087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:45.685126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81235dc-28f7-4371-a58b-d478523692c8 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:45.689078 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba6298-d807-45eb-bbea-4c89777cb71d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:45.689766 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba6298-d807-45eb-bbea-4c89777cb71d service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:45.690051 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba6298-d807-45eb-bbea-4c89777cb71d service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:45.690328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba6298-d807-45eb-bbea-4c89777cb71d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:45.700363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba6298-d807-45eb-bbea-4c89777cb71d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:45.701881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba6298-d807-45eb-bbea-4c89777cb71d service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:45.703146 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5411600-7b94-43af-b46c-b691569923ab None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:45.709486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834ba89-7140-4930-b21e-20ffcf270130 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:45.710149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834ba89-7140-4930-b21e-20ffcf270130 service placement] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:45.710585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834ba89-7140-4930-b21e-20ffcf270130 service placement] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:45.710845 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834ba89-7140-4930-b21e-20ffcf270130 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:45.713795 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f834ba89-7140-4930-b21e-20ffcf270130 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:45.722444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1169/2352] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 15:52:45.726793 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834ba89-7140-4930-b21e-20ffcf270130 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:45.728463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834ba89-7140-4930-b21e-20ffcf270130 service placement] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:45.750722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1184/2353] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:52:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:52:47.217881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdbc72-2b4c-4641-9d64-91de3b0d5a22 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:47.218489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdbc72-2b4c-4641-9d64-91de3b0d5a22 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:47.218489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdbc72-2b4c-4641-9d64-91de3b0d5a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:47.239030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-aabdbc72-2b4c-4641-9d64-91de3b0d5a22 None None] MFA Rules not processed for user `99827ab52d9242f385177cada4335b38`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:47.240788 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-aabdbc72-2b4c-4641-9d64-91de3b0d5a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:47.251608 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1170/2354] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:52:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:47.503910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34640192-1cb7-4079-995c-c2d4ae04d2ed None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:47.505031 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34640192-1cb7-4079-995c-c2d4ae04d2ed None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:47.505326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34640192-1cb7-4079-995c-c2d4ae04d2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:47.523944 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-34640192-1cb7-4079-995c-c2d4ae04d2ed None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:52:47.525204 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-34640192-1cb7-4079-995c-c2d4ae04d2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:47.587957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1185/2355] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Jul 11 15:52:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:52:47.603129 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdbc72-2b4c-4641-9d64-91de3b0d5a22 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:52:47.604998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-aabdbc72-2b4c-4641-9d64-91de3b0d5a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:52:47.681979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdbc72-2b4c-4641-9d64-91de3b0d5a22 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:52:47.687573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a26b07-63e0-4287-bbda-ea437797e99b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:52:47.688851 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a26b07-63e0-4287-bbda-ea437797e99b service swift] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:52:47.688851 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a26b07-63e0-4287-bbda-ea437797e99b service swift] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:52:47.689184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a26b07-63e0-4287-bbda-ea437797e99b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:52:47.699129 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a26b07-63e0-4287-bbda-ea437797e99b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:52:47.701060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a26b07-63e0-4287-bbda-ea437797e99b service swift] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:52:47.711342 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1171/2356] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 15:52:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:52:57.580948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:52:57.707576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=51 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:04.427354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cbf13-5349-4fc7-b3e9-654aa976cfcf None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:04.427874 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cbf13-5349-4fc7-b3e9-654aa976cfcf None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:04.427987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cbf13-5349-4fc7-b3e9-654aa976cfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:04.445888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-016cbf13-5349-4fc7-b3e9-654aa976cfcf None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:04.447077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-016cbf13-5349-4fc7-b3e9-654aa976cfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:04.454245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1186/2357] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Jul 11 15:53:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:04.467348 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a26b07-63e0-4287-bbda-ea437797e99b service swift] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:04.479636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a26b07-63e0-4287-bbda-ea437797e99b service swift] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:04.485249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976ad1a-a47f-4832-868a-ae2239f96952 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:04.485922 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976ad1a-a47f-4832-868a-ae2239f96952 service swift] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:04.486231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976ad1a-a47f-4832-868a-ae2239f96952 service swift] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:04.486469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976ad1a-a47f-4832-868a-ae2239f96952 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:04.497141 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976ad1a-a47f-4832-868a-ae2239f96952 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:04.499414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976ad1a-a47f-4832-868a-ae2239f96952 service swift] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:04.509945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1172/2358] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 15:53:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:53:14.440481 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:14.506202 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=6 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:19.323685 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8585ac-c50b-44fa-8bea-27a99589d689 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:19.324798 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8585ac-c50b-44fa-8bea-27a99589d689 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:19.325220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8585ac-c50b-44fa-8bea-27a99589d689 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:19.326817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1187/2359] 10.222.0.26 () {54 vars in 921 bytes} [Mon Jul 11 15:53:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:53:19.334463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a404b0-588c-464a-93e2-9aebb476e05d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:19.335380 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a404b0-588c-464a-93e2-9aebb476e05d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:19.335664 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a404b0-588c-464a-93e2-9aebb476e05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:19.356568 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-39a404b0-588c-464a-93e2-9aebb476e05d None None] MFA Rules not processed for user `fa038a2e30f544aaa609d32e0e1ceaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:19.358073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-39a404b0-588c-464a-93e2-9aebb476e05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:19.512450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1173/2360] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Jul 11 15:53:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 15:53:19.524755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8585ac-c50b-44fa-8bea-27a99589d689 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:19.526611 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7e8585ac-c50b-44fa-8bea-27a99589d689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:19.589156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8585ac-c50b-44fa-8bea-27a99589d689 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:19.592645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cabd09-240c-4aa0-9da8-255a96d60cfd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be29cfa76174b44b99ddaf3d293ead1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:19.593324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cabd09-240c-4aa0-9da8-255a96d60cfd service glance] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:19.593604 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cabd09-240c-4aa0-9da8-255a96d60cfd service glance] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:19.593876 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cabd09-240c-4aa0-9da8-255a96d60cfd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:19.605167 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cabd09-240c-4aa0-9da8-255a96d60cfd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:19.606798 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cabd09-240c-4aa0-9da8-255a96d60cfd service glance] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:19.618959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1188/2361] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:19.698943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d249f9-a802-42ac-b4af-1650643522c8 None None] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:19.699330 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d249f9-a802-42ac-b4af-1650643522c8 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:19.699718 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d249f9-a802-42ac-b4af-1650643522c8 None None] PATH_INFO: `/` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:19.701265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1174/2362] 10.222.0.26 () {54 vars in 921 bytes} [Mon Jul 11 15:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:53:19.708173 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff6d0d-beaf-4a12-831d-1f91340d34ab None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:19.708488 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff6d0d-beaf-4a12-831d-1f91340d34ab None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:19.709095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff6d0d-beaf-4a12-831d-1f91340d34ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:19.728767 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-e9ff6d0d-beaf-4a12-831d-1f91340d34ab None None] MFA Rules not processed for user `44a4d0441d4a423884d7adef45e2641f`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:19.730016 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e9ff6d0d-beaf-4a12-831d-1f91340d34ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:19.737670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1189/2363] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Jul 11 15:53:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:19.749816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d249f9-a802-42ac-b4af-1650643522c8 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:19.751965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-f5d249f9-a802-42ac-b4af-1650643522c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:19.766706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d249f9-a802-42ac-b4af-1650643522c8 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:19.771110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f54c9-5d46-4c85-a438-2dde3b5e9fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:19.771748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f54c9-5d46-4c85-a438-2dde3b5e9fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:19.772034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f54c9-5d46-4c85-a438-2dde3b5e9fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:19.772337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f54c9-5d46-4c85-a438-2dde3b5e9fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:19.780499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f54c9-5d46-4c85-a438-2dde3b5e9fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:19.781968 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f54c9-5d46-4c85-a438-2dde3b5e9fc8 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:19.790756 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1175/2364] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:19.890450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377029-e7af-4044-857f-d3dd54c8d7d9 None None] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:19.890731 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377029-e7af-4044-857f-d3dd54c8d7d9 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:19.891025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377029-e7af-4044-857f-d3dd54c8d7d9 None None] PATH_INFO: `/` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:19.892504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1190/2365] 10.222.0.26 () {54 vars in 921 bytes} [Mon Jul 11 15:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 15:53:19.898758 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca258f-7318-41b4-84a0-6c2a5f0a5fc4 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:19.899053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca258f-7318-41b4-84a0-6c2a5f0a5fc4 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:19.899331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca258f-7318-41b4-84a0-6c2a5f0a5fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:19.918390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e9ca258f-7318-41b4-84a0-6c2a5f0a5fc4 None None] MFA Rules not processed for user `fa038a2e30f544aaa609d32e0e1ceaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:19.919593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e9ca258f-7318-41b4-84a0-6c2a5f0a5fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:19.930048 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1176/2366] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Jul 11 15:53:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:19.940990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc377029-e7af-4044-857f-d3dd54c8d7d9 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:19.952519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc377029-e7af-4044-857f-d3dd54c8d7d9 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:19.957059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4710f-1c2a-47b4-ab39-2efb89f385f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:19.957741 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4710f-1c2a-47b4-ab39-2efb89f385f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:19.958027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4710f-1c2a-47b4-ab39-2efb89f385f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:19.958331 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4710f-1c2a-47b4-ab39-2efb89f385f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:19.974213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4710f-1c2a-47b4-ab39-2efb89f385f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:19.975887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4710f-1c2a-47b4-ab39-2efb89f385f0 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:19.987931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1191/2367] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:21.957509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca258f-7318-41b4-84a0-6c2a5f0a5fc4 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:21.971251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca258f-7318-41b4-84a0-6c2a5f0a5fc4 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:21.977720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e4a12-574a-45f9-9318-a3b9956ba35f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:21.978363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4a12-574a-45f9-9318-a3b9956ba35f service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:21.978644 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4a12-574a-45f9-9318-a3b9956ba35f service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:21.978915 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4a12-574a-45f9-9318-a3b9956ba35f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:21.981477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-241e4a12-574a-45f9-9318-a3b9956ba35f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:22.049986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e4a12-574a-45f9-9318-a3b9956ba35f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:22.051801 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e4a12-574a-45f9-9318-a3b9956ba35f service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:22.062976 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1177/2368] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:53:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:53:23.734285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54290f2-69c7-47b9-842d-0ff49009c291 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:23.735652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54290f2-69c7-47b9-842d-0ff49009c291 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:23.736076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54290f2-69c7-47b9-842d-0ff49009c291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:23.758422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-d54290f2-69c7-47b9-842d-0ff49009c291 None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:23.759624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d54290f2-69c7-47b9-842d-0ff49009c291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:23.767032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1192/2369] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Jul 11 15:53:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:23.779080 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e4a12-574a-45f9-9318-a3b9956ba35f service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:23.790538 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e4a12-574a-45f9-9318-a3b9956ba35f service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:23.795517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db437fd-4b14-4e74-94a0-273db96cff0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:23.796172 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db437fd-4b14-4e74-94a0-273db96cff0d service swift] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:23.796620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db437fd-4b14-4e74-94a0-273db96cff0d service swift] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:23.796905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db437fd-4b14-4e74-94a0-273db96cff0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:23.806853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db437fd-4b14-4e74-94a0-273db96cff0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:23.808593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db437fd-4b14-4e74-94a0-273db96cff0d service swift] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:23.818754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1178/2370] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 15:53:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:53:33.753088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=38 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:33.815491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=76 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:53:51.777743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988274-e81a-4bec-a0ae-553c055f912e None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:51.778354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988274-e81a-4bec-a0ae-553c055f912e None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:51.778354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988274-e81a-4bec-a0ae-553c055f912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:51.801174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-9c988274-e81a-4bec-a0ae-553c055f912e None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:53:51.803012 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9c988274-e81a-4bec-a0ae-553c055f912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:53:51.813063 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1193/2371] 10.222.0.26 () {58 vars in 967 bytes} [Mon Jul 11 15:53:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:53:51.835127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db437fd-4b14-4e74-94a0-273db96cff0d service swift] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:53:51.846834 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db437fd-4b14-4e74-94a0-273db96cff0d service swift] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:53:51.858486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786d5c5-9728-404f-ab61-b8b11847ebc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:53:51.859170 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786d5c5-9728-404f-ab61-b8b11847ebc9 service swift] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:53:51.859444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786d5c5-9728-404f-ab61-b8b11847ebc9 service swift] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:53:51.859713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786d5c5-9728-404f-ab61-b8b11847ebc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:53:51.869321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786d5c5-9728-404f-ab61-b8b11847ebc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:53:51.870948 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786d5c5-9728-404f-ab61-b8b11847ebc9 service swift] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:53:51.880972 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1179/2372] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 15:53:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 15:54:01.792555 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:01.876564 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=6 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:12.945906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d502d-3ae7-4513-ae3a-86d56c5733cb None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:54:12.946466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d502d-3ae7-4513-ae3a-86d56c5733cb None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:54:12.946466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d502d-3ae7-4513-ae3a-86d56c5733cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:54:12.965816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-856d502d-3ae7-4513-ae3a-86d56c5733cb None None] MFA Rules not processed for user `9d44f1f434534cc0b373943d48d672df`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:54:12.967048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-856d502d-3ae7-4513-ae3a-86d56c5733cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:54:13.026503 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1194/2373] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:54:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:54:23.019046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=25 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:27.798468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc7954-743a-482b-b75b-7d416fbed419 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:54:27.799053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc7954-743a-482b-b75b-7d416fbed419 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:54:27.799053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc7954-743a-482b-b75b-7d416fbed419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:54:27.817989 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-05bc7954-743a-482b-b75b-7d416fbed419 None None] MFA Rules not processed for user `052b95d2857c4e728a8008d00fc34780`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:54:27.819210 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-05bc7954-743a-482b-b75b-7d416fbed419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:54:27.874768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1180/2374] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:54:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:54:28.843489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb459af-cb0e-4d23-9d0c-3163a0510daa None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:54:28.844156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb459af-cb0e-4d23-9d0c-3163a0510daa None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:54:28.844156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb459af-cb0e-4d23-9d0c-3163a0510daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:54:28.862346 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-4fb459af-cb0e-4d23-9d0c-3163a0510daa None None] MFA Rules not processed for user `99827ab52d9242f385177cada4335b38`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 15:54:28.863731 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4fb459af-cb0e-4d23-9d0c-3163a0510daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:54:28.871170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1195/2375] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 15:54:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 15:54:37.750428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc7954-743a-482b-b75b-7d416fbed419 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:54:37.760660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc7954-743a-482b-b75b-7d416fbed419 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:54:37.764602 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcaaec-a5ba-4c8f-9ee6-128b1a263f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:54:37.765241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcaaec-a5ba-4c8f-9ee6-128b1a263f6b service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:54:37.765517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcaaec-a5ba-4c8f-9ee6-128b1a263f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:54:37.765790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcaaec-a5ba-4c8f-9ee6-128b1a263f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:54:37.767733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-09dcaaec-a5ba-4c8f-9ee6-128b1a263f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:54:37.781537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcaaec-a5ba-4c8f-9ee6-128b1a263f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:54:37.782956 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcaaec-a5ba-4c8f-9ee6-128b1a263f6b service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:54:37.793879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1181/2376] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:54:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:54:38.856758 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:39.070071 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb459af-cb0e-4d23-9d0c-3163a0510daa None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:54:39.081518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb459af-cb0e-4d23-9d0c-3163a0510daa None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:54:39.086022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e4eec-8412-4443-9a73-09eb1d111b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:54:39.086707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e4eec-8412-4443-9a73-09eb1d111b91 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:54:39.086987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e4eec-8412-4443-9a73-09eb1d111b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:54:39.087932 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e4eec-8412-4443-9a73-09eb1d111b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:54:39.089886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7c1e4eec-8412-4443-9a73-09eb1d111b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:54:39.104175 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e4eec-8412-4443-9a73-09eb1d111b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:54:39.105668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e4eec-8412-4443-9a73-09eb1d111b91 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:54:39.117576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1196/2377] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:54:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:54:47.789274 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=31 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:49.112539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=6 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:54:58.652108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcaaec-a5ba-4c8f-9ee6-128b1a263f6b service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:54:58.669198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcaaec-a5ba-4c8f-9ee6-128b1a263f6b service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:54:58.673852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d14981-91d0-4440-9192-ecf742cc5c99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:54:58.674519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d14981-91d0-4440-9192-ecf742cc5c99 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:54:58.674791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d14981-91d0-4440-9192-ecf742cc5c99 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:54:58.675066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d14981-91d0-4440-9192-ecf742cc5c99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:54:58.677301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-52d14981-91d0-4440-9192-ecf742cc5c99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:54:58.689677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d14981-91d0-4440-9192-ecf742cc5c99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:54:58.691129 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d14981-91d0-4440-9192-ecf742cc5c99 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:54:58.700321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1182/2378] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:54:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:55:08.696108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=6 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:18.863424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e4eec-8412-4443-9a73-09eb1d111b91 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:55:18.865289 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7c1e4eec-8412-4443-9a73-09eb1d111b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:18.879573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e4eec-8412-4443-9a73-09eb1d111b91 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:55:18.886678 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caadb74-5905-43e9-9b88-75772c7ea279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:55:18.887328 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caadb74-5905-43e9-9b88-75772c7ea279 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:18.887608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caadb74-5905-43e9-9b88-75772c7ea279 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:18.887880 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caadb74-5905-43e9-9b88-75772c7ea279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:18.889876 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8caadb74-5905-43e9-9b88-75772c7ea279 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:18.901773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caadb74-5905-43e9-9b88-75772c7ea279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:55:18.903385 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caadb74-5905-43e9-9b88-75772c7ea279 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:55:18.913052 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1197/2379] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:55:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:55:28.908802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=6 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:45.625257 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d14981-91d0-4440-9192-ecf742cc5c99 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:55:45.635502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d14981-91d0-4440-9192-ecf742cc5c99 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:55:45.639332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6577b4-be9d-4137-bc6c-d37c9ebef658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:55:45.640003 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6577b4-be9d-4137-bc6c-d37c9ebef658 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:45.640313 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6577b4-be9d-4137-bc6c-d37c9ebef658 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:45.640570 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6577b4-be9d-4137-bc6c-d37c9ebef658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:45.642850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ff6577b4-be9d-4137-bc6c-d37c9ebef658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:45.654909 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6577b4-be9d-4137-bc6c-d37c9ebef658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:55:45.656414 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6577b4-be9d-4137-bc6c-d37c9ebef658 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:55:45.665740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1183/2380] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:55:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:55:47.066504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caadb74-5905-43e9-9b88-75772c7ea279 service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:55:47.068220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8caadb74-5905-43e9-9b88-75772c7ea279 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:47.092128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caadb74-5905-43e9-9b88-75772c7ea279 service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:55:47.100603 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200ad59-7fa9-4b3f-acb4-1094549eb4b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:55:47.101278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200ad59-7fa9-4b3f-acb4-1094549eb4b2 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:55:47.101560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200ad59-7fa9-4b3f-acb4-1094549eb4b2 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:55:47.101849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200ad59-7fa9-4b3f-acb4-1094549eb4b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:55:47.104112 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f200ad59-7fa9-4b3f-acb4-1094549eb4b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:55:47.117794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200ad59-7fa9-4b3f-acb4-1094549eb4b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:55:47.119431 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200ad59-7fa9-4b3f-acb4-1094549eb4b2 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:55:47.131245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1198/2381] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:55:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:55:55.661979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=6 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:55:57.126532 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=6 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:16.072484 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6577b4-be9d-4137-bc6c-d37c9ebef658 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:56:16.086725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6577b4-be9d-4137-bc6c-d37c9ebef658 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:56:16.092390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeb9a0-23e0-4744-9bee-e0fa1d946d7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:56:16.093041 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeb9a0-23e0-4744-9bee-e0fa1d946d7e service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:56:16.093322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeb9a0-23e0-4744-9bee-e0fa1d946d7e service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:56:16.093587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeb9a0-23e0-4744-9bee-e0fa1d946d7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:56:16.095532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3bbeb9a0-23e0-4744-9bee-e0fa1d946d7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:56:16.156526 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeb9a0-23e0-4744-9bee-e0fa1d946d7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:56:16.158160 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeb9a0-23e0-4744-9bee-e0fa1d946d7e service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:56:16.173328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1184/2382] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:56:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:56:26.165562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=28 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:56:45.914924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200ad59-7fa9-4b3f-acb4-1094549eb4b2 service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:56:45.927560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200ad59-7fa9-4b3f-acb4-1094549eb4b2 service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:56:45.935038 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4e045-4f3a-48ec-819f-c965bc4b41f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:56:45.935711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4e045-4f3a-48ec-819f-c965bc4b41f6 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:56:45.935995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4e045-4f3a-48ec-819f-c965bc4b41f6 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:56:45.936267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4e045-4f3a-48ec-819f-c965bc4b41f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:56:45.938486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d1f4e045-4f3a-48ec-819f-c965bc4b41f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:56:46.001631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4e045-4f3a-48ec-819f-c965bc4b41f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:56:46.003243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4e045-4f3a-48ec-819f-c965bc4b41f6 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:56:46.012965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1199/2383] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:56:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:56:56.008570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=28 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:32.234630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeb9a0-23e0-4744-9bee-e0fa1d946d7e service nova] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:32.246556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeb9a0-23e0-4744-9bee-e0fa1d946d7e service nova] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:32.253597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce08039-c694-4cc7-a7f4-a88f23fbdbee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:32.254283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce08039-c694-4cc7-a7f4-a88f23fbdbee service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:32.254548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce08039-c694-4cc7-a7f4-a88f23fbdbee service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:32.254841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce08039-c694-4cc7-a7f4-a88f23fbdbee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:32.256962 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3ce08039-c694-4cc7-a7f4-a88f23fbdbee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:32.267989 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce08039-c694-4cc7-a7f4-a88f23fbdbee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:32.269642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce08039-c694-4cc7-a7f4-a88f23fbdbee service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:32.279301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1185/2384] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:42.274772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=6 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:57:45.959398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4e045-4f3a-48ec-819f-c965bc4b41f6 service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:57:45.961043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-d1f4e045-4f3a-48ec-819f-c965bc4b41f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:57:46.005897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4e045-4f3a-48ec-819f-c965bc4b41f6 service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:57:46.010295 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280cbf9-70b0-4cd1-8612-a22d38ea66aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:57:46.011047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280cbf9-70b0-4cd1-8612-a22d38ea66aa service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:57:46.011326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280cbf9-70b0-4cd1-8612-a22d38ea66aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:57:46.011673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280cbf9-70b0-4cd1-8612-a22d38ea66aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:57:46.036020 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280cbf9-70b0-4cd1-8612-a22d38ea66aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:57:46.037557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280cbf9-70b0-4cd1-8612-a22d38ea66aa service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:57:46.049694 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1200/2385] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:57:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:57:56.044692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=25 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:58:46.323302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce08039-c694-4cc7-a7f4-a88f23fbdbee service nova] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:58:46.324763 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3ce08039-c694-4cc7-a7f4-a88f23fbdbee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 15:58:46.418457 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce08039-c694-4cc7-a7f4-a88f23fbdbee service nova] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:58:46.427754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b41e1d-ddf9-4dac-bad8-cd297c70646a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:58:46.428691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b41e1d-ddf9-4dac-bad8-cd297c70646a service placement] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:58:46.428969 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b41e1d-ddf9-4dac-bad8-cd297c70646a service placement] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:58:46.429278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b41e1d-ddf9-4dac-bad8-cd297c70646a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:58:46.439399 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b41e1d-ddf9-4dac-bad8-cd297c70646a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:58:46.441075 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b41e1d-ddf9-4dac-bad8-cd297c70646a service placement] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:58:46.451325 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1186/2386] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:58:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:58:56.447178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=33 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:37.014409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280cbf9-70b0-4cd1-8612-a22d38ea66aa service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:37.035687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280cbf9-70b0-4cd1-8612-a22d38ea66aa service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:37.039917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889036d-784e-432d-9b7d-58d827ce3eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:37.040597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889036d-784e-432d-9b7d-58d827ce3eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:37.040878 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889036d-784e-432d-9b7d-58d827ce3eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:37.041260 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889036d-784e-432d-9b7d-58d827ce3eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:37.059559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889036d-784e-432d-9b7d-58d827ce3eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:37.061043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889036d-784e-432d-9b7d-58d827ce3eb3 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:37.085161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1201/2387] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:45.958131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b41e1d-ddf9-4dac-bad8-cd297c70646a service placement] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:45.968551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b41e1d-ddf9-4dac-bad8-cd297c70646a service placement] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:45.972314 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51152f-b47f-46c6-8b50-321ef4f80076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:45.972981 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51152f-b47f-46c6-8b50-321ef4f80076 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:45.973287 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51152f-b47f-46c6-8b50-321ef4f80076 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:45.973554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51152f-b47f-46c6-8b50-321ef4f80076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:45.985138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51152f-b47f-46c6-8b50-321ef4f80076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:45.986598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51152f-b47f-46c6-8b50-321ef4f80076 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:45.999338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1187/2388] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 15:59:47.081489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=17 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:55.992924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=6 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 15:59:57.545425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889036d-784e-432d-9b7d-58d827ce3eb3 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 15:59:57.561926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889036d-784e-432d-9b7d-58d827ce3eb3 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 15:59:57.569201 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82b8ce-2d88-408f-9dee-effbc695bd81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 15:59:57.569849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82b8ce-2d88-408f-9dee-effbc695bd81 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 15:59:57.570116 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82b8ce-2d88-408f-9dee-effbc695bd81 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 15:59:57.570390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82b8ce-2d88-408f-9dee-effbc695bd81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 15:59:57.579491 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82b8ce-2d88-408f-9dee-effbc695bd81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 15:59:57.581137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82b8ce-2d88-408f-9dee-effbc695bd81 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 15:59:57.609827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1202/2389] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 15:59:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:00:07.607775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=13 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:00:50.044030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51152f-b47f-46c6-8b50-321ef4f80076 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:00:50.052626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51152f-b47f-46c6-8b50-321ef4f80076 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:00:50.057086 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd972f-2654-486c-a062-d69dcbaa06fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:00:50.057740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd972f-2654-486c-a062-d69dcbaa06fb service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:00:50.058020 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd972f-2654-486c-a062-d69dcbaa06fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:00:50.058292 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd972f-2654-486c-a062-d69dcbaa06fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:00:50.066200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd972f-2654-486c-a062-d69dcbaa06fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:00:50.067637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd972f-2654-486c-a062-d69dcbaa06fb service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:00:50.076203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1188/2390] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:00:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:01:00.072555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=6 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:46.331728 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82b8ce-2d88-408f-9dee-effbc695bd81 service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:46.352569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82b8ce-2d88-408f-9dee-effbc695bd81 service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:46.356861 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cb71e-2e9c-4565-a231-8eabee02254c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:46.357445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cb71e-2e9c-4565-a231-8eabee02254c service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:46.357749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cb71e-2e9c-4565-a231-8eabee02254c service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:46.358029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cb71e-2e9c-4565-a231-8eabee02254c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:46.367140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cb71e-2e9c-4565-a231-8eabee02254c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:46.368601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cb71e-2e9c-4565-a231-8eabee02254c service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:46.401857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1203/2391] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:01:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:01:46.472214 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd972f-2654-486c-a062-d69dcbaa06fb service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:46.482733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd972f-2654-486c-a062-d69dcbaa06fb service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:46.487076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd84f8-1c43-4ade-a7de-513e05e54d92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:46.487719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd84f8-1c43-4ade-a7de-513e05e54d92 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:46.488002 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd84f8-1c43-4ade-a7de-513e05e54d92 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:46.488275 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd84f8-1c43-4ade-a7de-513e05e54d92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:46.497271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd84f8-1c43-4ade-a7de-513e05e54d92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:46.498705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd84f8-1c43-4ade-a7de-513e05e54d92 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:46.526795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1189/2392] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:01:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:01:46.637349 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cb71e-2e9c-4565-a231-8eabee02254c service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:46.651948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cb71e-2e9c-4565-a231-8eabee02254c service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:46.659094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bb2cc-e1e1-461f-8afc-390f44c1bd91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:46.659756 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bb2cc-e1e1-461f-8afc-390f44c1bd91 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:46.660034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bb2cc-e1e1-461f-8afc-390f44c1bd91 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:46.660325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bb2cc-e1e1-461f-8afc-390f44c1bd91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:46.668775 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bb2cc-e1e1-461f-8afc-390f44c1bd91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:46.670382 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bb2cc-e1e1-461f-8afc-390f44c1bd91 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:46.699170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1204/2393] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:01:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:01:48.198367 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd84f8-1c43-4ade-a7de-513e05e54d92 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:01:48.212216 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd84f8-1c43-4ade-a7de-513e05e54d92 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:01:48.219096 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd9bb6-a8e6-4a43-9c48-fe02de6f85e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:01:48.219768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd9bb6-a8e6-4a43-9c48-fe02de6f85e9 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:01:48.220052 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd9bb6-a8e6-4a43-9c48-fe02de6f85e9 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:01:48.220353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd9bb6-a8e6-4a43-9c48-fe02de6f85e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:01:48.222221 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-70dd9bb6-a8e6-4a43-9c48-fe02de6f85e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:01:48.256491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd9bb6-a8e6-4a43-9c48-fe02de6f85e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:01:48.258677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd9bb6-a8e6-4a43-9c48-fe02de6f85e9 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:01:48.273033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1190/2394] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:01:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:01:56.696561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=30 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:01:58.268004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=24 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:02:46.718963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bb2cc-e1e1-461f-8afc-390f44c1bd91 service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:02:46.735890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bb2cc-e1e1-461f-8afc-390f44c1bd91 service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:02:46.743448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a31ca-7af2-4825-b4f4-c8b83600e8fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:02:46.744139 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a31ca-7af2-4825-b4f4-c8b83600e8fb service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:02:46.744405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a31ca-7af2-4825-b4f4-c8b83600e8fb service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:02:46.744704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a31ca-7af2-4825-b4f4-c8b83600e8fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:02:46.746989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-351a31ca-7af2-4825-b4f4-c8b83600e8fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:02:46.839548 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a31ca-7af2-4825-b4f4-c8b83600e8fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:02:46.841274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a31ca-7af2-4825-b4f4-c8b83600e8fb service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:02:46.861497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1205/2395] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:02:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:02:56.858678 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=41 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:46.806409 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd9bb6-a8e6-4a43-9c48-fe02de6f85e9 service nova] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:46.865522 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd9bb6-a8e6-4a43-9c48-fe02de6f85e9 service nova] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:46.870530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a50ed-3ae6-44c2-8b77-292bf6015e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:46.871182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a50ed-3ae6-44c2-8b77-292bf6015e77 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:46.871465 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a50ed-3ae6-44c2-8b77-292bf6015e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:46.871735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a50ed-3ae6-44c2-8b77-292bf6015e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:46.944771 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a50ed-3ae6-44c2-8b77-292bf6015e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:46.946218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a50ed-3ae6-44c2-8b77-292bf6015e77 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:46.965902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1191/2396] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:48.385937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a31ca-7af2-4825-b4f4-c8b83600e8fb service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:03:48.466562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a31ca-7af2-4825-b4f4-c8b83600e8fb service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:03:48.472796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4f624-a25e-4651-a040-a33d8dd0784b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:03:48.473527 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4f624-a25e-4651-a040-a33d8dd0784b service placement] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:03:48.473904 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4f624-a25e-4651-a040-a33d8dd0784b service placement] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:03:48.474280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4f624-a25e-4651-a040-a33d8dd0784b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:03:48.476581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-12b4f624-a25e-4651-a040-a33d8dd0784b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:03:48.494788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4f624-a25e-4651-a040-a33d8dd0784b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:03:48.496957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4f624-a25e-4651-a040-a33d8dd0784b service placement] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:03:48.509048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1206/2397] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:03:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:03:56.962819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=56 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:03:58.504794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=32 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:04:36.581731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a50ed-3ae6-44c2-8b77-292bf6015e77 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:04:36.583935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-180a50ed-3ae6-44c2-8b77-292bf6015e77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:04:36.655641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a50ed-3ae6-44c2-8b77-292bf6015e77 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:04:36.659561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d602e-26e7-42fa-a9f3-199ff53b3bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:04:36.660207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d602e-26e7-42fa-a9f3-199ff53b3bec service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:04:36.660519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d602e-26e7-42fa-a9f3-199ff53b3bec service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:04:36.660797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d602e-26e7-42fa-a9f3-199ff53b3bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:04:36.746114 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d602e-26e7-42fa-a9f3-199ff53b3bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:04:36.747572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d602e-26e7-42fa-a9f3-199ff53b3bec service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:04:36.760443 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1192/2398] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:04:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:04:46.753963 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=59 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:05:47.454716 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4f624-a25e-4651-a040-a33d8dd0784b service placement] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:47.464971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4f624-a25e-4651-a040-a33d8dd0784b service placement] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:47.469477 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67123f22-1859-42e2-8afc-5be9d055b589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:47.470123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67123f22-1859-42e2-8afc-5be9d055b589 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:47.470401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67123f22-1859-42e2-8afc-5be9d055b589 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:47.470703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67123f22-1859-42e2-8afc-5be9d055b589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:47.472871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-67123f22-1859-42e2-8afc-5be9d055b589 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:47.488591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67123f22-1859-42e2-8afc-5be9d055b589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:47.490063 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67123f22-1859-42e2-8afc-5be9d055b589 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:47.502163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1207/2399] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:47.545937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d602e-26e7-42fa-a9f3-199ff53b3bec service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:47.559986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d602e-26e7-42fa-a9f3-199ff53b3bec service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:47.564555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd51d42-9dfb-42a2-b548-85681fbcb1fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:47.565223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd51d42-9dfb-42a2-b548-85681fbcb1fa service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:47.565508 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd51d42-9dfb-42a2-b548-85681fbcb1fa service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:47.565782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd51d42-9dfb-42a2-b548-85681fbcb1fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:47.567963 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2dd51d42-9dfb-42a2-b548-85681fbcb1fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:47.642455 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd51d42-9dfb-42a2-b548-85681fbcb1fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:47.643931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd51d42-9dfb-42a2-b548-85681fbcb1fa service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:47.654370 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1193/2400] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:52.618220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67123f22-1859-42e2-8afc-5be9d055b589 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:05:52.620515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-67123f22-1859-42e2-8afc-5be9d055b589 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:52.633920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67123f22-1859-42e2-8afc-5be9d055b589 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:05:52.638796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea7a12-cd80-454e-bca3-e634af09a492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:05:52.639442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea7a12-cd80-454e-bca3-e634af09a492 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:05:52.639726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea7a12-cd80-454e-bca3-e634af09a492 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:05:52.639995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea7a12-cd80-454e-bca3-e634af09a492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:05:52.642168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-7fea7a12-cd80-454e-bca3-e634af09a492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:05:52.652204 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea7a12-cd80-454e-bca3-e634af09a492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:05:52.653707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea7a12-cd80-454e-bca3-e634af09a492 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:05:52.662313 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1208/2401] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:05:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:05:57.650206 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=33 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:06:02.658442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=12 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:06:46.273145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd51d42-9dfb-42a2-b548-85681fbcb1fa service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:06:46.285483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd51d42-9dfb-42a2-b548-85681fbcb1fa service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:06:46.290167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0eefbc-bbea-4a87-a3e3-7d4b76acd216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:06:46.290872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eefbc-bbea-4a87-a3e3-7d4b76acd216 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:06:46.291152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eefbc-bbea-4a87-a3e3-7d4b76acd216 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:06:46.291419 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eefbc-bbea-4a87-a3e3-7d4b76acd216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:06:46.293673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ae0eefbc-bbea-4a87-a3e3-7d4b76acd216 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:06:46.373646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0eefbc-bbea-4a87-a3e3-7d4b76acd216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:06:46.375014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0eefbc-bbea-4a87-a3e3-7d4b76acd216 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:06:46.384544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1194/2402] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:06:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:06:46.474969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea7a12-cd80-454e-bca3-e634af09a492 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:06:46.484930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea7a12-cd80-454e-bca3-e634af09a492 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:06:46.489165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dbbfd-ee1c-4f44-9170-615f85cd4903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:06:46.489826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dbbfd-ee1c-4f44-9170-615f85cd4903 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:06:46.490110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dbbfd-ee1c-4f44-9170-615f85cd4903 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:06:46.490387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dbbfd-ee1c-4f44-9170-615f85cd4903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:06:46.492412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-610dbbfd-ee1c-4f44-9170-615f85cd4903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:06:46.564893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dbbfd-ee1c-4f44-9170-615f85cd4903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:06:46.566359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dbbfd-ee1c-4f44-9170-615f85cd4903 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:06:46.575524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1209/2403] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:06:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:06:46.673488 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0eefbc-bbea-4a87-a3e3-7d4b76acd216 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:06:46.682580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0eefbc-bbea-4a87-a3e3-7d4b76acd216 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:06:46.686639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd6b01-52da-471d-aae7-5a59e631862a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:06:46.687295 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd6b01-52da-471d-aae7-5a59e631862a service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:06:46.687572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd6b01-52da-471d-aae7-5a59e631862a service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:06:46.687842 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd6b01-52da-471d-aae7-5a59e631862a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:06:46.689865 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d9fd6b01-52da-471d-aae7-5a59e631862a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:06:46.771112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd6b01-52da-471d-aae7-5a59e631862a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:06:46.772601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd6b01-52da-471d-aae7-5a59e631862a service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:06:46.782245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1195/2404] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:06:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:06:56.571400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=33 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:06:56.777670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=66 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:07:46.317977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dbbfd-ee1c-4f44-9170-615f85cd4903 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:07:46.319608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-610dbbfd-ee1c-4f44-9170-615f85cd4903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:07:46.357278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dbbfd-ee1c-4f44-9170-615f85cd4903 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:07:46.362023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb698bec-dec3-4c99-b8b8-c9f1c0d96c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:07:46.362696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb698bec-dec3-4c99-b8b8-c9f1c0d96c25 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:07:46.362980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb698bec-dec3-4c99-b8b8-c9f1c0d96c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:07:46.363255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb698bec-dec3-4c99-b8b8-c9f1c0d96c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:07:46.373704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb698bec-dec3-4c99-b8b8-c9f1c0d96c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:07:46.375306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb698bec-dec3-4c99-b8b8-c9f1c0d96c25 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:07:46.385895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1210/2405] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:07:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:07:47.830714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd6b01-52da-471d-aae7-5a59e631862a service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:07:47.835337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d9fd6b01-52da-471d-aae7-5a59e631862a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:07:47.857196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd6b01-52da-471d-aae7-5a59e631862a service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:07:47.863663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e7f8-b7e9-44f1-975b-cd2097a770d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:07:47.864982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e7f8-b7e9-44f1-975b-cd2097a770d2 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:07:47.865267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e7f8-b7e9-44f1-975b-cd2097a770d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:07:47.865543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e7f8-b7e9-44f1-975b-cd2097a770d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:07:47.880547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610e7f8-b7e9-44f1-975b-cd2097a770d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:07:47.882625 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610e7f8-b7e9-44f1-975b-cd2097a770d2 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:07:47.897167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1196/2406] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:07:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:07:56.381462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=15 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:07:57.890404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=6 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:08:56.189122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb698bec-dec3-4c99-b8b8-c9f1c0d96c25 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:08:56.190934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-fb698bec-dec3-4c99-b8b8-c9f1c0d96c25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:08:56.274317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb698bec-dec3-4c99-b8b8-c9f1c0d96c25 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:08:56.279931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f0023-15c4-4dd0-8dae-a7e50392be01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:08:56.280634 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f0023-15c4-4dd0-8dae-a7e50392be01 service placement] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:08:56.280920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f0023-15c4-4dd0-8dae-a7e50392be01 service placement] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:08:56.281193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f0023-15c4-4dd0-8dae-a7e50392be01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:08:56.290449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f0023-15c4-4dd0-8dae-a7e50392be01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:08:56.292039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f0023-15c4-4dd0-8dae-a7e50392be01 service placement] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:08:56.302383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1211/2407] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:08:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:09:06.298191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=33 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:37.062047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e7f8-b7e9-44f1-975b-cd2097a770d2 service nova] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:09:37.102380 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e7f8-b7e9-44f1-975b-cd2097a770d2 service nova] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:09:37.106650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113492a-4e23-4867-b7f7-a11c83f59562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:09:37.107292 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113492a-4e23-4867-b7f7-a11c83f59562 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:09:37.107573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113492a-4e23-4867-b7f7-a11c83f59562 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:09:37.107840 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113492a-4e23-4867-b7f7-a11c83f59562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:09:37.109931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3113492a-4e23-4867-b7f7-a11c83f59562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:09:37.131281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113492a-4e23-4867-b7f7-a11c83f59562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:09:37.132768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113492a-4e23-4867-b7f7-a11c83f59562 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:09:37.153549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1197/2408] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:09:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:09:47.151045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=22 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:09:47.972003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f0023-15c4-4dd0-8dae-a7e50392be01 service placement] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:09:47.983559 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f0023-15c4-4dd0-8dae-a7e50392be01 service placement] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:09:47.987983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc636aa-650d-4b70-adf3-a82ff55215b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:09:47.988691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc636aa-650d-4b70-adf3-a82ff55215b9 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:09:47.988972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc636aa-650d-4b70-adf3-a82ff55215b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:09:47.989238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc636aa-650d-4b70-adf3-a82ff55215b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:09:47.991480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9cc636aa-650d-4b70-adf3-a82ff55215b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:09:48.015596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc636aa-650d-4b70-adf3-a82ff55215b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:09:48.017136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc636aa-650d-4b70-adf3-a82ff55215b9 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:09:48.026154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1212/2409] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:09:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:09:58.021930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=11 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:47.029915 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113492a-4e23-4867-b7f7-a11c83f59562 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:47.039123 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113492a-4e23-4867-b7f7-a11c83f59562 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:47.043001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9351ac-f668-4b0e-9561-028a7cb2cbfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:47.043634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9351ac-f668-4b0e-9561-028a7cb2cbfa service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:47.043910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9351ac-f668-4b0e-9561-028a7cb2cbfa service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:47.044180 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9351ac-f668-4b0e-9561-028a7cb2cbfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:47.055951 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9351ac-f668-4b0e-9561-028a7cb2cbfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:47.057529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9351ac-f668-4b0e-9561-028a7cb2cbfa service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:47.069290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1198/2410] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:10:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:10:47.077793 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc636aa-650d-4b70-adf3-a82ff55215b9 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:47.087788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc636aa-650d-4b70-adf3-a82ff55215b9 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:47.091776 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce49bc-558a-4531-adce-49b249d8ac29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:47.092467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce49bc-558a-4531-adce-49b249d8ac29 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:47.092750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce49bc-558a-4531-adce-49b249d8ac29 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:47.093019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce49bc-558a-4531-adce-49b249d8ac29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:47.102756 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce49bc-558a-4531-adce-49b249d8ac29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:47.104309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce49bc-558a-4531-adce-49b249d8ac29 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:47.132659 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1213/2411] 10.222.0.26 () {60 vars in 1396 bytes} [Mon Jul 11 16:10:47 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3258 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:10:57.064108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=6 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:57.129868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=13 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:10:59.031799 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9351ac-f668-4b0e-9561-028a7cb2cbfa service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:10:59.040519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9351ac-f668-4b0e-9561-028a7cb2cbfa service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:10:59.052723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740ebdf-f658-4f95-88ce-ce67396da75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:10:59.052723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740ebdf-f658-4f95-88ce-ce67396da75e service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:10:59.052723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740ebdf-f658-4f95-88ce-ce67396da75e service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:10:59.052723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740ebdf-f658-4f95-88ce-ce67396da75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:10:59.053563 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740ebdf-f658-4f95-88ce-ce67396da75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:10:59.055014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740ebdf-f658-4f95-88ce-ce67396da75e service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:10:59.063201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1199/2412] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:10:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:11:09.059658 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=6 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:46.508870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce49bc-558a-4531-adce-49b249d8ac29 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:11:46.510489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-bcce49bc-558a-4531-adce-49b249d8ac29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:11:46.527155 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce49bc-558a-4531-adce-49b249d8ac29 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:11:46.533299 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f94efc-4541-4878-b6cc-abe124a7ee4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:11:46.533960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94efc-4541-4878-b6cc-abe124a7ee4b service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:11:46.534250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94efc-4541-4878-b6cc-abe124a7ee4b service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:11:46.534527 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94efc-4541-4878-b6cc-abe124a7ee4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:11:46.542833 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f94efc-4541-4878-b6cc-abe124a7ee4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:11:46.544478 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f94efc-4541-4878-b6cc-abe124a7ee4b service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:11:46.571506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1214/2413] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:11:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:11:48.250983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740ebdf-f658-4f95-88ce-ce67396da75e service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:11:48.271989 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740ebdf-f658-4f95-88ce-ce67396da75e service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:11:48.276086 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d746c6-9115-404f-a882-c5c4adc85d8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:11:48.276741 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d746c6-9115-404f-a882-c5c4adc85d8f service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:11:48.277041 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d746c6-9115-404f-a882-c5c4adc85d8f service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:11:48.277310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d746c6-9115-404f-a882-c5c4adc85d8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:11:48.291149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d746c6-9115-404f-a882-c5c4adc85d8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:11:48.291149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d746c6-9115-404f-a882-c5c4adc85d8f service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:11:48.294079 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f94efc-4541-4878-b6cc-abe124a7ee4b service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:11:48.295884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b8f94efc-4541-4878-b6cc-abe124a7ee4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:11:48.308638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f94efc-4541-4878-b6cc-abe124a7ee4b service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:11:48.312837 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62fe1e-fd57-45e3-ac78-ed9502999583 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:11:48.313504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62fe1e-fd57-45e3-ac78-ed9502999583 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:11:48.313818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62fe1e-fd57-45e3-ac78-ed9502999583 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:11:48.314091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62fe1e-fd57-45e3-ac78-ed9502999583 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:11:48.317149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1200/2414] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:11:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:11:48.323980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62fe1e-fd57-45e3-ac78-ed9502999583 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:11:48.325485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62fe1e-fd57-45e3-ac78-ed9502999583 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:11:48.354318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1215/2415] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:11:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:11:48.866935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d746c6-9115-404f-a882-c5c4adc85d8f service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:11:48.876970 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d746c6-9115-404f-a882-c5c4adc85d8f service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:11:48.880925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2976c3-c624-4dbe-9d8e-459ca1b8d73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:11:48.881684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2976c3-c624-4dbe-9d8e-459ca1b8d73e service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:11:48.882033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2976c3-c624-4dbe-9d8e-459ca1b8d73e service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:11:48.882317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2976c3-c624-4dbe-9d8e-459ca1b8d73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:11:48.884209 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2c2976c3-c624-4dbe-9d8e-459ca1b8d73e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:11:48.972268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2976c3-c624-4dbe-9d8e-459ca1b8d73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:11:48.973698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2976c3-c624-4dbe-9d8e-459ca1b8d73e service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:11:48.995277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1201/2416] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:11:51.973708 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62fe1e-fd57-45e3-ac78-ed9502999583 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:11:51.976791 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6d62fe1e-fd57-45e3-ac78-ed9502999583 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:11:52.013025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62fe1e-fd57-45e3-ac78-ed9502999583 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:11:52.019046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17846e-7f0f-4c13-ba95-77ed564eee42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:11:52.019833 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17846e-7f0f-4c13-ba95-77ed564eee42 service placement] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:11:52.020185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17846e-7f0f-4c13-ba95-77ed564eee42 service placement] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:11:52.020618 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17846e-7f0f-4c13-ba95-77ed564eee42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:11:52.022718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9a17846e-7f0f-4c13-ba95-77ed564eee42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:11:52.036343 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17846e-7f0f-4c13-ba95-77ed564eee42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:11:52.038255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17846e-7f0f-4c13-ba95-77ed564eee42 service placement] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:11:52.053301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1216/2417] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:11:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:11:56.738401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2976c3-c624-4dbe-9d8e-459ca1b8d73e service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:11:56.740467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2c2976c3-c624-4dbe-9d8e-459ca1b8d73e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:11:56.759959 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2976c3-c624-4dbe-9d8e-459ca1b8d73e service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:11:56.764996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c35f4-eabd-4ccd-b6fc-1dad11a661ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:11:56.765903 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c35f4-eabd-4ccd-b6fc-1dad11a661ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:11:56.766191 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c35f4-eabd-4ccd-b6fc-1dad11a661ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:11:56.766466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c35f4-eabd-4ccd-b6fc-1dad11a661ce admin admin] PATH_INFO: `/v3/users/0c2fbf5d3064479a909e7547a050ef5e` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:11:56.767679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c35f4-eabd-4ccd-b6fc-1dad11a661ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2fbf5d3064479a909e7547a050ef5e)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:11:56.769670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c35f4-eabd-4ccd-b6fc-1dad11a661ce admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:11:56.824746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-c27c35f4-eabd-4ccd-b6fc-1dad11a661ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2fbf5d3064479a909e7547a050ef5e'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:56.834658 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-c27c35f4-eabd-4ccd-b6fc-1dad11a661ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2fbf5d3064479a909e7547a050ef5e'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:56.835390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-c27c35f4-eabd-4ccd-b6fc-1dad11a661ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2fbf5d3064479a909e7547a050ef5e'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:56.835993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-c27c35f4-eabd-4ccd-b6fc-1dad11a661ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2fbf5d3064479a909e7547a050ef5e'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:56.847044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-c27c35f4-eabd-4ccd-b6fc-1dad11a661ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2fbf5d3064479a909e7547a050ef5e'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:56.861759 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:56.872693 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1202/2418] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:11:56 2022] DELETE /identity/v3/users/0c2fbf5d3064479a909e7547a050ef5e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:11:57.148437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17846e-7f0f-4c13-ba95-77ed564eee42 service placement] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:11:57.184970 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17846e-7f0f-4c13-ba95-77ed564eee42 service placement] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:11:57.251273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:11:57.252166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:11:57.252474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:11:57.252747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] PATH_INFO: `/v3/projects/34616afcc7d2411992085fbb829ec4d8` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:11:57.253964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34616afcc7d2411992085fbb829ec4d8)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:11:57.256002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:11:57.305867 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34616afcc7d2411992085fbb829ec4d8', 'request_id': 'req-9a9ea3be-1331-48df-a248-7ac372b764e0'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:57.312765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34616afcc7d2411992085fbb829ec4d8', 'request_id': 'req-9a9ea3be-1331-48df-a248-7ac372b764e0'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:57.319015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34616afcc7d2411992085fbb829ec4d8', 'request_id': 'req-9a9ea3be-1331-48df-a248-7ac372b764e0'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:57.334460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] The token cache is being invalidate because project 34616afcc7d2411992085fbb829ec4d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:11:57.334759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:57.335407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:57.337287 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1217/2419] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:11:57 2022] DELETE /identity/v3/projects/34616afcc7d2411992085fbb829ec4d8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:11:57.341270 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c35f4-eabd-4ccd-b6fc-1dad11a661ce admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:11:57.343850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-c27c35f4-eabd-4ccd-b6fc-1dad11a661ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:11:57.357702 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c35f4-eabd-4ccd-b6fc-1dad11a661ce admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:11:57.418211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f98fa-af9c-4d11-8b01-18530979fe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:11:57.419011 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f98fa-af9c-4d11-8b01-18530979fe86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:11:57.419315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f98fa-af9c-4d11-8b01-18530979fe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:11:57.419588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f98fa-af9c-4d11-8b01-18530979fe86 admin admin] PATH_INFO: `/v3/users/d38617657600492e9887791c690620a7` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:11:57.433726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f98fa-af9c-4d11-8b01-18530979fe86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d38617657600492e9887791c690620a7)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:11:57.435710 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f98fa-af9c-4d11-8b01-18530979fe86 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:11:57.484280 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f15f98fa-af9c-4d11-8b01-18530979fe86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd38617657600492e9887791c690620a7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:57.491058 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f15f98fa-af9c-4d11-8b01-18530979fe86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd38617657600492e9887791c690620a7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:57.491744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f15f98fa-af9c-4d11-8b01-18530979fe86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd38617657600492e9887791c690620a7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:57.492418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f15f98fa-af9c-4d11-8b01-18530979fe86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd38617657600492e9887791c690620a7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:57.500781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f15f98fa-af9c-4d11-8b01-18530979fe86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd38617657600492e9887791c690620a7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:57.517792 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1203/2420] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:11:57 2022] DELETE /identity/v3/users/d38617657600492e9887791c690620a7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:11:57.698230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:11:57.699813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:11:57.716580 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ea3be-1331-48df-a248-7ac372b764e0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:11:57.734633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:11:57.784600 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:11:57.785486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:11:57.785769 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:11:57.786044 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] PATH_INFO: `/v3/projects/56cdda7c64754dfc82af9067e447e6e5` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:11:57.798710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56cdda7c64754dfc82af9067e447e6e5)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:11:57.800850 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:11:57.991645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56cdda7c64754dfc82af9067e447e6e5', 'request_id': 'req-098ae371-afb7-48d8-958c-537b1d5f6ab9'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:57.998792 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56cdda7c64754dfc82af9067e447e6e5', 'request_id': 'req-098ae371-afb7-48d8-958c-537b1d5f6ab9'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:58.006671 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56cdda7c64754dfc82af9067e447e6e5', 'request_id': 'req-098ae371-afb7-48d8-958c-537b1d5f6ab9'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:58.021626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] The token cache is being invalidate because project 56cdda7c64754dfc82af9067e447e6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:11:58.021915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:58.022540 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:11:58.024168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1218/2421] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:11:57 2022] DELETE /identity/v3/projects/56cdda7c64754dfc82af9067e447e6e5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:12:07.514692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:08.018755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:47.014853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f98fa-af9c-4d11-8b01-18530979fe86 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:12:47.016435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-f15f98fa-af9c-4d11-8b01-18530979fe86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:12:47.115329 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f98fa-af9c-4d11-8b01-18530979fe86 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:12:47.180015 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ba3ef-9e16-4572-a189-eb923e6e5d01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:12:47.180707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ba3ef-9e16-4572-a189-eb923e6e5d01 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:12:47.180998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ba3ef-9e16-4572-a189-eb923e6e5d01 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:12:47.181271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ba3ef-9e16-4572-a189-eb923e6e5d01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:12:47.183421 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-259ba3ef-9e16-4572-a189-eb923e6e5d01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:12:47.266728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ba3ef-9e16-4572-a189-eb923e6e5d01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:12:47.268319 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ba3ef-9e16-4572-a189-eb923e6e5d01 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:12:47.278997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:12:47.289083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1204/2422] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:12:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:12:57.286444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:13:48.036175 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:13:48.038038 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:13:48.057167 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ae371-afb7-48d8-958c-537b1d5f6ab9 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:13:48.063570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819fa47-8ac6-41a1-82d5-10ffd472c03c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:13:48.073185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819fa47-8ac6-41a1-82d5-10ffd472c03c service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:13:48.073185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819fa47-8ac6-41a1-82d5-10ffd472c03c service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:13:48.073185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819fa47-8ac6-41a1-82d5-10ffd472c03c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:13:48.073185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f819fa47-8ac6-41a1-82d5-10ffd472c03c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:13:48.095043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819fa47-8ac6-41a1-82d5-10ffd472c03c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:13:48.098810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819fa47-8ac6-41a1-82d5-10ffd472c03c service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:13:48.126394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1219/2423] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:13:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:13:49.636060 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232ffb-1712-4e21-8e55-88cb3bf46df2 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:13:49.636652 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232ffb-1712-4e21-8e55-88cb3bf46df2 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:13:49.636652 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232ffb-1712-4e21-8e55-88cb3bf46df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:13:49.664680 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-cc232ffb-1712-4e21-8e55-88cb3bf46df2 None None] MFA Rules not processed for user `046cf5e98eca41c0a532e84f777efaab`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:13:49.665937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-cc232ffb-1712-4e21-8e55-88cb3bf46df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:13:49.738077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1205/2424] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:13:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:13:50.054410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819fa47-8ac6-41a1-82d5-10ffd472c03c service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:13:50.055965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f819fa47-8ac6-41a1-82d5-10ffd472c03c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:13:50.115932 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819fa47-8ac6-41a1-82d5-10ffd472c03c service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:13:50.120439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc2453-df15-4a8a-9161-bf59654a59df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:13:50.121064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2453-df15-4a8a-9161-bf59654a59df service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:13:50.121339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2453-df15-4a8a-9161-bf59654a59df service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:13:50.121607 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2453-df15-4a8a-9161-bf59654a59df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:13:50.123789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c5fc2453-df15-4a8a-9161-bf59654a59df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:13:50.134196 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc2453-df15-4a8a-9161-bf59654a59df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:13:50.135620 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc2453-df15-4a8a-9161-bf59654a59df service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:13:50.143553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1220/2425] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:13:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:13:50.481843 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232ffb-1712-4e21-8e55-88cb3bf46df2 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:13:50.483492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-cc232ffb-1712-4e21-8e55-88cb3bf46df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:13:50.553488 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232ffb-1712-4e21-8e55-88cb3bf46df2 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:13:50.558670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59694532-1eb5-4fd9-8e6b-eac838a5036b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:13:50.559318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59694532-1eb5-4fd9-8e6b-eac838a5036b service placement] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:13:50.559594 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59694532-1eb5-4fd9-8e6b-eac838a5036b service placement] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:13:50.559849 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59694532-1eb5-4fd9-8e6b-eac838a5036b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:13:50.561670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-59694532-1eb5-4fd9-8e6b-eac838a5036b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:13:50.573127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59694532-1eb5-4fd9-8e6b-eac838a5036b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:13:50.574647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59694532-1eb5-4fd9-8e6b-eac838a5036b service placement] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:13:50.584965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1206/2426] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:13:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:13:57.067551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc2453-df15-4a8a-9161-bf59654a59df service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:13:57.069081 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c5fc2453-df15-4a8a-9161-bf59654a59df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:13:57.087724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc2453-df15-4a8a-9161-bf59654a59df service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:13:57.094026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41b9ba-1303-452f-87c9-2a27aba77593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:13:57.094678 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41b9ba-1303-452f-87c9-2a27aba77593 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:13:57.094957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41b9ba-1303-452f-87c9-2a27aba77593 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:13:57.095227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41b9ba-1303-452f-87c9-2a27aba77593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:13:57.096995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4c41b9ba-1303-452f-87c9-2a27aba77593 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:13:57.109956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41b9ba-1303-452f-87c9-2a27aba77593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:13:57.111654 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41b9ba-1303-452f-87c9-2a27aba77593 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:13:57.124040 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1221/2427] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:13:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:13:59.295926 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59694532-1eb5-4fd9-8e6b-eac838a5036b service placement] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:13:59.307395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59694532-1eb5-4fd9-8e6b-eac838a5036b service placement] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:13:59.313951 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bfab2-c061-41b0-956e-aec9f20eb04f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:13:59.314711 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bfab2-c061-41b0-956e-aec9f20eb04f service placement] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:13:59.315061 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bfab2-c061-41b0-956e-aec9f20eb04f service placement] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:13:59.315383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bfab2-c061-41b0-956e-aec9f20eb04f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:13:59.317663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a77bfab2-c061-41b0-956e-aec9f20eb04f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:13:59.330892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bfab2-c061-41b0-956e-aec9f20eb04f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:13:59.333055 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bfab2-c061-41b0-956e-aec9f20eb04f service placement] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:13:59.344564 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1207/2428] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:13:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:14:07.119232 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=38 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:09.340040 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=66 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:36.926302 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41b9ba-1303-452f-87c9-2a27aba77593 service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:14:36.936551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41b9ba-1303-452f-87c9-2a27aba77593 service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:14:36.940859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c6306-4768-4762-ba8c-13e4bf1f2ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:14:36.941503 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c6306-4768-4762-ba8c-13e4bf1f2ceb service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:14:36.941776 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c6306-4768-4762-ba8c-13e4bf1f2ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:14:36.942021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c6306-4768-4762-ba8c-13e4bf1f2ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:14:36.944098 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-860c6306-4768-4762-ba8c-13e4bf1f2ceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:14:36.958357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c6306-4768-4762-ba8c-13e4bf1f2ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:14:36.959786 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c6306-4768-4762-ba8c-13e4bf1f2ceb service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:14:36.970572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1222/2429] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:14:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:14:46.965757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=6 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:14:48.716528 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bfab2-c061-41b0-956e-aec9f20eb04f service placement] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:14:48.734100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bfab2-c061-41b0-956e-aec9f20eb04f service placement] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:14:48.741815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf9f19-99e1-44b4-a55a-a27672064b3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:14:48.742936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf9f19-99e1-44b4-a55a-a27672064b3a service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:14:48.743340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf9f19-99e1-44b4-a55a-a27672064b3a service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:14:48.743762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf9f19-99e1-44b4-a55a-a27672064b3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:14:48.746844 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-87cf9f19-99e1-44b4-a55a-a27672064b3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:14:48.821133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf9f19-99e1-44b4-a55a-a27672064b3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:14:48.823133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf9f19-99e1-44b4-a55a-a27672064b3a service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:14:48.842047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1208/2430] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:14:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:14:58.839344 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=36 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:15:48.155067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c6306-4768-4762-ba8c-13e4bf1f2ceb service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:15:48.166177 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c6306-4768-4762-ba8c-13e4bf1f2ceb service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:15:48.170736 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5867d-d191-429f-9f25-7c340837ae20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:15:48.171381 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5867d-d191-429f-9f25-7c340837ae20 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:15:48.171658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5867d-d191-429f-9f25-7c340837ae20 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:15:48.171921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5867d-d191-429f-9f25-7c340837ae20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:15:48.174208 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8db5867d-d191-429f-9f25-7c340837ae20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:15:48.188929 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5867d-d191-429f-9f25-7c340837ae20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:15:48.190368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5867d-d191-429f-9f25-7c340837ae20 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:15:48.203025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1223/2431] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:15:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:15:48.393299 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb598c7-f136-4913-94ed-d963a776ef74 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:15:48.393824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb598c7-f136-4913-94ed-d963a776ef74 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:15:48.393824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb598c7-f136-4913-94ed-d963a776ef74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:15:48.453410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-3bb598c7-f136-4913-94ed-d963a776ef74 None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:15:48.454660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3bb598c7-f136-4913-94ed-d963a776ef74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:15:48.519104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1209/2432] 10.222.0.26 () {58 vars in 967 bytes} [Mon Jul 11 16:15:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:15:48.576479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5867d-d191-429f-9f25-7c340837ae20 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:15:48.577982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8db5867d-d191-429f-9f25-7c340837ae20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:15:48.668074 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb598c7-f136-4913-94ed-d963a776ef74 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:15:48.670943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3bb598c7-f136-4913-94ed-d963a776ef74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:15:48.672407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5867d-d191-429f-9f25-7c340837ae20 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:15:48.678203 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccfd33-710d-4aa1-981f-baa0c17dbdba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:15:48.678961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccfd33-710d-4aa1-981f-baa0c17dbdba service swift] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:15:48.679245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccfd33-710d-4aa1-981f-baa0c17dbdba service swift] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:15:48.679426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccfd33-710d-4aa1-981f-baa0c17dbdba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:15:48.689392 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccfd33-710d-4aa1-981f-baa0c17dbdba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:15:48.691131 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccfd33-710d-4aa1-981f-baa0c17dbdba service swift] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:15:48.702421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1224/2433] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 16:15:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:15:48.751005 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb598c7-f136-4913-94ed-d963a776ef74 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:15:48.755179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9dab8-5523-4874-ae54-26331496d85e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:15:48.755848 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9dab8-5523-4874-ae54-26331496d85e service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:15:48.756130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9dab8-5523-4874-ae54-26331496d85e service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:15:48.756435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9dab8-5523-4874-ae54-26331496d85e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:15:48.758294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-f0d9dab8-5523-4874-ae54-26331496d85e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:15:48.851070 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9dab8-5523-4874-ae54-26331496d85e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:15:48.853630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9dab8-5523-4874-ae54-26331496d85e service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:15:48.881298 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1210/2434] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:15:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:15:49.331353 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccfd33-710d-4aa1-981f-baa0c17dbdba service swift] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:15:49.341800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccfd33-710d-4aa1-981f-baa0c17dbdba service swift] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:15:49.345544 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402b26f-1c33-40c4-aee4-3002c731a046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:15:49.346214 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402b26f-1c33-40c4-aee4-3002c731a046 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:15:49.346555 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402b26f-1c33-40c4-aee4-3002c731a046 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:15:49.346831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402b26f-1c33-40c4-aee4-3002c731a046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:15:49.349422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c402b26f-1c33-40c4-aee4-3002c731a046 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:15:49.415444 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402b26f-1c33-40c4-aee4-3002c731a046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:15:49.417676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402b26f-1c33-40c4-aee4-3002c731a046 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:15:49.430629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1225/2435] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:15:58.860616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:15:59.426226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=77 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:17:05.555518 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9dab8-5523-4874-ae54-26331496d85e service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:05.557912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-f0d9dab8-5523-4874-ae54-26331496d85e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:05.593112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9dab8-5523-4874-ae54-26331496d85e service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:05.597985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadf35e-0ce3-4bd1-b77a-c630456c3781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:05.598675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadf35e-0ce3-4bd1-b77a-c630456c3781 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:05.598973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadf35e-0ce3-4bd1-b77a-c630456c3781 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:05.599241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadf35e-0ce3-4bd1-b77a-c630456c3781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:05.601544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-deadf35e-0ce3-4bd1-b77a-c630456c3781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:05.612347 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadf35e-0ce3-4bd1-b77a-c630456c3781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:05.613821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadf35e-0ce3-4bd1-b77a-c630456c3781 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:05.622290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1211/2436] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:17:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:17:15.618475 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=11 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:17:47.398583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402b26f-1c33-40c4-aee4-3002c731a046 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:47.415364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402b26f-1c33-40c4-aee4-3002c731a046 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:47.424973 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e5ae0-6772-476d-88c5-1cf986a8ed5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:47.425771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5ae0-6772-476d-88c5-1cf986a8ed5d service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:47.426231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5ae0-6772-476d-88c5-1cf986a8ed5d service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:47.426506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5ae0-6772-476d-88c5-1cf986a8ed5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:47.436022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e5ae0-6772-476d-88c5-1cf986a8ed5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:47.437676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e5ae0-6772-476d-88c5-1cf986a8ed5d service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:47.447449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1226/2437] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:17:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:17:49.119653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadf35e-0ce3-4bd1-b77a-c630456c3781 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:49.130527 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadf35e-0ce3-4bd1-b77a-c630456c3781 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:49.134914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237e790-9403-467d-bd6e-f73d2d5a57cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:49.135571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237e790-9403-467d-bd6e-f73d2d5a57cd service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:49.135857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237e790-9403-467d-bd6e-f73d2d5a57cd service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:49.136131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237e790-9403-467d-bd6e-f73d2d5a57cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:49.138416 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7237e790-9403-467d-bd6e-f73d2d5a57cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:49.219148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237e790-9403-467d-bd6e-f73d2d5a57cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:49.220580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237e790-9403-467d-bd6e-f73d2d5a57cd service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:49.230684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1212/2438] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:17:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:17:49.291809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e5ae0-6772-476d-88c5-1cf986a8ed5d service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:49.293370 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-114e5ae0-6772-476d-88c5-1cf986a8ed5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:49.329658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e5ae0-6772-476d-88c5-1cf986a8ed5d service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:49.335672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da130c3-6b43-469c-b4a1-5b8dc53187a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:49.336374 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da130c3-6b43-469c-b4a1-5b8dc53187a6 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:49.336660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da130c3-6b43-469c-b4a1-5b8dc53187a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:49.336937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da130c3-6b43-469c-b4a1-5b8dc53187a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:49.338926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6da130c3-6b43-469c-b4a1-5b8dc53187a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:49.362984 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da130c3-6b43-469c-b4a1-5b8dc53187a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:49.364467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da130c3-6b43-469c-b4a1-5b8dc53187a6 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:49.373471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1227/2439] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:17:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:17:49.565305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237e790-9403-467d-bd6e-f73d2d5a57cd service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:49.576517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237e790-9403-467d-bd6e-f73d2d5a57cd service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:49.586469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f503cd7-59f9-43c6-b50d-fb932ee02b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:49.587220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503cd7-59f9-43c6-b50d-fb932ee02b39 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:49.587571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503cd7-59f9-43c6-b50d-fb932ee02b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:49.587896 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503cd7-59f9-43c6-b50d-fb932ee02b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:49.589864 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7f503cd7-59f9-43c6-b50d-fb932ee02b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:49.603631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f503cd7-59f9-43c6-b50d-fb932ee02b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:49.605458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f503cd7-59f9-43c6-b50d-fb932ee02b39 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:49.617607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1213/2440] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:17:52.742587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da130c3-6b43-469c-b4a1-5b8dc53187a6 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:52.756247 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da130c3-6b43-469c-b4a1-5b8dc53187a6 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:52.761344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb0cd5-9b55-4c4b-a107-24ffe7b1059e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:52.762118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb0cd5-9b55-4c4b-a107-24ffe7b1059e service placement] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:52.762472 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb0cd5-9b55-4c4b-a107-24ffe7b1059e service placement] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:52.762814 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb0cd5-9b55-4c4b-a107-24ffe7b1059e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:52.764782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-22eb0cd5-9b55-4c4b-a107-24ffe7b1059e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:52.777426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb0cd5-9b55-4c4b-a107-24ffe7b1059e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:52.779058 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb0cd5-9b55-4c4b-a107-24ffe7b1059e service placement] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:52.790411 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1228/2441] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:17:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:17:52.807436 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f503cd7-59f9-43c6-b50d-fb932ee02b39 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:52.809011 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7f503cd7-59f9-43c6-b50d-fb932ee02b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:52.825144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f503cd7-59f9-43c6-b50d-fb932ee02b39 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:52.831727 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf257c-bd2f-4b9e-82ba-45ee63ce4beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:52.832790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf257c-bd2f-4b9e-82ba-45ee63ce4beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:52.833735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf257c-bd2f-4b9e-82ba-45ee63ce4beb admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:52.834083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf257c-bd2f-4b9e-82ba-45ee63ce4beb admin admin] PATH_INFO: `/v3/users/052b95d2857c4e728a8008d00fc34780` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:52.835435 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf257c-bd2f-4b9e-82ba-45ee63ce4beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=052b95d2857c4e728a8008d00fc34780)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:52.837514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf257c-bd2f-4b9e-82ba-45ee63ce4beb admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:52.889302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6acf257c-bd2f-4b9e-82ba-45ee63ce4beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '052b95d2857c4e728a8008d00fc34780'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:17:52.896139 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6acf257c-bd2f-4b9e-82ba-45ee63ce4beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '052b95d2857c4e728a8008d00fc34780'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:17:52.896905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6acf257c-bd2f-4b9e-82ba-45ee63ce4beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '052b95d2857c4e728a8008d00fc34780'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:17:52.897494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6acf257c-bd2f-4b9e-82ba-45ee63ce4beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '052b95d2857c4e728a8008d00fc34780'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:17:52.906878 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6acf257c-bd2f-4b9e-82ba-45ee63ce4beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '052b95d2857c4e728a8008d00fc34780'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:17:52.929548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1214/2442] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:17:52 2022] DELETE /identity/v3/users/052b95d2857c4e728a8008d00fc34780 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:17:53.122958 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb0cd5-9b55-4c4b-a107-24ffe7b1059e service placement] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:53.134305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb0cd5-9b55-4c4b-a107-24ffe7b1059e service placement] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:53.190173 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:53.190843 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:53.191119 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:53.191388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22 admin admin] PATH_INFO: `/v3/projects/f6145a3ef3d147afbeb90dd49d01af2e` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:53.192620 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6145a3ef3d147afbeb90dd49d01af2e)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:53.194678 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:53.243467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6145a3ef3d147afbeb90dd49d01af2e', 'request_id': 'req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:17:53.249561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6145a3ef3d147afbeb90dd49d01af2e', 'request_id': 'req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:17:53.255767 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6145a3ef3d147afbeb90dd49d01af2e', 'request_id': 'req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:17:53.269060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22 admin admin] The token cache is being invalidate because project f6145a3ef3d147afbeb90dd49d01af2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:17:53.269342 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:17:53.269950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6da3a9ca-51ca-4f3a-b98d-e313cf275d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:17:53.271528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1229/2443] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:17:53 2022] DELETE /identity/v3/projects/f6145a3ef3d147afbeb90dd49d01af2e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:17:53.277599 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f572b-45b7-4f44-b861-6c5e0c70c1a5 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:53.277931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f572b-45b7-4f44-b861-6c5e0c70c1a5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:53.278211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f572b-45b7-4f44-b861-6c5e0c70c1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:53.337171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-b40f572b-45b7-4f44-b861-6c5e0c70c1a5 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:17:53.338434 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b40f572b-45b7-4f44-b861-6c5e0c70c1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:53.349466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:17:53.411017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1215/2444] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:17:53.420006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84a176-f0f6-4800-af1b-4b4e1e05f02b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:53.420318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84a176-f0f6-4800-af1b-4b4e1e05f02b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:53.420673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84a176-f0f6-4800-af1b-4b4e1e05f02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:53.449367 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-ce84a176-f0f6-4800-af1b-4b4e1e05f02b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:17:53.450571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ce84a176-f0f6-4800-af1b-4b4e1e05f02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:53.464776 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1230/2445] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:17:53.469844 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f572b-45b7-4f44-b861-6c5e0c70c1a5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:53.481779 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f572b-45b7-4f44-b861-6c5e0c70c1a5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:53.487775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed71ef-3e02-4d61-a5e9-0957e7c9fe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:53.488477 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed71ef-3e02-4d61-a5e9-0957e7c9fe05 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:53.488745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed71ef-3e02-4d61-a5e9-0957e7c9fe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:53.489041 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed71ef-3e02-4d61-a5e9-0957e7c9fe05 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:53.489771 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed71ef-3e02-4d61-a5e9-0957e7c9fe05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:17:53.490046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed71ef-3e02-4d61-a5e9-0957e7c9fe05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:53.491692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed71ef-3e02-4d61-a5e9-0957e7c9fe05 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:53.505282 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1216/2446] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:17:53.510441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84a176-f0f6-4800-af1b-4b4e1e05f02b None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:53.525679 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84a176-f0f6-4800-af1b-4b4e1e05f02b None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:53.532138 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bbab2-0827-4a49-be29-eb63e393231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:53.532860 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bbab2-0827-4a49-be29-eb63e393231f admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:53.533141 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bbab2-0827-4a49-be29-eb63e393231f admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:53.533414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bbab2-0827-4a49-be29-eb63e393231f admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:53.534149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bbab2-0827-4a49-be29-eb63e393231f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:53.536514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bbab2-0827-4a49-be29-eb63e393231f admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:53.547315 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:17:53.582102 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1231/2447] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:17:53 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:17:53.586801 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed71ef-3e02-4d61-a5e9-0957e7c9fe05 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:53.598132 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed71ef-3e02-4d61-a5e9-0957e7c9fe05 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:53.657766 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f36eb-7e95-45d1-ab62-d26f0da146a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:53.658374 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f36eb-7e95-45d1-ab62-d26f0da146a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:53.658654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f36eb-7e95-45d1-ab62-d26f0da146a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:53.658933 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f36eb-7e95-45d1-ab62-d26f0da146a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:53.659607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f36eb-7e95-45d1-ab62-d26f0da146a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:53.661601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f36eb-7e95-45d1-ab62-d26f0da146a3 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:53.683709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1217/2448] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:17:53 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:17:53.688661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bbab2-0827-4a49-be29-eb63e393231f admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:53.702095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bbab2-0827-4a49-be29-eb63e393231f admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:53.707700 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca88d66-017b-4e23-91f6-fb751150b8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:53.708420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca88d66-017b-4e23-91f6-fb751150b8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:53.708684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca88d66-017b-4e23-91f6-fb751150b8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:53.708955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca88d66-017b-4e23-91f6-fb751150b8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:53.709687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca88d66-017b-4e23-91f6-fb751150b8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:53.711402 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca88d66-017b-4e23-91f6-fb751150b8c5 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:53.721795 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1232/2449] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:17:53.725983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f36eb-7e95-45d1-ab62-d26f0da146a3 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:53.736578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f36eb-7e95-45d1-ab62-d26f0da146a3 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:53.743157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a52b0-eee6-4412-a2d8-341f2f8ecc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:53.743822 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a52b0-eee6-4412-a2d8-341f2f8ecc2f admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:53.744105 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a52b0-eee6-4412-a2d8-341f2f8ecc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:53.744413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a52b0-eee6-4412-a2d8-341f2f8ecc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:53.745183 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a52b0-eee6-4412-a2d8-341f2f8ecc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:53.746833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a52b0-eee6-4412-a2d8-341f2f8ecc2f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:53.757384 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1218/2450] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:17:53.761619 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca88d66-017b-4e23-91f6-fb751150b8c5 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:53.772239 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca88d66-017b-4e23-91f6-fb751150b8c5 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:53.778404 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460be2c0-fb79-4169-a5c7-863dd4dc53b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:53.779327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460be2c0-fb79-4169-a5c7-863dd4dc53b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:53.779610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460be2c0-fb79-4169-a5c7-863dd4dc53b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:53.779881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460be2c0-fb79-4169-a5c7-863dd4dc53b1 admin admin] PATH_INFO: `/v3/projects/610285d61840462396d864f3451b8d37/users/747ef0d9e6f1483ebc7637553dfb3372/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:53.795739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460be2c0-fb79-4169-a5c7-863dd4dc53b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=610285d61840462396d864f3451b8d37, user_id=747ef0d9e6f1483ebc7637553dfb3372, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:53.798413 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460be2c0-fb79-4169-a5c7-863dd4dc53b1 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:53.814743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1233/2451] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:17:53 2022] PUT /identity/v3/projects/610285d61840462396d864f3451b8d37/users/747ef0d9e6f1483ebc7637553dfb3372/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:17:53.826574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7e73e-ba10-470a-ac71-aeed5c9a7e1f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:53.827122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7e73e-ba10-470a-ac71-aeed5c9a7e1f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:53.827122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7e73e-ba10-470a-ac71-aeed5c9a7e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:53.862029 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-18d7e73e-ba10-470a-ac71-aeed5c9a7e1f None None] MFA Rules not processed for user `747ef0d9e6f1483ebc7637553dfb3372`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:17:53.863258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-18d7e73e-ba10-470a-ac71-aeed5c9a7e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:53.931191 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1219/2452] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:17:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:17:53.935926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460be2c0-fb79-4169-a5c7-863dd4dc53b1 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:54.001241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460be2c0-fb79-4169-a5c7-863dd4dc53b1 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:54.006692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9525da-7cfb-4706-95f1-0fa6a9a6f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:54.007417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9525da-7cfb-4706-95f1-0fa6a9a6f1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:54.007695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9525da-7cfb-4706-95f1-0fa6a9a6f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:54.007974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9525da-7cfb-4706-95f1-0fa6a9a6f1e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:54.008700 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9525da-7cfb-4706-95f1-0fa6a9a6f1e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:54.010640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9525da-7cfb-4706-95f1-0fa6a9a6f1e3 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:54.044206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1234/2453] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:17:53 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:17:54.048396 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7e73e-ba10-470a-ac71-aeed5c9a7e1f None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:54.059845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7e73e-ba10-470a-ac71-aeed5c9a7e1f None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:54.068009 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:17:54.118603 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c95cc7-4fbc-4c16-b62a-ce00d264aa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:54.119278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c95cc7-4fbc-4c16-b62a-ce00d264aa88 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:54.119557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c95cc7-4fbc-4c16-b62a-ce00d264aa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:54.119849 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c95cc7-4fbc-4c16-b62a-ce00d264aa88 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:54.120565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c95cc7-4fbc-4c16-b62a-ce00d264aa88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:54.122531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c95cc7-4fbc-4c16-b62a-ce00d264aa88 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:54.144961 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1220/2454] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:17:54 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:17:54.149412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9525da-7cfb-4706-95f1-0fa6a9a6f1e3 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:54.160094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9525da-7cfb-4706-95f1-0fa6a9a6f1e3 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:54.165718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e502e28-5375-4bd2-a0e7-454276851cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:54.166385 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e502e28-5375-4bd2-a0e7-454276851cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:54.166667 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e502e28-5375-4bd2-a0e7-454276851cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:54.166938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e502e28-5375-4bd2-a0e7-454276851cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:54.167673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e502e28-5375-4bd2-a0e7-454276851cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:54.169333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e502e28-5375-4bd2-a0e7-454276851cf5 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:54.179970 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1235/2455] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:17:54.184548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c95cc7-4fbc-4c16-b62a-ce00d264aa88 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:54.198869 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c95cc7-4fbc-4c16-b62a-ce00d264aa88 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:54.206817 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2ce05-49f5-4f0d-a82d-fdd706847a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:54.208157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2ce05-49f5-4f0d-a82d-fdd706847a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:54.208610 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2ce05-49f5-4f0d-a82d-fdd706847a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:54.209015 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2ce05-49f5-4f0d-a82d-fdd706847a62 admin admin] PATH_INFO: `/v3/projects/a069498b26004a1caaf731395af88448/users/482e02cc3fc54feeb6a66862274e19bb/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:54.225993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2ce05-49f5-4f0d-a82d-fdd706847a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a069498b26004a1caaf731395af88448, user_id=482e02cc3fc54feeb6a66862274e19bb, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:54.228754 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2ce05-49f5-4f0d-a82d-fdd706847a62 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:54.244279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1221/2456] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:17:54 2022] PUT /identity/v3/projects/a069498b26004a1caaf731395af88448/users/482e02cc3fc54feeb6a66862274e19bb/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:17:54.248621 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e502e28-5375-4bd2-a0e7-454276851cf5 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:54.259198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e502e28-5375-4bd2-a0e7-454276851cf5 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:54.315665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f223a-f102-4a77-9b82-7822d060f02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:54.316327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f223a-f102-4a77-9b82-7822d060f02f admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:54.316632 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f223a-f102-4a77-9b82-7822d060f02f admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:54.316886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f223a-f102-4a77-9b82-7822d060f02f admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:54.317634 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f223a-f102-4a77-9b82-7822d060f02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:54.319227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f223a-f102-4a77-9b82-7822d060f02f admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:54.329939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1236/2457] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:17:54.335237 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2ce05-49f5-4f0d-a82d-fdd706847a62 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:17:54.347033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2ce05-49f5-4f0d-a82d-fdd706847a62 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:17:54.352937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a18bb-b280-4db0-b622-38665912c44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:17:54.353838 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a18bb-b280-4db0-b622-38665912c44e admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:54.354118 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a18bb-b280-4db0-b622-38665912c44e admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:54.354396 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a18bb-b280-4db0-b622-38665912c44e admin admin] PATH_INFO: `/v3/projects/a069498b26004a1caaf731395af88448/users/482e02cc3fc54feeb6a66862274e19bb/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:54.356716 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a18bb-b280-4db0-b622-38665912c44e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a069498b26004a1caaf731395af88448, user_id=482e02cc3fc54feeb6a66862274e19bb, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:17:54.359474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a18bb-b280-4db0-b622-38665912c44e admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:17:54.370864 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1222/2458] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:17:54 2022] PUT /identity/v3/projects/a069498b26004a1caaf731395af88448/users/482e02cc3fc54feeb6a66862274e19bb/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:17:54.381593 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5518-f622-45a7-9c26-94460469eeeb None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:17:54.381908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5518-f622-45a7-9c26-94460469eeeb None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:17:54.382186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5518-f622-45a7-9c26-94460469eeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:17:54.411113 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-ef3a5518-f622-45a7-9c26-94460469eeeb None None] MFA Rules not processed for user `482e02cc3fc54feeb6a66862274e19bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:17:54.412358 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ef3a5518-f622-45a7-9c26-94460469eeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:17:54.417923 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:17:54.485241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1237/2459] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:18:04.367013 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=39,keystone:INSERT=5 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:18:04.482276 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=26 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:19:06.289639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a18bb-b280-4db0-b622-38665912c44e admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:19:06.292756 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-625a18bb-b280-4db0-b622-38665912c44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:19:06.432896 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a18bb-b280-4db0-b622-38665912c44e admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:19:06.443126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fa41a-0f13-48a8-a0d2-37b2d91d1ae1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:19:06.444239 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fa41a-0f13-48a8-a0d2-37b2d91d1ae1 service placement] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:19:06.444622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fa41a-0f13-48a8-a0d2-37b2d91d1ae1 service placement] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:19:06.444904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fa41a-0f13-48a8-a0d2-37b2d91d1ae1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:19:06.447525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e03fa41a-0f13-48a8-a0d2-37b2d91d1ae1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:19:06.461351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fa41a-0f13-48a8-a0d2-37b2d91d1ae1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:19:06.462946 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fa41a-0f13-48a8-a0d2-37b2d91d1ae1 service placement] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:19:06.473219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1223/2460] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:19:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:19:16.468851 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=54 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:19:49.475053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a5518-f622-45a7-9c26-94460469eeeb None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:19:49.477241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ef3a5518-f622-45a7-9c26-94460469eeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:19:49.560314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a5518-f622-45a7-9c26-94460469eeeb None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:19:49.565004 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a2dd2-1ed6-4c6b-b0f1-fe8edc385611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:19:49.565658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a2dd2-1ed6-4c6b-b0f1-fe8edc385611 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:19:49.565935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a2dd2-1ed6-4c6b-b0f1-fe8edc385611 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:19:49.566206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a2dd2-1ed6-4c6b-b0f1-fe8edc385611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:19:49.575950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a2dd2-1ed6-4c6b-b0f1-fe8edc385611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:19:49.577417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a2dd2-1ed6-4c6b-b0f1-fe8edc385611 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:19:49.587701 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1238/2461] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:19:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:19:49.904042 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fa41a-0f13-48a8-a0d2-37b2d91d1ae1 service placement] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:19:49.905534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e03fa41a-0f13-48a8-a0d2-37b2d91d1ae1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:19:49.927289 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fa41a-0f13-48a8-a0d2-37b2d91d1ae1 service placement] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:19:49.931067 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56789f28-e631-49dc-aa54-ef73db91ab55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:19:49.931705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56789f28-e631-49dc-aa54-ef73db91ab55 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:19:49.931983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56789f28-e631-49dc-aa54-ef73db91ab55 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:19:49.932250 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56789f28-e631-49dc-aa54-ef73db91ab55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:19:49.934046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-56789f28-e631-49dc-aa54-ef73db91ab55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:19:50.008214 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56789f28-e631-49dc-aa54-ef73db91ab55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:19:50.010363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56789f28-e631-49dc-aa54-ef73db91ab55 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:19:50.025664 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1224/2462] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:19:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:19:59.583189 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=35 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:20:00.018739 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=38 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:21:49.817828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a2dd2-1ed6-4c6b-b0f1-fe8edc385611 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:21:49.844414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a2dd2-1ed6-4c6b-b0f1-fe8edc385611 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:21:49.851301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c8ab9-53a2-481c-b2ec-de9d6aca0dbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:21:49.852426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c8ab9-53a2-481c-b2ec-de9d6aca0dbb service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:49.852827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c8ab9-53a2-481c-b2ec-de9d6aca0dbb service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:49.853249 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c8ab9-53a2-481c-b2ec-de9d6aca0dbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:49.856479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ad8c8ab9-53a2-481c-b2ec-de9d6aca0dbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:21:49.946318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c8ab9-53a2-481c-b2ec-de9d6aca0dbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:21:49.947778 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c8ab9-53a2-481c-b2ec-de9d6aca0dbb service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:21:49.968153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1239/2463] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:21:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:21:50.027867 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56789f28-e631-49dc-aa54-ef73db91ab55 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:21:50.047927 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56789f28-e631-49dc-aa54-ef73db91ab55 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:21:50.052048 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d00ad-ae04-4f8c-965c-346cc2515156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:21:50.052729 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d00ad-ae04-4f8c-965c-346cc2515156 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:50.053082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d00ad-ae04-4f8c-965c-346cc2515156 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:50.053251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d00ad-ae04-4f8c-965c-346cc2515156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:50.114797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d00ad-ae04-4f8c-965c-346cc2515156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:21:50.116251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d00ad-ae04-4f8c-965c-346cc2515156 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:21:50.125891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1225/2464] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:21:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:21:50.392829 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c8ab9-53a2-481c-b2ec-de9d6aca0dbb service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:21:50.394393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ad8c8ab9-53a2-481c-b2ec-de9d6aca0dbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:21:50.461487 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c8ab9-53a2-481c-b2ec-de9d6aca0dbb service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:21:50.465479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87dc20-fe65-4fca-9302-7d4bf978382f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:21:50.466115 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87dc20-fe65-4fca-9302-7d4bf978382f service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:50.466420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87dc20-fe65-4fca-9302-7d4bf978382f service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:50.466687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87dc20-fe65-4fca-9302-7d4bf978382f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:50.468577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ac87dc20-fe65-4fca-9302-7d4bf978382f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:21:50.560722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:21:50.566610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87dc20-fe65-4fca-9302-7d4bf978382f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:21:50.569886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87dc20-fe65-4fca-9302-7d4bf978382f service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:21:50.592513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1240/2465] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:21:53.749041 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d00ad-ae04-4f8c-965c-346cc2515156 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:21:53.750660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-c43d00ad-ae04-4f8c-965c-346cc2515156 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:21:53.767039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d00ad-ae04-4f8c-965c-346cc2515156 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:21:53.772516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72937e7-dfc2-429b-8682-6c091f1ca7d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:21:53.773257 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72937e7-dfc2-429b-8682-6c091f1ca7d8 service placement] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:53.773609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72937e7-dfc2-429b-8682-6c091f1ca7d8 service placement] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:53.773968 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72937e7-dfc2-429b-8682-6c091f1ca7d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:53.776007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b72937e7-dfc2-429b-8682-6c091f1ca7d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:21:53.788700 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72937e7-dfc2-429b-8682-6c091f1ca7d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:21:53.790534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72937e7-dfc2-429b-8682-6c091f1ca7d8 service placement] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:21:53.802663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1226/2466] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:21:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:21:53.817360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87dc20-fe65-4fca-9302-7d4bf978382f service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:21:53.819031 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ac87dc20-fe65-4fca-9302-7d4bf978382f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:21:53.831959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87dc20-fe65-4fca-9302-7d4bf978382f service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:21:53.837895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b5aa2-d67a-4c6a-b0ce-29fa37ba57c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:21:53.838795 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b5aa2-d67a-4c6a-b0ce-29fa37ba57c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:53.839075 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b5aa2-d67a-4c6a-b0ce-29fa37ba57c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:53.839349 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b5aa2-d67a-4c6a-b0ce-29fa37ba57c8 admin admin] PATH_INFO: `/v3/users/046cf5e98eca41c0a532e84f777efaab` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:53.841223 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b5aa2-d67a-4c6a-b0ce-29fa37ba57c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=046cf5e98eca41c0a532e84f777efaab)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:21:53.843649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b5aa2-d67a-4c6a-b0ce-29fa37ba57c8 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:21:53.896316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ea0b5aa2-d67a-4c6a-b0ce-29fa37ba57c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046cf5e98eca41c0a532e84f777efaab'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:21:53.904188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ea0b5aa2-d67a-4c6a-b0ce-29fa37ba57c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046cf5e98eca41c0a532e84f777efaab'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:21:53.905010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ea0b5aa2-d67a-4c6a-b0ce-29fa37ba57c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046cf5e98eca41c0a532e84f777efaab'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:21:53.905732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ea0b5aa2-d67a-4c6a-b0ce-29fa37ba57c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046cf5e98eca41c0a532e84f777efaab'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:21:53.916445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ea0b5aa2-d67a-4c6a-b0ce-29fa37ba57c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046cf5e98eca41c0a532e84f777efaab'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:21:53.935451 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1241/2467] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:21:53 2022] DELETE /identity/v3/users/046cf5e98eca41c0a532e84f777efaab => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:21:54.117100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72937e7-dfc2-429b-8682-6c091f1ca7d8 service placement] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:21:54.128748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72937e7-dfc2-429b-8682-6c091f1ca7d8 service placement] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:21:54.202095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314c2b8-4164-4266-824a-0f25e7f01e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:21:54.202985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314c2b8-4164-4266-824a-0f25e7f01e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:54.203270 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314c2b8-4164-4266-824a-0f25e7f01e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:54.203546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314c2b8-4164-4266-824a-0f25e7f01e03 admin admin] PATH_INFO: `/v3/projects/8e5aad4353bf4dc2ba841d971f7212f2` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:54.214734 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314c2b8-4164-4266-824a-0f25e7f01e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5aad4353bf4dc2ba841d971f7212f2)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:21:54.216705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314c2b8-4164-4266-824a-0f25e7f01e03 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:21:54.263260 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0314c2b8-4164-4266-824a-0f25e7f01e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5aad4353bf4dc2ba841d971f7212f2', 'request_id': 'req-0314c2b8-4164-4266-824a-0f25e7f01e03'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:21:54.268874 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0314c2b8-4164-4266-824a-0f25e7f01e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5aad4353bf4dc2ba841d971f7212f2', 'request_id': 'req-0314c2b8-4164-4266-824a-0f25e7f01e03'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:21:54.275513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0314c2b8-4164-4266-824a-0f25e7f01e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5aad4353bf4dc2ba841d971f7212f2', 'request_id': 'req-0314c2b8-4164-4266-824a-0f25e7f01e03'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:21:54.287293 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:21:54.292628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0314c2b8-4164-4266-824a-0f25e7f01e03 admin admin] The token cache is being invalidate because project 8e5aad4353bf4dc2ba841d971f7212f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:21:54.292925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0314c2b8-4164-4266-824a-0f25e7f01e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:21:54.294070 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-0314c2b8-4164-4266-824a-0f25e7f01e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:21:54.295733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1227/2468] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:21:54 2022] DELETE /identity/v3/projects/8e5aad4353bf4dc2ba841d971f7212f2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:21:54.302742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff48f61-0a49-4a1b-bd49-4aa710e1108f None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:54.303031 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff48f61-0a49-4a1b-bd49-4aa710e1108f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:54.303293 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff48f61-0a49-4a1b-bd49-4aa710e1108f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:54.322924 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-4ff48f61-0a49-4a1b-bd49-4aa710e1108f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:21:54.324130 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4ff48f61-0a49-4a1b-bd49-4aa710e1108f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:21:54.387001 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1242/2469] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:21:54.395144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59085b2b-ed41-40ad-b855-5ff113de30cd None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:54.395509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59085b2b-ed41-40ad-b855-5ff113de30cd None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:54.395874 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59085b2b-ed41-40ad-b855-5ff113de30cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:54.415862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-59085b2b-ed41-40ad-b855-5ff113de30cd None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:21:54.417139 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-59085b2b-ed41-40ad-b855-5ff113de30cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:21:54.426515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1228/2470] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:21:54.431592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff48f61-0a49-4a1b-bd49-4aa710e1108f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:21:54.441850 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff48f61-0a49-4a1b-bd49-4aa710e1108f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:21:54.447105 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2c494-638d-46a8-a55f-58bf118b676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:21:54.447759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2c494-638d-46a8-a55f-58bf118b676d admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:54.448037 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2c494-638d-46a8-a55f-58bf118b676d admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:54.448317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2c494-638d-46a8-a55f-58bf118b676d admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:54.449117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2c494-638d-46a8-a55f-58bf118b676d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:21:54.449455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2c494-638d-46a8-a55f-58bf118b676d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:21:54.451081 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2c494-638d-46a8-a55f-58bf118b676d admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:21:54.462938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1243/2471] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:21:54.467428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59085b2b-ed41-40ad-b855-5ff113de30cd None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:21:54.477201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59085b2b-ed41-40ad-b855-5ff113de30cd None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:21:54.482773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89298b21-d7c1-4bf5-a38c-28bda15b5c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:21:54.483432 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89298b21-d7c1-4bf5-a38c-28bda15b5c41 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:54.483717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89298b21-d7c1-4bf5-a38c-28bda15b5c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:54.483994 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89298b21-d7c1-4bf5-a38c-28bda15b5c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:54.484726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89298b21-d7c1-4bf5-a38c-28bda15b5c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:21:54.486657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89298b21-d7c1-4bf5-a38c-28bda15b5c41 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:21:54.515410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1229/2472] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:21:54 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:21:54.519846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2c494-638d-46a8-a55f-58bf118b676d admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:21:54.529885 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2c494-638d-46a8-a55f-58bf118b676d admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:21:54.571539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:21:54.588356 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918e7fa-5bf5-4d49-a284-6527c5c6a312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:21:54.589034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918e7fa-5bf5-4d49-a284-6527c5c6a312 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:54.589349 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918e7fa-5bf5-4d49-a284-6527c5c6a312 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:54.589626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918e7fa-5bf5-4d49-a284-6527c5c6a312 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:54.590387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918e7fa-5bf5-4d49-a284-6527c5c6a312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:21:54.592432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918e7fa-5bf5-4d49-a284-6527c5c6a312 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:21:54.615868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1244/2473] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:21:54 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:21:54.620057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89298b21-d7c1-4bf5-a38c-28bda15b5c41 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:21:54.630727 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89298b21-d7c1-4bf5-a38c-28bda15b5c41 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:21:54.635609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec560e7-b55b-4b26-a70d-456c68a5e493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:21:54.636254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec560e7-b55b-4b26-a70d-456c68a5e493 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:54.636580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec560e7-b55b-4b26-a70d-456c68a5e493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:54.636997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec560e7-b55b-4b26-a70d-456c68a5e493 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:54.637572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec560e7-b55b-4b26-a70d-456c68a5e493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:21:54.639179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec560e7-b55b-4b26-a70d-456c68a5e493 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:21:54.650047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1230/2474] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:21:54.654104 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918e7fa-5bf5-4d49-a284-6527c5c6a312 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:21:54.664099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918e7fa-5bf5-4d49-a284-6527c5c6a312 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:21:54.669213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447aba2-097d-48e4-8348-1c95992379b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:21:54.669878 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447aba2-097d-48e4-8348-1c95992379b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:54.670163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447aba2-097d-48e4-8348-1c95992379b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:54.670440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447aba2-097d-48e4-8348-1c95992379b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:54.671172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447aba2-097d-48e4-8348-1c95992379b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:21:54.672825 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447aba2-097d-48e4-8348-1c95992379b4 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:21:54.682884 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1245/2475] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:21:54.687388 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec560e7-b55b-4b26-a70d-456c68a5e493 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:21:54.697940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec560e7-b55b-4b26-a70d-456c68a5e493 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:21:54.703259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1b118-e8b6-4302-992c-99258bd4ac66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:21:54.704130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1b118-e8b6-4302-992c-99258bd4ac66 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:54.704758 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1b118-e8b6-4302-992c-99258bd4ac66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:54.705034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1b118-e8b6-4302-992c-99258bd4ac66 admin admin] PATH_INFO: `/v3/projects/f8ad959b0413410ab06c7ff793b7801b/users/ad1057ac8f4c471bb9ffdb8a8f1fe61c/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:54.720149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1b118-e8b6-4302-992c-99258bd4ac66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ad959b0413410ab06c7ff793b7801b, user_id=ad1057ac8f4c471bb9ffdb8a8f1fe61c, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:21:54.722913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1b118-e8b6-4302-992c-99258bd4ac66 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:21:54.738796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1231/2476] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:21:54 2022] PUT /identity/v3/projects/f8ad959b0413410ab06c7ff793b7801b/users/ad1057ac8f4c471bb9ffdb8a8f1fe61c/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:21:54.744278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14de90a-83b7-4ef5-a489-158f3e78652c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:54.744618 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14de90a-83b7-4ef5-a489-158f3e78652c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:54.744911 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14de90a-83b7-4ef5-a489-158f3e78652c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:54.763231 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-a14de90a-83b7-4ef5-a489-158f3e78652c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:21:54.764479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a14de90a-83b7-4ef5-a489-158f3e78652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:21:54.826941 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1246/2477] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:21:54.838343 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1b118-e8b6-4302-992c-99258bd4ac66 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:21:54.841720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-f6b1b118-e8b6-4302-992c-99258bd4ac66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:21:54.909492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1b118-e8b6-4302-992c-99258bd4ac66 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:21:54.916496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e530a-086c-49c0-8d47-73ba5b5a8834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:21:54.917503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e530a-086c-49c0-8d47-73ba5b5a8834 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:54.917943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e530a-086c-49c0-8d47-73ba5b5a8834 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:54.918321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e530a-086c-49c0-8d47-73ba5b5a8834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:54.934121 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e530a-086c-49c0-8d47-73ba5b5a8834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:21:54.936366 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e530a-086c-49c0-8d47-73ba5b5a8834 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:21:54.951191 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1232/2478] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:21:58.923557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4af0e-c9b2-41e9-a54c-350fdafcfd5a None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:58.924101 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4af0e-c9b2-41e9-a54c-350fdafcfd5a None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:58.924326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4af0e-c9b2-41e9-a54c-350fdafcfd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:58.950844 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-a1a4af0e-c9b2-41e9-a54c-350fdafcfd5a None None] MFA Rules not processed for user `ad1057ac8f4c471bb9ffdb8a8f1fe61c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:21:58.951990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a1a4af0e-c9b2-41e9-a54c-350fdafcfd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:21:59.016247 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1247/2479] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:21:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:21:59.036090 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e530a-086c-49c0-8d47-73ba5b5a8834 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:21:59.037797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-785e530a-086c-49c0-8d47-73ba5b5a8834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:21:59.129576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e530a-086c-49c0-8d47-73ba5b5a8834 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:21:59.135141 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d70aeb-86d5-4562-9551-138d64871320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:21:59.135790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d70aeb-86d5-4562-9551-138d64871320 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:21:59.136056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d70aeb-86d5-4562-9551-138d64871320 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:21:59.136348 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d70aeb-86d5-4562-9551-138d64871320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:21:59.144592 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d70aeb-86d5-4562-9551-138d64871320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:21:59.146390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d70aeb-86d5-4562-9551-138d64871320 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:21:59.157588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1233/2480] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:21:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:22:00.524848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04486c83-f977-4504-ab3c-559d59285189 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:22:00.525351 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04486c83-f977-4504-ab3c-559d59285189 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:22:00.525455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04486c83-f977-4504-ab3c-559d59285189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:22:00.544219 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-04486c83-f977-4504-ab3c-559d59285189 None None] MFA Rules not processed for user `ad1057ac8f4c471bb9ffdb8a8f1fe61c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:22:00.545450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-04486c83-f977-4504-ab3c-559d59285189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:22:00.553046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1248/2481] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:22:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:22:00.592749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d70aeb-86d5-4562-9551-138d64871320 service nova] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:22:00.594230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d3d70aeb-86d5-4562-9551-138d64871320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:22:00.604130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:22:00.678475 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d70aeb-86d5-4562-9551-138d64871320 service nova] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:22:00.682428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd9ed1-5e87-4901-97d9-dd3403b08aea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3be29cfa76174b44b99ddaf3d293ead1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:22:00.683078 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd9ed1-5e87-4901-97d9-dd3403b08aea service glance] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:22:00.683358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd9ed1-5e87-4901-97d9-dd3403b08aea service glance] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:22:00.684238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd9ed1-5e87-4901-97d9-dd3403b08aea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:22:00.686387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-88cd9ed1-5e87-4901-97d9-dd3403b08aea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:22:00.701230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd9ed1-5e87-4901-97d9-dd3403b08aea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:22:00.702681 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd9ed1-5e87-4901-97d9-dd3403b08aea service glance] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:22:00.714329 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1234/2482] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:22:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:22:00.997960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04486c83-f977-4504-ab3c-559d59285189 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:22:01.008275 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04486c83-f977-4504-ab3c-559d59285189 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:22:01.012305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd83ddf-11c8-4d37-9e41-943e0c09a669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:22:01.012965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd83ddf-11c8-4d37-9e41-943e0c09a669 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:22:01.013252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd83ddf-11c8-4d37-9e41-943e0c09a669 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:22:01.013530 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd83ddf-11c8-4d37-9e41-943e0c09a669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:22:01.015359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ccd83ddf-11c8-4d37-9e41-943e0c09a669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:22:01.025626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd83ddf-11c8-4d37-9e41-943e0c09a669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:22:01.027156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd83ddf-11c8-4d37-9e41-943e0c09a669 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:22:01.036183 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1249/2483] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:22:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:22:01.389156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd9ed1-5e87-4901-97d9-dd3403b08aea service glance] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:22:01.390543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-88cd9ed1-5e87-4901-97d9-dd3403b08aea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:22:01.395733 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd83ddf-11c8-4d37-9e41-943e0c09a669 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:22:01.405478 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd83ddf-11c8-4d37-9e41-943e0c09a669 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:22:01.409906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0261747-bcc5-498c-aa88-ef2181935e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:22:01.411139 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0261747-bcc5-498c-aa88-ef2181935e65 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:22:01.411651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0261747-bcc5-498c-aa88-ef2181935e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:22:01.412528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0261747-bcc5-498c-aa88-ef2181935e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:22:01.414697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f0261747-bcc5-498c-aa88-ef2181935e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:22:01.432845 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0261747-bcc5-498c-aa88-ef2181935e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:22:01.437963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0261747-bcc5-498c-aa88-ef2181935e65 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:22:01.457245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1250/2484] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:22:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:22:01.476920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd9ed1-5e87-4901-97d9-dd3403b08aea service glance] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:22:01.482057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985e57b-2d68-448d-a784-04c02eaadb78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:22:01.482890 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985e57b-2d68-448d-a784-04c02eaadb78 service placement] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:22:01.483311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985e57b-2d68-448d-a784-04c02eaadb78 service placement] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:22:01.483585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985e57b-2d68-448d-a784-04c02eaadb78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:22:01.485521 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4985e57b-2d68-448d-a784-04c02eaadb78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:22:01.501188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985e57b-2d68-448d-a784-04c02eaadb78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:22:01.502819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985e57b-2d68-448d-a784-04c02eaadb78 service placement] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:22:01.519124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1235/2485] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:22:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:22:03.920383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0261747-bcc5-498c-aa88-ef2181935e65 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:22:03.922886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f0261747-bcc5-498c-aa88-ef2181935e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:22:03.937569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0261747-bcc5-498c-aa88-ef2181935e65 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:22:03.943704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0e3a3-6f87-4c2c-b718-1a9cc7025eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:22:03.945243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e3a3-6f87-4c2c-b718-1a9cc7025eac service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:22:03.945603 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e3a3-6f87-4c2c-b718-1a9cc7025eac service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:22:03.945953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e3a3-6f87-4c2c-b718-1a9cc7025eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:22:03.947931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e7c0e3a3-6f87-4c2c-b718-1a9cc7025eac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:22:03.961886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0e3a3-6f87-4c2c-b718-1a9cc7025eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:22:03.963586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0e3a3-6f87-4c2c-b718-1a9cc7025eac service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:22:03.977143 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1251/2486] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:22:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:22:05.722415 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985e57b-2d68-448d-a784-04c02eaadb78 service placement] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:22:05.724253 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4985e57b-2d68-448d-a784-04c02eaadb78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:22:05.737198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985e57b-2d68-448d-a784-04c02eaadb78 service placement] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:22:05.741521 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75592e-3c9a-4cbe-b205-41f3c9a4e6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:22:05.742167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75592e-3c9a-4cbe-b205-41f3c9a4e6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:22:05.742449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75592e-3c9a-4cbe-b205-41f3c9a4e6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:22:05.742726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75592e-3c9a-4cbe-b205-41f3c9a4e6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:22:05.745016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7c75592e-3c9a-4cbe-b205-41f3c9a4e6c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:22:05.754752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75592e-3c9a-4cbe-b205-41f3c9a4e6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:22:05.756195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75592e-3c9a-4cbe-b205-41f3c9a4e6c0 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:22:05.764489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1236/2487] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:22:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:22:09.351626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0e3a3-6f87-4c2c-b718-1a9cc7025eac service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:22:09.363627 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0e3a3-6f87-4c2c-b718-1a9cc7025eac service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:22:09.369778 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af471533-c645-4730-9d0c-d4d1841836c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:22:09.370441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471533-c645-4730-9d0c-d4d1841836c1 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:22:09.370726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471533-c645-4730-9d0c-d4d1841836c1 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:22:09.371667 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af471533-c645-4730-9d0c-d4d1841836c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:22:09.373678 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-af471533-c645-4730-9d0c-d4d1841836c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:22:09.382748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:22:09.388637 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af471533-c645-4730-9d0c-d4d1841836c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:22:09.390742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af471533-c645-4730-9d0c-d4d1841836c1 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:22:09.401462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1252/2488] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:22:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:22:15.761087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=70 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:22:19.397160 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:23:50.349352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75592e-3c9a-4cbe-b205-41f3c9a4e6c0 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:23:50.351503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7c75592e-3c9a-4cbe-b205-41f3c9a4e6c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:23:50.428467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75592e-3c9a-4cbe-b205-41f3c9a4e6c0 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:23:50.432469 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e9471-8f1b-4054-b90b-ef737fc94cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:23:50.433127 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e9471-8f1b-4054-b90b-ef737fc94cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:23:50.433404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e9471-8f1b-4054-b90b-ef737fc94cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:23:50.433674 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e9471-8f1b-4054-b90b-ef737fc94cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:23:50.435772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-c88e9471-8f1b-4054-b90b-ef737fc94cd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:23:50.525986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e9471-8f1b-4054-b90b-ef737fc94cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:23:50.527558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e9471-8f1b-4054-b90b-ef737fc94cd7 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:23:50.549358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1237/2489] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:23:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:23:53.318129 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa4ced-21c6-4856-ab4e-c36b45eafd71 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:23:53.318673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa4ced-21c6-4856-ab4e-c36b45eafd71 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:23:53.318673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa4ced-21c6-4856-ab4e-c36b45eafd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:23:53.338636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-6efa4ced-21c6-4856-ab4e-c36b45eafd71 None None] MFA Rules not processed for user `ad1057ac8f4c471bb9ffdb8a8f1fe61c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:23:53.339940 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6efa4ced-21c6-4856-ab4e-c36b45eafd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:23:53.348796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1253/2490] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:23:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:24:00.547171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=61 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:24:03.333449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:24:04.848420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e9471-8f1b-4054-b90b-ef737fc94cd7 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:24:04.860984 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e9471-8f1b-4054-b90b-ef737fc94cd7 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:24:04.866367 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbcd4c-1cda-4e38-8961-5c8da0ec1b40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:24:04.867015 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbcd4c-1cda-4e38-8961-5c8da0ec1b40 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:24:04.867294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbcd4c-1cda-4e38-8961-5c8da0ec1b40 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:24:04.867565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbcd4c-1cda-4e38-8961-5c8da0ec1b40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:24:04.869383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e6dbcd4c-1cda-4e38-8961-5c8da0ec1b40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:24:04.895875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbcd4c-1cda-4e38-8961-5c8da0ec1b40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:24:04.897513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbcd4c-1cda-4e38-8961-5c8da0ec1b40 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:24:04.909168 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1238/2491] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:24:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:24:13.283319 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa4ced-21c6-4856-ab4e-c36b45eafd71 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:24:13.284914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6efa4ced-21c6-4856-ab4e-c36b45eafd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:24:13.300778 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa4ced-21c6-4856-ab4e-c36b45eafd71 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:24:13.306988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd625bdf-cae2-4e0c-a9b5-2b56176fffe8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:24:13.307641 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd625bdf-cae2-4e0c-a9b5-2b56176fffe8 service placement] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:24:13.307923 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd625bdf-cae2-4e0c-a9b5-2b56176fffe8 service placement] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:24:13.308194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd625bdf-cae2-4e0c-a9b5-2b56176fffe8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:24:13.310107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-dd625bdf-cae2-4e0c-a9b5-2b56176fffe8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:24:13.330897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd625bdf-cae2-4e0c-a9b5-2b56176fffe8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:24:13.332536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd625bdf-cae2-4e0c-a9b5-2b56176fffe8 service placement] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:24:13.353229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1254/2492] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:24:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:24:14.904665 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=11 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:24:23.344309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=6 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:25:46.913333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a817e-7a47-4ec8-9f0d-a7b1274cdd36 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:46.913857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a817e-7a47-4ec8-9f0d-a7b1274cdd36 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:46.913968 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a817e-7a47-4ec8-9f0d-a7b1274cdd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:46.931349 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-034a817e-7a47-4ec8-9f0d-a7b1274cdd36 None None] MFA Rules not processed for user `ad1057ac8f4c471bb9ffdb8a8f1fe61c`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:25:46.932503 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-034a817e-7a47-4ec8-9f0d-a7b1274cdd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:46.939731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1239/2493] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:25:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:25:47.271707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd625bdf-cae2-4e0c-a9b5-2b56176fffe8 service placement] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:47.273361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-dd625bdf-cae2-4e0c-a9b5-2b56176fffe8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:47.279795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a817e-7a47-4ec8-9f0d-a7b1274cdd36 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:47.285885 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd625bdf-cae2-4e0c-a9b5-2b56176fffe8 service placement] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:47.289372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1feab0-4647-473c-bff7-0bea45aa8264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:47.290019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1feab0-4647-473c-bff7-0bea45aa8264 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:47.290552 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1feab0-4647-473c-bff7-0bea45aa8264 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:47.291007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1feab0-4647-473c-bff7-0bea45aa8264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:47.293290 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-cc1feab0-4647-473c-bff7-0bea45aa8264 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:47.305207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a817e-7a47-4ec8-9f0d-a7b1274cdd36 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:47.308764 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdd1f7-e3f9-44c4-9ff8-db60972eef46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:47.309706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdd1f7-e3f9-44c4-9ff8-db60972eef46 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:47.310161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdd1f7-e3f9-44c4-9ff8-db60972eef46 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:47.310464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdd1f7-e3f9-44c4-9ff8-db60972eef46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:47.312325 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-32fdd1f7-e3f9-44c4-9ff8-db60972eef46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:47.326189 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdd1f7-e3f9-44c4-9ff8-db60972eef46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:47.329046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdd1f7-e3f9-44c4-9ff8-db60972eef46 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:47.342298 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1240/2494] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:25:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:25:47.390299 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1feab0-4647-473c-bff7-0bea45aa8264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:47.391971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1feab0-4647-473c-bff7-0bea45aa8264 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:47.402824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1255/2495] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:25:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:25:47.507139 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdd1f7-e3f9-44c4-9ff8-db60972eef46 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:47.509645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-32fdd1f7-e3f9-44c4-9ff8-db60972eef46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:47.527676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdd1f7-e3f9-44c4-9ff8-db60972eef46 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:47.534263 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f32ea5-d2b8-47b6-848c-c4467c287f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:47.535574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f32ea5-d2b8-47b6-848c-c4467c287f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:47.536122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f32ea5-d2b8-47b6-848c-c4467c287f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:47.536468 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f32ea5-d2b8-47b6-848c-c4467c287f81 admin admin] PATH_INFO: `/v3/users/747ef0d9e6f1483ebc7637553dfb3372` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:47.537993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f32ea5-d2b8-47b6-848c-c4467c287f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747ef0d9e6f1483ebc7637553dfb3372)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:47.540660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f32ea5-d2b8-47b6-848c-c4467c287f81 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:47.652974 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b8f32ea5-d2b8-47b6-848c-c4467c287f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747ef0d9e6f1483ebc7637553dfb3372'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:47.670848 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b8f32ea5-d2b8-47b6-848c-c4467c287f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747ef0d9e6f1483ebc7637553dfb3372'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:47.672199 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b8f32ea5-d2b8-47b6-848c-c4467c287f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747ef0d9e6f1483ebc7637553dfb3372'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:47.674887 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b8f32ea5-d2b8-47b6-848c-c4467c287f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747ef0d9e6f1483ebc7637553dfb3372'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:47.691109 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-b8f32ea5-d2b8-47b6-848c-c4467c287f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747ef0d9e6f1483ebc7637553dfb3372'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:47.713039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1241/2496] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:25:47 2022] DELETE /identity/v3/users/747ef0d9e6f1483ebc7637553dfb3372 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:25:47.718142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2a385-3638-43eb-9e5d-dae2b77a531e None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:47.718317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2a385-3638-43eb-9e5d-dae2b77a531e None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:47.718515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2a385-3638-43eb-9e5d-dae2b77a531e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:47.738773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-b6e2a385-3638-43eb-9e5d-dae2b77a531e None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:25:47.740240 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b6e2a385-3638-43eb-9e5d-dae2b77a531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:47.855988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1256/2497] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:25:47.868497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f32ea5-d2b8-47b6-848c-c4467c287f81 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:47.870008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b8f32ea5-d2b8-47b6-848c-c4467c287f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:47.979872 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f32ea5-d2b8-47b6-848c-c4467c287f81 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:47.984056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba82321-5edd-43e3-a2a5-c2b1d1554a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:47.984786 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba82321-5edd-43e3-a2a5-c2b1d1554a75 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:47.985082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba82321-5edd-43e3-a2a5-c2b1d1554a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:47.985360 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba82321-5edd-43e3-a2a5-c2b1d1554a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:47.996740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba82321-5edd-43e3-a2a5-c2b1d1554a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:47.998380 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba82321-5edd-43e3-a2a5-c2b1d1554a75 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:48.011573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1242/2498] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:25:48.353273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2a385-3638-43eb-9e5d-dae2b77a531e None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:48.354539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b6e2a385-3638-43eb-9e5d-dae2b77a531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:48.366722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2a385-3638-43eb-9e5d-dae2b77a531e None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:48.371718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:48.372653 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:48.372933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:48.373209 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] PATH_INFO: `/v3/projects/610285d61840462396d864f3451b8d37` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:48.374405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] RBAC: Authorizing `identity:delete_project(project_id=610285d61840462396d864f3451b8d37)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:48.376392 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:48.424057 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '610285d61840462396d864f3451b8d37', 'request_id': 'req-33e0955c-1ff4-40e6-a81a-617deb83f20a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:48.430282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '610285d61840462396d864f3451b8d37', 'request_id': 'req-33e0955c-1ff4-40e6-a81a-617deb83f20a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:48.436038 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '610285d61840462396d864f3451b8d37', 'request_id': 'req-33e0955c-1ff4-40e6-a81a-617deb83f20a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:48.449868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] The token cache is being invalidate because project 610285d61840462396d864f3451b8d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:25:48.450155 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:48.450850 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:48.452486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1257/2499] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:25:48 2022] DELETE /identity/v3/projects/610285d61840462396d864f3451b8d37 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:25:48.458911 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba82321-5edd-43e3-a2a5-c2b1d1554a75 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:48.469977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba82321-5edd-43e3-a2a5-c2b1d1554a75 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:48.531756 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:25:48.541480 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ce377-8079-4fa4-9075-227188c3d19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:48.542860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ce377-8079-4fa4-9075-227188c3d19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:48.543328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ce377-8079-4fa4-9075-227188c3d19e admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:48.543668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ce377-8079-4fa4-9075-227188c3d19e admin admin] PATH_INFO: `/v3/users/482e02cc3fc54feeb6a66862274e19bb` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:48.545406 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ce377-8079-4fa4-9075-227188c3d19e admin admin] RBAC: Authorizing `identity:delete_user(user_id=482e02cc3fc54feeb6a66862274e19bb)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:48.547625 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ce377-8079-4fa4-9075-227188c3d19e admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:48.596480 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-367ce377-8079-4fa4-9075-227188c3d19e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '482e02cc3fc54feeb6a66862274e19bb'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:48.604765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-367ce377-8079-4fa4-9075-227188c3d19e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '482e02cc3fc54feeb6a66862274e19bb'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:48.605515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-367ce377-8079-4fa4-9075-227188c3d19e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '482e02cc3fc54feeb6a66862274e19bb'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:48.606125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-367ce377-8079-4fa4-9075-227188c3d19e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '482e02cc3fc54feeb6a66862274e19bb'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:48.614064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-367ce377-8079-4fa4-9075-227188c3d19e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '482e02cc3fc54feeb6a66862274e19bb'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:48.631870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1243/2500] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:25:48 2022] DELETE /identity/v3/users/482e02cc3fc54feeb6a66862274e19bb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:25:48.936486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:48.937990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:48.955330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0955c-1ff4-40e6-a81a-617deb83f20a admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:48.977045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:25:49.024707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9cc46-685b-431a-9286-108de39e5452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:49.025723 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9cc46-685b-431a-9286-108de39e5452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:49.025995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9cc46-685b-431a-9286-108de39e5452 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:49.026313 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9cc46-685b-431a-9286-108de39e5452 admin admin] PATH_INFO: `/v3/projects/a069498b26004a1caaf731395af88448` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:49.027514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9cc46-685b-431a-9286-108de39e5452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a069498b26004a1caaf731395af88448)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:49.029463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9cc46-685b-431a-9286-108de39e5452 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:49.082280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-8ed9cc46-685b-431a-9286-108de39e5452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a069498b26004a1caaf731395af88448', 'request_id': 'req-8ed9cc46-685b-431a-9286-108de39e5452'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:49.089191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-8ed9cc46-685b-431a-9286-108de39e5452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a069498b26004a1caaf731395af88448', 'request_id': 'req-8ed9cc46-685b-431a-9286-108de39e5452'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:49.095232 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-8ed9cc46-685b-431a-9286-108de39e5452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a069498b26004a1caaf731395af88448', 'request_id': 'req-8ed9cc46-685b-431a-9286-108de39e5452'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:49.108670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-8ed9cc46-685b-431a-9286-108de39e5452 admin admin] The token cache is being invalidate because project a069498b26004a1caaf731395af88448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:25:49.108985 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-8ed9cc46-685b-431a-9286-108de39e5452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:49.109682 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-8ed9cc46-685b-431a-9286-108de39e5452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:25:49.111257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1258/2501] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:25:48 2022] DELETE /identity/v3/projects/a069498b26004a1caaf731395af88448 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:25:49.117081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f05ee3-99ec-47f1-a6fd-4a4aa6ce8e3a None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:49.117562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f05ee3-99ec-47f1-a6fd-4a4aa6ce8e3a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:49.117682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f05ee3-99ec-47f1-a6fd-4a4aa6ce8e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:49.136190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-56f05ee3-99ec-47f1-a6fd-4a4aa6ce8e3a None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:25:49.137554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-56f05ee3-99ec-47f1-a6fd-4a4aa6ce8e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:49.205103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1244/2502] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:25:49.212944 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e96ae-22fe-4c19-a96c-d1465b7d44a2 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:49.213226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e96ae-22fe-4c19-a96c-d1465b7d44a2 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:49.213502 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e96ae-22fe-4c19-a96c-d1465b7d44a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:49.233318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-898e96ae-22fe-4c19-a96c-d1465b7d44a2 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:25:49.234651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-898e96ae-22fe-4c19-a96c-d1465b7d44a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:49.243339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1259/2503] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:25:49.248036 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f05ee3-99ec-47f1-a6fd-4a4aa6ce8e3a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:49.258251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f05ee3-99ec-47f1-a6fd-4a4aa6ce8e3a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:49.263919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478a8a5-cdb2-423b-8820-0a74857ae474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:49.264656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478a8a5-cdb2-423b-8820-0a74857ae474 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:49.264939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478a8a5-cdb2-423b-8820-0a74857ae474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:49.265293 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478a8a5-cdb2-423b-8820-0a74857ae474 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:49.265955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478a8a5-cdb2-423b-8820-0a74857ae474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:25:49.266262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478a8a5-cdb2-423b-8820-0a74857ae474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:49.267893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478a8a5-cdb2-423b-8820-0a74857ae474 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:49.280790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1245/2504] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:25:49.284969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e96ae-22fe-4c19-a96c-d1465b7d44a2 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:49.295300 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e96ae-22fe-4c19-a96c-d1465b7d44a2 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:49.300833 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79348b2e-f009-42b1-9b06-e85fa2636ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:49.301497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79348b2e-f009-42b1-9b06-e85fa2636ffc admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:49.301779 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79348b2e-f009-42b1-9b06-e85fa2636ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:49.302039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79348b2e-f009-42b1-9b06-e85fa2636ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:49.302733 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79348b2e-f009-42b1-9b06-e85fa2636ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:49.304725 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79348b2e-f009-42b1-9b06-e85fa2636ffc admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:49.334963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1260/2505] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:25:49 2022] POST /identity/v3/projects => generated 353 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:25:49.339601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478a8a5-cdb2-423b-8820-0a74857ae474 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:49.352340 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478a8a5-cdb2-423b-8820-0a74857ae474 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:49.412580 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90466d6-dd62-4ca1-a1e9-df49731cb608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:49.413178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90466d6-dd62-4ca1-a1e9-df49731cb608 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:49.413460 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90466d6-dd62-4ca1-a1e9-df49731cb608 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:49.413733 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90466d6-dd62-4ca1-a1e9-df49731cb608 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:49.414423 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90466d6-dd62-4ca1-a1e9-df49731cb608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:49.416452 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90466d6-dd62-4ca1-a1e9-df49731cb608 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:49.424553 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:25:49.440681 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1246/2506] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:25:49 2022] POST /identity/v3/users => generated 277 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:25:49.442492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79348b2e-f009-42b1-9b06-e85fa2636ffc admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:49.453879 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79348b2e-f009-42b1-9b06-e85fa2636ffc admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:49.458960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d6155-bed8-4940-9773-8b867866fb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:49.459664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d6155-bed8-4940-9773-8b867866fb01 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:49.459950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d6155-bed8-4940-9773-8b867866fb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:49.460226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d6155-bed8-4940-9773-8b867866fb01 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:49.461006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d6155-bed8-4940-9773-8b867866fb01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:49.462846 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d6155-bed8-4940-9773-8b867866fb01 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:49.473530 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1261/2507] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:25:49.477533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90466d6-dd62-4ca1-a1e9-df49731cb608 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:49.487827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90466d6-dd62-4ca1-a1e9-df49731cb608 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:49.492965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f79cc4-602d-438a-a6d2-ea329ee869b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:49.493757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f79cc4-602d-438a-a6d2-ea329ee869b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:49.494025 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f79cc4-602d-438a-a6d2-ea329ee869b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:49.494301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f79cc4-602d-438a-a6d2-ea329ee869b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:49.495041 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f79cc4-602d-438a-a6d2-ea329ee869b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:49.496712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f79cc4-602d-438a-a6d2-ea329ee869b1 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:49.506814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1247/2508] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:25:49.511026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d6155-bed8-4940-9773-8b867866fb01 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:49.521504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d6155-bed8-4940-9773-8b867866fb01 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:49.527035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75b258-d395-4813-b429-14d97818993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:49.527918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75b258-d395-4813-b429-14d97818993f admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:49.528190 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75b258-d395-4813-b429-14d97818993f admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:49.528495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75b258-d395-4813-b429-14d97818993f admin admin] PATH_INFO: `/v3/projects/61af108da54e49f7b4f800f9ae529963/users/6c9fe5dce1a640ab83b2bb392d97c01f/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:49.544363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75b258-d395-4813-b429-14d97818993f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61af108da54e49f7b4f800f9ae529963, user_id=6c9fe5dce1a640ab83b2bb392d97c01f, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:49.547048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75b258-d395-4813-b429-14d97818993f admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:49.562851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1262/2509] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:25:49 2022] PUT /identity/v3/projects/61af108da54e49f7b4f800f9ae529963/users/6c9fe5dce1a640ab83b2bb392d97c01f/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:25:49.574998 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d518b7-056d-4825-8942-74353b3aa6d5 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:49.575260 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d518b7-056d-4825-8942-74353b3aa6d5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:49.575562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d518b7-056d-4825-8942-74353b3aa6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:49.603617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-f5d518b7-056d-4825-8942-74353b3aa6d5 None None] MFA Rules not processed for user `6c9fe5dce1a640ab83b2bb392d97c01f`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:25:49.604877 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-f5d518b7-056d-4825-8942-74353b3aa6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:49.674812 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1248/2510] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:25:49 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:25:49.679514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75b258-d395-4813-b429-14d97818993f admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:49.726016 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:25:49.743901 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75b258-d395-4813-b429-14d97818993f admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:49.748628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af48953-3f2c-4a6a-a564-0e24de6de3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:49.749290 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48953-3f2c-4a6a-a564-0e24de6de3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:49.749558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48953-3f2c-4a6a-a564-0e24de6de3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:49.749831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48953-3f2c-4a6a-a564-0e24de6de3a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:49.750528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af48953-3f2c-4a6a-a564-0e24de6de3a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:49.752463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af48953-3f2c-4a6a-a564-0e24de6de3a0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:49.781835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1263/2511] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:25:49 2022] POST /identity/v3/projects => generated 353 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:25:49.786607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d518b7-056d-4825-8942-74353b3aa6d5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:49.804100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d518b7-056d-4825-8942-74353b3aa6d5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:49.875197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17e824-ef4f-4bb2-9838-55cfdcef11ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:49.875894 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17e824-ef4f-4bb2-9838-55cfdcef11ca admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:49.876153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17e824-ef4f-4bb2-9838-55cfdcef11ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:49.876458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17e824-ef4f-4bb2-9838-55cfdcef11ca admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:49.877146 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17e824-ef4f-4bb2-9838-55cfdcef11ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:49.879089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17e824-ef4f-4bb2-9838-55cfdcef11ca admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:49.901576 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1249/2512] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:25:49 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:25:49.905773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af48953-3f2c-4a6a-a564-0e24de6de3a0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:49.916316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af48953-3f2c-4a6a-a564-0e24de6de3a0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:49.921471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2af70-e6d7-4617-b170-40a3ccfe7dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:49.922156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2af70-e6d7-4617-b170-40a3ccfe7dae admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:49.922459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2af70-e6d7-4617-b170-40a3ccfe7dae admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:49.922718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2af70-e6d7-4617-b170-40a3ccfe7dae admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:49.923511 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2af70-e6d7-4617-b170-40a3ccfe7dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:49.925211 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2af70-e6d7-4617-b170-40a3ccfe7dae admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:49.937652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1264/2513] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:25:49.941942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17e824-ef4f-4bb2-9838-55cfdcef11ca admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:49.953163 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17e824-ef4f-4bb2-9838-55cfdcef11ca admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:49.958924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a66a6-4339-4935-9bcb-62dd9df70eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:49.959844 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a66a6-4339-4935-9bcb-62dd9df70eac admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:49.960185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a66a6-4339-4935-9bcb-62dd9df70eac admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:49.960541 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a66a6-4339-4935-9bcb-62dd9df70eac admin admin] PATH_INFO: `/v3/projects/757b3ed057e74e95be7cde321fc64da4/users/09c19537ee3b4778b20ca2851ba374b7/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:49.975871 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a66a6-4339-4935-9bcb-62dd9df70eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=757b3ed057e74e95be7cde321fc64da4, user_id=09c19537ee3b4778b20ca2851ba374b7, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:49.978648 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a66a6-4339-4935-9bcb-62dd9df70eac admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:49.993923 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1250/2514] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:25:49 2022] PUT /identity/v3/projects/757b3ed057e74e95be7cde321fc64da4/users/09c19537ee3b4778b20ca2851ba374b7/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:25:49.998020 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2af70-e6d7-4617-b170-40a3ccfe7dae admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:50.008114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2af70-e6d7-4617-b170-40a3ccfe7dae admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:50.069601 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26372b2-ab60-4c72-a702-344aad1c76b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:50.070297 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26372b2-ab60-4c72-a702-344aad1c76b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:50.070576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26372b2-ab60-4c72-a702-344aad1c76b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:50.070849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26372b2-ab60-4c72-a702-344aad1c76b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:50.071780 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26372b2-ab60-4c72-a702-344aad1c76b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:50.073585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26372b2-ab60-4c72-a702-344aad1c76b0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:50.083939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1265/2515] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:25:50.088920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a66a6-4339-4935-9bcb-62dd9df70eac admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:50.099547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a66a6-4339-4935-9bcb-62dd9df70eac admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:50.105047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99df8a-e128-4880-a8cc-f670150ebdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:50.105954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99df8a-e128-4880-a8cc-f670150ebdbf admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:50.106222 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99df8a-e128-4880-a8cc-f670150ebdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:50.106501 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99df8a-e128-4880-a8cc-f670150ebdbf admin admin] PATH_INFO: `/v3/projects/757b3ed057e74e95be7cde321fc64da4/users/09c19537ee3b4778b20ca2851ba374b7/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:50.108550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99df8a-e128-4880-a8cc-f670150ebdbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=757b3ed057e74e95be7cde321fc64da4, user_id=09c19537ee3b4778b20ca2851ba374b7, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:50.111393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99df8a-e128-4880-a8cc-f670150ebdbf admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:50.131031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1251/2516] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:25:50 2022] PUT /identity/v3/projects/757b3ed057e74e95be7cde321fc64da4/users/09c19537ee3b4778b20ca2851ba374b7/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:25:50.141629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531617c-07fd-4831-87f3-a5349fc2d406 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:50.141920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531617c-07fd-4831-87f3-a5349fc2d406 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:50.142195 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531617c-07fd-4831-87f3-a5349fc2d406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:50.170858 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-1531617c-07fd-4831-87f3-a5349fc2d406 None None] MFA Rules not processed for user `09c19537ee3b4778b20ca2851ba374b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:25:50.172079 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1531617c-07fd-4831-87f3-a5349fc2d406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:50.241545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1266/2517] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:25:50 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:25:50.253376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99df8a-e128-4880-a8cc-f670150ebdbf admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:50.255162 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3b99df8a-e128-4880-a8cc-f670150ebdbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:50.282134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:25:50.317412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99df8a-e128-4880-a8cc-f670150ebdbf admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:50.321195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3f572-0de7-4dcc-9a38-ebfa646cfa1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:50.322474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3f572-0de7-4dcc-9a38-ebfa646cfa1d service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:50.322759 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3f572-0de7-4dcc-9a38-ebfa646cfa1d service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:50.323043 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3f572-0de7-4dcc-9a38-ebfa646cfa1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:50.333459 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3f572-0de7-4dcc-9a38-ebfa646cfa1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:50.334902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3f572-0de7-4dcc-9a38-ebfa646cfa1d service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:50.346021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1252/2518] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:25:50 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:25:50.431819 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531617c-07fd-4831-87f3-a5349fc2d406 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:50.442166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531617c-07fd-4831-87f3-a5349fc2d406 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:50.445774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd849def-99cc-4a88-9338-2ee9e85ef2ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:50.446506 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849def-99cc-4a88-9338-2ee9e85ef2ae service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:50.446972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849def-99cc-4a88-9338-2ee9e85ef2ae service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:50.447252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849def-99cc-4a88-9338-2ee9e85ef2ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:50.492569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:25:50.513285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd849def-99cc-4a88-9338-2ee9e85ef2ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:50.514801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd849def-99cc-4a88-9338-2ee9e85ef2ae service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:50.524176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1267/2519] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:25:50 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:25:51.091490 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3f572-0de7-4dcc-9a38-ebfa646cfa1d service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:51.093198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-85a3f572-0de7-4dcc-9a38-ebfa646cfa1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:51.180390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3f572-0de7-4dcc-9a38-ebfa646cfa1d service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:51.185702 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504f9e8-89d4-4c43-8973-332a64e520be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:51.186569 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504f9e8-89d4-4c43-8973-332a64e520be service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:51.187186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504f9e8-89d4-4c43-8973-332a64e520be service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:51.187579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504f9e8-89d4-4c43-8973-332a64e520be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:51.191487 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b504f9e8-89d4-4c43-8973-332a64e520be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:51.288248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504f9e8-89d4-4c43-8973-332a64e520be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:51.291839 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504f9e8-89d4-4c43-8973-332a64e520be service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:51.323855 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1253/2520] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:25:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:25:56.571174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd849def-99cc-4a88-9338-2ee9e85ef2ae service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:25:56.572808 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-bd849def-99cc-4a88-9338-2ee9e85ef2ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:56.585242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd849def-99cc-4a88-9338-2ee9e85ef2ae service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:25:56.588872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7b315-baf8-4eba-89ce-c10e6940a228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:25:56.589534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7b315-baf8-4eba-89ce-c10e6940a228 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:25:56.589818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7b315-baf8-4eba-89ce-c10e6940a228 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:25:56.590091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7b315-baf8-4eba-89ce-c10e6940a228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:25:56.591919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-83d7b315-baf8-4eba-89ce-c10e6940a228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:25:56.659183 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7b315-baf8-4eba-89ce-c10e6940a228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:25:56.660568 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7b315-baf8-4eba-89ce-c10e6940a228 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:25:56.671586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1268/2521] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:00.333282 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504f9e8-89d4-4c43-8973-332a64e520be service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:00.334772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b504f9e8-89d4-4c43-8973-332a64e520be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:00.351884 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504f9e8-89d4-4c43-8973-332a64e520be service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:00.357791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8b26c-4a53-4d02-beaf-29a14abfb24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:00.360122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8b26c-4a53-4d02-beaf-29a14abfb24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:00.361987 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8b26c-4a53-4d02-beaf-29a14abfb24e admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:00.362344 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8b26c-4a53-4d02-beaf-29a14abfb24e admin admin] PATH_INFO: `/v3/users/9d44f1f434534cc0b373943d48d672df` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:00.378304 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8b26c-4a53-4d02-beaf-29a14abfb24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d44f1f434534cc0b373943d48d672df)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:00.380309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8b26c-4a53-4d02-beaf-29a14abfb24e admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:00.427689 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:00.430391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bfe8b26c-4a53-4d02-beaf-29a14abfb24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d44f1f434534cc0b373943d48d672df'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:00.441894 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bfe8b26c-4a53-4d02-beaf-29a14abfb24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d44f1f434534cc0b373943d48d672df'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:00.442859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bfe8b26c-4a53-4d02-beaf-29a14abfb24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d44f1f434534cc0b373943d48d672df'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:00.443713 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bfe8b26c-4a53-4d02-beaf-29a14abfb24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d44f1f434534cc0b373943d48d672df'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:00.459402 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bfe8b26c-4a53-4d02-beaf-29a14abfb24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d44f1f434534cc0b373943d48d672df'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:00.491230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1254/2522] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:00 2022] DELETE /identity/v3/users/9d44f1f434534cc0b373943d48d672df => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:00.688202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7b315-baf8-4eba-89ce-c10e6940a228 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:00.700142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7b315-baf8-4eba-89ce-c10e6940a228 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:00.789913 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66af4c-7c61-4f96-98bb-bd37317b9589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:00.791808 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66af4c-7c61-4f96-98bb-bd37317b9589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:00.792103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66af4c-7c61-4f96-98bb-bd37317b9589 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:00.792399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66af4c-7c61-4f96-98bb-bd37317b9589 admin admin] PATH_INFO: `/v3/projects/5c230554e8a34a7086e433e797360e28` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:00.794414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66af4c-7c61-4f96-98bb-bd37317b9589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c230554e8a34a7086e433e797360e28)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:00.796770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66af4c-7c61-4f96-98bb-bd37317b9589 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:00.881528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4e66af4c-7c61-4f96-98bb-bd37317b9589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c230554e8a34a7086e433e797360e28', 'request_id': 'req-4e66af4c-7c61-4f96-98bb-bd37317b9589'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:00.888462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4e66af4c-7c61-4f96-98bb-bd37317b9589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c230554e8a34a7086e433e797360e28', 'request_id': 'req-4e66af4c-7c61-4f96-98bb-bd37317b9589'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:00.894620 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4e66af4c-7c61-4f96-98bb-bd37317b9589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c230554e8a34a7086e433e797360e28', 'request_id': 'req-4e66af4c-7c61-4f96-98bb-bd37317b9589'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:00.907956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4e66af4c-7c61-4f96-98bb-bd37317b9589 admin admin] The token cache is being invalidate because project 5c230554e8a34a7086e433e797360e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:00.908250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4e66af4c-7c61-4f96-98bb-bd37317b9589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:00.908897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4e66af4c-7c61-4f96-98bb-bd37317b9589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:00.910467 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1269/2523] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:00 2022] DELETE /identity/v3/projects/5c230554e8a34a7086e433e797360e28 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:00.917559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e5b8c-4c4e-49a2-8181-e37a0d7aa499 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:00.917882 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e5b8c-4c4e-49a2-8181-e37a0d7aa499 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:00.918189 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e5b8c-4c4e-49a2-8181-e37a0d7aa499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:00.937063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-501e5b8c-4c4e-49a2-8181-e37a0d7aa499 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:00.938200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-501e5b8c-4c4e-49a2-8181-e37a0d7aa499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:00.997685 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1255/2524] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:01.005736 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c2af-93b8-4c97-8cfa-563a0af0b95d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:01.006016 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c2af-93b8-4c97-8cfa-563a0af0b95d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:01.006292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c2af-93b8-4c97-8cfa-563a0af0b95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:01.013065 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:01.027594 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-5466c2af-93b8-4c97-8cfa-563a0af0b95d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:01.028832 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5466c2af-93b8-4c97-8cfa-563a0af0b95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:01.037824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1270/2525] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:01.042728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e5b8c-4c4e-49a2-8181-e37a0d7aa499 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:01.054063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e5b8c-4c4e-49a2-8181-e37a0d7aa499 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:01.060027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92840-4696-47cc-84e3-b4a13424756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:01.060727 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92840-4696-47cc-84e3-b4a13424756a admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:01.060987 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92840-4696-47cc-84e3-b4a13424756a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:01.061288 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92840-4696-47cc-84e3-b4a13424756a admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:01.062024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92840-4696-47cc-84e3-b4a13424756a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:26:01.062316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92840-4696-47cc-84e3-b4a13424756a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:01.063947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92840-4696-47cc-84e3-b4a13424756a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:01.077020 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1256/2526] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:26:01.081788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466c2af-93b8-4c97-8cfa-563a0af0b95d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:01.091325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466c2af-93b8-4c97-8cfa-563a0af0b95d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:01.097405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399062d2-cdce-40b2-b522-e9ad41da3902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:01.098062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399062d2-cdce-40b2-b522-e9ad41da3902 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:01.098337 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399062d2-cdce-40b2-b522-e9ad41da3902 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:01.098604 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399062d2-cdce-40b2-b522-e9ad41da3902 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:01.099290 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399062d2-cdce-40b2-b522-e9ad41da3902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:01.101405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399062d2-cdce-40b2-b522-e9ad41da3902 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:01.129857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1271/2527] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:01 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:01.134151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92840-4696-47cc-84e3-b4a13424756a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:01.144565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92840-4696-47cc-84e3-b4a13424756a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:01.208583 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e79f3a-1cf1-4a74-b266-97ed5d20ebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:01.209297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e79f3a-1cf1-4a74-b266-97ed5d20ebbb admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:01.209577 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e79f3a-1cf1-4a74-b266-97ed5d20ebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:01.209853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e79f3a-1cf1-4a74-b266-97ed5d20ebbb admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:01.210539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e79f3a-1cf1-4a74-b266-97ed5d20ebbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:01.212790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e79f3a-1cf1-4a74-b266-97ed5d20ebbb admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:01.235236 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1257/2528] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:01 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:01.240552 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399062d2-cdce-40b2-b522-e9ad41da3902 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:01.254354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399062d2-cdce-40b2-b522-e9ad41da3902 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:01.262224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5f57c-d1fb-4d03-8bc8-1baf5855ea73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:01.263366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f57c-d1fb-4d03-8bc8-1baf5855ea73 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:01.263875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f57c-d1fb-4d03-8bc8-1baf5855ea73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:01.264424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f57c-d1fb-4d03-8bc8-1baf5855ea73 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:01.265760 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5f57c-d1fb-4d03-8bc8-1baf5855ea73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:01.268948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5f57c-d1fb-4d03-8bc8-1baf5855ea73 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:01.288715 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1272/2529] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:01.293720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e79f3a-1cf1-4a74-b266-97ed5d20ebbb admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:01.314334 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e79f3a-1cf1-4a74-b266-97ed5d20ebbb admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:01.321298 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17598b-e0bd-4de3-b2d9-14a0e5ca6a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:01.322110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17598b-e0bd-4de3-b2d9-14a0e5ca6a82 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:01.322458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17598b-e0bd-4de3-b2d9-14a0e5ca6a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:01.322813 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17598b-e0bd-4de3-b2d9-14a0e5ca6a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:01.323673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17598b-e0bd-4de3-b2d9-14a0e5ca6a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:01.325486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17598b-e0bd-4de3-b2d9-14a0e5ca6a82 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:01.336840 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1258/2530] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:01.341330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5f57c-d1fb-4d03-8bc8-1baf5855ea73 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:01.351760 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5f57c-d1fb-4d03-8bc8-1baf5855ea73 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:01.357255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eece60-df88-43ec-a5c9-f7ce0e1de868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:01.358147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eece60-df88-43ec-a5c9-f7ce0e1de868 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:01.358428 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eece60-df88-43ec-a5c9-f7ce0e1de868 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:01.358701 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eece60-df88-43ec-a5c9-f7ce0e1de868 admin admin] PATH_INFO: `/v3/projects/b28093d932554f31a9f75babc1df52bb/users/d170cdd708bb4c8b902a3fac4a050795/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:01.375016 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eece60-df88-43ec-a5c9-f7ce0e1de868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28093d932554f31a9f75babc1df52bb, user_id=d170cdd708bb4c8b902a3fac4a050795, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:01.378543 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eece60-df88-43ec-a5c9-f7ce0e1de868 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:01.394555 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1273/2531] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:01 2022] PUT /identity/v3/projects/b28093d932554f31a9f75babc1df52bb/users/d170cdd708bb4c8b902a3fac4a050795/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:01.405928 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd6d35-7433-4233-8ed7-57cdcb8a5418 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:01.406338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd6d35-7433-4233-8ed7-57cdcb8a5418 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:01.406796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd6d35-7433-4233-8ed7-57cdcb8a5418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:01.444620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-90fd6d35-7433-4233-8ed7-57cdcb8a5418 None None] MFA Rules not processed for user `d170cdd708bb4c8b902a3fac4a050795`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:01.445822 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-90fd6d35-7433-4233-8ed7-57cdcb8a5418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:01.468134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:01.534227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1259/2532] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:01.538854 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eece60-df88-43ec-a5c9-f7ce0e1de868 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:01.606302 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eece60-df88-43ec-a5c9-f7ce0e1de868 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:01.612229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141bcf4-6fff-45bc-9dee-773907548c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:01.613039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141bcf4-6fff-45bc-9dee-773907548c5e admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:01.613443 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141bcf4-6fff-45bc-9dee-773907548c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:01.613830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141bcf4-6fff-45bc-9dee-773907548c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:01.614770 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141bcf4-6fff-45bc-9dee-773907548c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:01.616805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141bcf4-6fff-45bc-9dee-773907548c5e admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:01.653711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1274/2533] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:01 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:01.657615 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd6d35-7433-4233-8ed7-57cdcb8a5418 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:01.678802 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd6d35-7433-4233-8ed7-57cdcb8a5418 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:01.742278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2accf95-a2bc-4387-8e15-ef1d65e7fe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:01.742969 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2accf95-a2bc-4387-8e15-ef1d65e7fe9d admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:01.743934 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2accf95-a2bc-4387-8e15-ef1d65e7fe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:01.744234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2accf95-a2bc-4387-8e15-ef1d65e7fe9d admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:01.745018 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2accf95-a2bc-4387-8e15-ef1d65e7fe9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:01.747007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2accf95-a2bc-4387-8e15-ef1d65e7fe9d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:01.772682 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1260/2534] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:01 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:01.777747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141bcf4-6fff-45bc-9dee-773907548c5e admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:01.788743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141bcf4-6fff-45bc-9dee-773907548c5e admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:01.794019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45612b2e-2588-4791-8692-ffff730908aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:01.794704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45612b2e-2588-4791-8692-ffff730908aa admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:01.794997 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45612b2e-2588-4791-8692-ffff730908aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:01.795280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45612b2e-2588-4791-8692-ffff730908aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:01.796026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45612b2e-2588-4791-8692-ffff730908aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:01.797699 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45612b2e-2588-4791-8692-ffff730908aa admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:01.810132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1275/2535] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:01.814811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2accf95-a2bc-4387-8e15-ef1d65e7fe9d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:01.825431 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2accf95-a2bc-4387-8e15-ef1d65e7fe9d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:01.830502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804f86d-55cd-4328-ba34-9e910b066646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:01.831387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804f86d-55cd-4328-ba34-9e910b066646 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:01.831668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804f86d-55cd-4328-ba34-9e910b066646 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:01.831938 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804f86d-55cd-4328-ba34-9e910b066646 admin admin] PATH_INFO: `/v3/projects/edc3fa45914b4d9abca73313e434722e/users/9502cefd9cc04eb1b510fe0dc9cd520d/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:01.847390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804f86d-55cd-4328-ba34-9e910b066646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc3fa45914b4d9abca73313e434722e, user_id=9502cefd9cc04eb1b510fe0dc9cd520d, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:01.850058 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804f86d-55cd-4328-ba34-9e910b066646 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:01.865594 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1261/2536] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:01 2022] PUT /identity/v3/projects/edc3fa45914b4d9abca73313e434722e/users/9502cefd9cc04eb1b510fe0dc9cd520d/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:01.869983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45612b2e-2588-4791-8692-ffff730908aa admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:01.883168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45612b2e-2588-4791-8692-ffff730908aa admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:01.950937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da5c8c-c646-4f4c-b8fd-889396a7c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:01.951546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da5c8c-c646-4f4c-b8fd-889396a7c110 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:01.951834 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da5c8c-c646-4f4c-b8fd-889396a7c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:01.952108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da5c8c-c646-4f4c-b8fd-889396a7c110 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:01.952887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da5c8c-c646-4f4c-b8fd-889396a7c110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:01.954819 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da5c8c-c646-4f4c-b8fd-889396a7c110 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:01.965690 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1276/2537] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:01.970150 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804f86d-55cd-4328-ba34-9e910b066646 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:01.981165 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804f86d-55cd-4328-ba34-9e910b066646 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:01.986577 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdf526-019f-4452-95b1-345ab730983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:01.987480 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdf526-019f-4452-95b1-345ab730983e admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:01.987879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdf526-019f-4452-95b1-345ab730983e admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:01.988160 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdf526-019f-4452-95b1-345ab730983e admin admin] PATH_INFO: `/v3/projects/edc3fa45914b4d9abca73313e434722e/users/9502cefd9cc04eb1b510fe0dc9cd520d/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:01.990226 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdf526-019f-4452-95b1-345ab730983e admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc3fa45914b4d9abca73313e434722e, user_id=9502cefd9cc04eb1b510fe0dc9cd520d, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:01.993019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdf526-019f-4452-95b1-345ab730983e admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:02.004737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1262/2538] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:01 2022] PUT /identity/v3/projects/edc3fa45914b4d9abca73313e434722e/users/9502cefd9cc04eb1b510fe0dc9cd520d/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:02.017072 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4664cd-5149-4a15-be39-1df257bfea05 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:02.017437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4664cd-5149-4a15-be39-1df257bfea05 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:02.017782 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4664cd-5149-4a15-be39-1df257bfea05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:02.056015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:02.071699 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-4f4664cd-5149-4a15-be39-1df257bfea05 None None] MFA Rules not processed for user `9502cefd9cc04eb1b510fe0dc9cd520d`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:02.073140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4f4664cd-5149-4a15-be39-1df257bfea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:02.148018 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1277/2539] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:02 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:02.163711 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdf526-019f-4452-95b1-345ab730983e admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:02.166004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-26cdf526-019f-4452-95b1-345ab730983e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:02.229102 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdf526-019f-4452-95b1-345ab730983e admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:02.233712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5e650-4a38-487d-9029-3c7deb378779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:02.234565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5e650-4a38-487d-9029-3c7deb378779 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:02.234847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5e650-4a38-487d-9029-3c7deb378779 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:02.235126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5e650-4a38-487d-9029-3c7deb378779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:02.247112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5e650-4a38-487d-9029-3c7deb378779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:02.248641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5e650-4a38-487d-9029-3c7deb378779 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:02.261142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1263/2540] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:02.684695 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4664cd-5149-4a15-be39-1df257bfea05 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:02.754118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4664cd-5149-4a15-be39-1df257bfea05 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:02.759094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7713a-5766-49e5-942e-5b452ab0a3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:02.759968 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7713a-5766-49e5-942e-5b452ab0a3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:02.760240 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7713a-5766-49e5-942e-5b452ab0a3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:02.760546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7713a-5766-49e5-942e-5b452ab0a3d3 admin admin] PATH_INFO: `/v3/users/d170cdd708bb4c8b902a3fac4a050795` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:02.761789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7713a-5766-49e5-942e-5b452ab0a3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d170cdd708bb4c8b902a3fac4a050795)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:02.763720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7713a-5766-49e5-942e-5b452ab0a3d3 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:02.816023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-5ea7713a-5766-49e5-942e-5b452ab0a3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd170cdd708bb4c8b902a3fac4a050795'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:02.823833 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-5ea7713a-5766-49e5-942e-5b452ab0a3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd170cdd708bb4c8b902a3fac4a050795'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:02.824582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-5ea7713a-5766-49e5-942e-5b452ab0a3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd170cdd708bb4c8b902a3fac4a050795'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:02.825223 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-5ea7713a-5766-49e5-942e-5b452ab0a3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd170cdd708bb4c8b902a3fac4a050795'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:02.835648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-5ea7713a-5766-49e5-942e-5b452ab0a3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd170cdd708bb4c8b902a3fac4a050795'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:02.856616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1278/2541] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:02 2022] DELETE /identity/v3/users/d170cdd708bb4c8b902a3fac4a050795 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:02.861273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f690cde-8324-49c1-97c2-5f05a7c85ee3 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:02.861756 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f690cde-8324-49c1-97c2-5f05a7c85ee3 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:02.861896 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f690cde-8324-49c1-97c2-5f05a7c85ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:02.884579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-4f690cde-8324-49c1-97c2-5f05a7c85ee3 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:02.885948 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4f690cde-8324-49c1-97c2-5f05a7c85ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:02.895254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:02.951701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1264/2542] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:02.962500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7713a-5766-49e5-942e-5b452ab0a3d3 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:02.964670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5ea7713a-5766-49e5-942e-5b452ab0a3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:02.983449 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:03.030242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7713a-5766-49e5-942e-5b452ab0a3d3 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:03.033906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8da77e-09e9-40b6-b790-68415f429504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:03.034571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8da77e-09e9-40b6-b790-68415f429504 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:03.034861 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8da77e-09e9-40b6-b790-68415f429504 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:03.035123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8da77e-09e9-40b6-b790-68415f429504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:03.044617 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8da77e-09e9-40b6-b790-68415f429504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:03.046099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8da77e-09e9-40b6-b790-68415f429504 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:03.060107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1279/2543] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:03.453271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f690cde-8324-49c1-97c2-5f05a7c85ee3 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:03.455280 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4f690cde-8324-49c1-97c2-5f05a7c85ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:03.469352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f690cde-8324-49c1-97c2-5f05a7c85ee3 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:03.485434 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:03.486331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:03.486680 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:03.486922 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] PATH_INFO: `/v3/projects/b28093d932554f31a9f75babc1df52bb` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:03.488357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28093d932554f31a9f75babc1df52bb)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:03.490241 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:03.537873 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28093d932554f31a9f75babc1df52bb', 'request_id': 'req-4ab976f3-bb56-4b0e-835b-666b37efed08'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:03.543479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28093d932554f31a9f75babc1df52bb', 'request_id': 'req-4ab976f3-bb56-4b0e-835b-666b37efed08'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:03.549773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28093d932554f31a9f75babc1df52bb', 'request_id': 'req-4ab976f3-bb56-4b0e-835b-666b37efed08'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:03.564200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] The token cache is being invalidate because project b28093d932554f31a9f75babc1df52bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:03.564530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:03.565124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:03.566757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1265/2544] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:03 2022] DELETE /identity/v3/projects/b28093d932554f31a9f75babc1df52bb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:03.570959 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8da77e-09e9-40b6-b790-68415f429504 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:03.581585 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8da77e-09e9-40b6-b790-68415f429504 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:03.637674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d23a0-5f99-4e2d-bc1a-643949d45256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:03.638570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d23a0-5f99-4e2d-bc1a-643949d45256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:03.638849 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d23a0-5f99-4e2d-bc1a-643949d45256 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:03.639125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d23a0-5f99-4e2d-bc1a-643949d45256 admin admin] PATH_INFO: `/v3/users/9502cefd9cc04eb1b510fe0dc9cd520d` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:03.640375 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d23a0-5f99-4e2d-bc1a-643949d45256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9502cefd9cc04eb1b510fe0dc9cd520d)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:03.642325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d23a0-5f99-4e2d-bc1a-643949d45256 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:03.690535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-fd3d23a0-5f99-4e2d-bc1a-643949d45256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9502cefd9cc04eb1b510fe0dc9cd520d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:03.697903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-fd3d23a0-5f99-4e2d-bc1a-643949d45256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9502cefd9cc04eb1b510fe0dc9cd520d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:03.698625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-fd3d23a0-5f99-4e2d-bc1a-643949d45256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9502cefd9cc04eb1b510fe0dc9cd520d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:03.699283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-fd3d23a0-5f99-4e2d-bc1a-643949d45256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9502cefd9cc04eb1b510fe0dc9cd520d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:03.707543 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-fd3d23a0-5f99-4e2d-bc1a-643949d45256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9502cefd9cc04eb1b510fe0dc9cd520d'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:03.726230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1280/2545] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:03 2022] DELETE /identity/v3/users/9502cefd9cc04eb1b510fe0dc9cd520d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:04.001117 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:04.003151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:04.018148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab976f3-bb56-4b0e-835b-666b37efed08 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:04.078412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a048813-6b53-4ad4-ba05-0466118894c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:04.079600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a048813-6b53-4ad4-ba05-0466118894c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:04.079885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a048813-6b53-4ad4-ba05-0466118894c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:04.080218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a048813-6b53-4ad4-ba05-0466118894c9 admin admin] PATH_INFO: `/v3/projects/edc3fa45914b4d9abca73313e434722e` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:04.081437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a048813-6b53-4ad4-ba05-0466118894c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc3fa45914b4d9abca73313e434722e)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:04.083411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a048813-6b53-4ad4-ba05-0466118894c9 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:04.140790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:04.147585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6a048813-6b53-4ad4-ba05-0466118894c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc3fa45914b4d9abca73313e434722e', 'request_id': 'req-6a048813-6b53-4ad4-ba05-0466118894c9'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:04.154478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6a048813-6b53-4ad4-ba05-0466118894c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc3fa45914b4d9abca73313e434722e', 'request_id': 'req-6a048813-6b53-4ad4-ba05-0466118894c9'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:04.161051 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6a048813-6b53-4ad4-ba05-0466118894c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc3fa45914b4d9abca73313e434722e', 'request_id': 'req-6a048813-6b53-4ad4-ba05-0466118894c9'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:04.180670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6a048813-6b53-4ad4-ba05-0466118894c9 admin admin] The token cache is being invalidate because project edc3fa45914b4d9abca73313e434722e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:04.180980 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6a048813-6b53-4ad4-ba05-0466118894c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:04.181858 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6a048813-6b53-4ad4-ba05-0466118894c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:04.184485 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1266/2546] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:03 2022] DELETE /identity/v3/projects/edc3fa45914b4d9abca73313e434722e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:04.188465 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111afb-5cc3-4a0b-904c-838baf47811b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:04.188990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111afb-5cc3-4a0b-904c-838baf47811b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:04.189083 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111afb-5cc3-4a0b-904c-838baf47811b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:04.209709 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-73111afb-5cc3-4a0b-904c-838baf47811b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:04.211016 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-73111afb-5cc3-4a0b-904c-838baf47811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:04.266348 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:04.307872 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1281/2547] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:04.315869 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b701f42-5b00-4225-8d3e-0515759e2e1b None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:04.316411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b701f42-5b00-4225-8d3e-0515759e2e1b None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:04.318673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b701f42-5b00-4225-8d3e-0515759e2e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:04.343612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-9b701f42-5b00-4225-8d3e-0515759e2e1b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:04.344825 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9b701f42-5b00-4225-8d3e-0515759e2e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:04.365452 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1267/2548] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:04.370656 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73111afb-5cc3-4a0b-904c-838baf47811b None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:04.386517 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73111afb-5cc3-4a0b-904c-838baf47811b None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:04.392244 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecb9cf-e899-4b75-b9f3-8e6bab903463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:04.393577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecb9cf-e899-4b75-b9f3-8e6bab903463 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:04.393941 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecb9cf-e899-4b75-b9f3-8e6bab903463 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:04.394425 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecb9cf-e899-4b75-b9f3-8e6bab903463 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:04.395561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecb9cf-e899-4b75-b9f3-8e6bab903463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:26:04.395931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecb9cf-e899-4b75-b9f3-8e6bab903463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:04.398103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecb9cf-e899-4b75-b9f3-8e6bab903463 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:04.427069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1282/2549] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:26:04.435102 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b701f42-5b00-4225-8d3e-0515759e2e1b None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:04.444960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b701f42-5b00-4225-8d3e-0515759e2e1b None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:04.452960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c445d9-11e1-4b45-9c14-11338fc7d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:04.453923 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c445d9-11e1-4b45-9c14-11338fc7d485 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:04.454207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c445d9-11e1-4b45-9c14-11338fc7d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:04.454490 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c445d9-11e1-4b45-9c14-11338fc7d485 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:04.455382 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c445d9-11e1-4b45-9c14-11338fc7d485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:04.457483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c445d9-11e1-4b45-9c14-11338fc7d485 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:04.490781 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1268/2550] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:04 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:04.495096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecb9cf-e899-4b75-b9f3-8e6bab903463 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:04.506143 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecb9cf-e899-4b75-b9f3-8e6bab903463 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:04.601237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186651a3-ab3c-4be0-93a9-add106ec558b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:04.602027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186651a3-ab3c-4be0-93a9-add106ec558b admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:04.602450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186651a3-ab3c-4be0-93a9-add106ec558b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:04.602815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186651a3-ab3c-4be0-93a9-add106ec558b admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:04.603626 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186651a3-ab3c-4be0-93a9-add106ec558b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:04.606669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186651a3-ab3c-4be0-93a9-add106ec558b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:04.643297 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1283/2551] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:04 2022] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:04.644597 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c445d9-11e1-4b45-9c14-11338fc7d485 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:04.658778 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c445d9-11e1-4b45-9c14-11338fc7d485 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:04.673793 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be5fe1-c824-4673-b98d-2ddd1dece5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:04.674814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be5fe1-c824-4673-b98d-2ddd1dece5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:04.675106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be5fe1-c824-4673-b98d-2ddd1dece5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:04.675441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be5fe1-c824-4673-b98d-2ddd1dece5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:04.676203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be5fe1-c824-4673-b98d-2ddd1dece5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:04.677909 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be5fe1-c824-4673-b98d-2ddd1dece5b8 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:04.692896 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1269/2552] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:04.696854 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186651a3-ab3c-4be0-93a9-add106ec558b admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:04.707433 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186651a3-ab3c-4be0-93a9-add106ec558b admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:04.713625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94848e8b-a8f2-47fa-b868-106f4c432d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:04.714308 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94848e8b-a8f2-47fa-b868-106f4c432d59 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:04.715667 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94848e8b-a8f2-47fa-b868-106f4c432d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:04.715667 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94848e8b-a8f2-47fa-b868-106f4c432d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:04.715667 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94848e8b-a8f2-47fa-b868-106f4c432d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:04.717248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94848e8b-a8f2-47fa-b868-106f4c432d59 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:04.729947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1284/2553] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:04.734053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be5fe1-c824-4673-b98d-2ddd1dece5b8 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:04.746215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be5fe1-c824-4673-b98d-2ddd1dece5b8 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:04.751684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85cbd3-08f8-41d6-b414-134e37e5ce47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:04.752646 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85cbd3-08f8-41d6-b414-134e37e5ce47 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:04.752932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85cbd3-08f8-41d6-b414-134e37e5ce47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:04.753213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85cbd3-08f8-41d6-b414-134e37e5ce47 admin admin] PATH_INFO: `/v3/projects/d5070b4e34a84d9ab8b9caab23200ace/users/2d3a2e2e915541498587254ff3440cb4/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:04.773362 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85cbd3-08f8-41d6-b414-134e37e5ce47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5070b4e34a84d9ab8b9caab23200ace, user_id=2d3a2e2e915541498587254ff3440cb4, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:04.776304 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85cbd3-08f8-41d6-b414-134e37e5ce47 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:04.797445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1270/2554] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:04 2022] PUT /identity/v3/projects/d5070b4e34a84d9ab8b9caab23200ace/users/2d3a2e2e915541498587254ff3440cb4/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:04.860890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3ad7e-bbc5-442d-ba3d-87a796f2d6dd None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:04.861166 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3ad7e-bbc5-442d-ba3d-87a796f2d6dd None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:04.861442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3ad7e-bbc5-442d-ba3d-87a796f2d6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:04.890224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-36d3ad7e-bbc5-442d-ba3d-87a796f2d6dd None None] MFA Rules not processed for user `2d3a2e2e915541498587254ff3440cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:04.891956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-36d3ad7e-bbc5-442d-ba3d-87a796f2d6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:04.975574 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1285/2555] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:04.984187 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85cbd3-08f8-41d6-b414-134e37e5ce47 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:05.060912 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85cbd3-08f8-41d6-b414-134e37e5ce47 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:05.068389 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83727349-dd9e-4ca4-8e17-841351f98f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:05.068772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83727349-dd9e-4ca4-8e17-841351f98f67 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:05.069575 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83727349-dd9e-4ca4-8e17-841351f98f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:05.069575 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83727349-dd9e-4ca4-8e17-841351f98f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:05.070368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83727349-dd9e-4ca4-8e17-841351f98f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:05.073158 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83727349-dd9e-4ca4-8e17-841351f98f67 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:05.109848 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1271/2556] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:04 2022] POST /identity/v3/projects => generated 363 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:05.113915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3ad7e-bbc5-442d-ba3d-87a796f2d6dd None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:05.126569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3ad7e-bbc5-442d-ba3d-87a796f2d6dd None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:05.157416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:05.186711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f15f-90fd-4983-84ef-2171ca8c23af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:05.187501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f15f-90fd-4983-84ef-2171ca8c23af admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:05.187927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f15f-90fd-4983-84ef-2171ca8c23af admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:05.188211 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f15f-90fd-4983-84ef-2171ca8c23af admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:05.188950 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4f15f-90fd-4983-84ef-2171ca8c23af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:05.190905 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4f15f-90fd-4983-84ef-2171ca8c23af admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:05.212612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1286/2557] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:05 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:05.216436 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83727349-dd9e-4ca4-8e17-841351f98f67 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:05.226942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83727349-dd9e-4ca4-8e17-841351f98f67 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:05.232046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf4cca-2355-4e57-8e45-7c32794efa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:05.232893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf4cca-2355-4e57-8e45-7c32794efa61 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:05.233212 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf4cca-2355-4e57-8e45-7c32794efa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:05.233578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf4cca-2355-4e57-8e45-7c32794efa61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:05.234229 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf4cca-2355-4e57-8e45-7c32794efa61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:05.235855 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf4cca-2355-4e57-8e45-7c32794efa61 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:05.247015 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1272/2558] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:26:05.251689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f15f-90fd-4983-84ef-2171ca8c23af admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:05.262903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f15f-90fd-4983-84ef-2171ca8c23af admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:05.268553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ff474-8799-4dba-a45e-f9b4f7a81cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:05.269460 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ff474-8799-4dba-a45e-f9b4f7a81cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:05.269742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ff474-8799-4dba-a45e-f9b4f7a81cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:05.270017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ff474-8799-4dba-a45e-f9b4f7a81cbb admin admin] PATH_INFO: `/v3/projects/d096bf69c1ac449e8f58455a3ae2d2af/users/b1d7b4c963044954be09540fbcf4d61b/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:05.286341 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ff474-8799-4dba-a45e-f9b4f7a81cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d096bf69c1ac449e8f58455a3ae2d2af, user_id=b1d7b4c963044954be09540fbcf4d61b, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:05.289137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ff474-8799-4dba-a45e-f9b4f7a81cbb admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:05.306862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1287/2559] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:05 2022] PUT /identity/v3/projects/d096bf69c1ac449e8f58455a3ae2d2af/users/b1d7b4c963044954be09540fbcf4d61b/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:05.310881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf4cca-2355-4e57-8e45-7c32794efa61 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:05.322352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf4cca-2355-4e57-8e45-7c32794efa61 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:05.365957 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:05.393641 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6986bf-590c-41a4-9d62-d775e79b11d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:05.394328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6986bf-590c-41a4-9d62-d775e79b11d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:05.394628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6986bf-590c-41a4-9d62-d775e79b11d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:05.394885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6986bf-590c-41a4-9d62-d775e79b11d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:05.395623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6986bf-590c-41a4-9d62-d775e79b11d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:05.397699 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6986bf-590c-41a4-9d62-d775e79b11d3 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:05.408830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1273/2560] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:05.413133 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ff474-8799-4dba-a45e-f9b4f7a81cbb admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:05.424491 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ff474-8799-4dba-a45e-f9b4f7a81cbb admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:05.430477 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126d2e9-367f-421b-937b-85651f1c060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:05.432118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126d2e9-367f-421b-937b-85651f1c060d admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:05.432437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126d2e9-367f-421b-937b-85651f1c060d admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:05.432720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126d2e9-367f-421b-937b-85651f1c060d admin admin] PATH_INFO: `/v3/projects/d096bf69c1ac449e8f58455a3ae2d2af/users/b1d7b4c963044954be09540fbcf4d61b/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:05.434784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126d2e9-367f-421b-937b-85651f1c060d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d096bf69c1ac449e8f58455a3ae2d2af, user_id=b1d7b4c963044954be09540fbcf4d61b, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:05.437499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126d2e9-367f-421b-937b-85651f1c060d admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:05.449707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1288/2561] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:05 2022] PUT /identity/v3/projects/d096bf69c1ac449e8f58455a3ae2d2af/users/b1d7b4c963044954be09540fbcf4d61b/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:05.460426 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c0801-6ecd-43c0-bc03-9e5e27d83497 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:05.460812 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c0801-6ecd-43c0-bc03-9e5e27d83497 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:05.461162 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c0801-6ecd-43c0-bc03-9e5e27d83497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:05.497091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-714c0801-6ecd-43c0-bc03-9e5e27d83497 None None] MFA Rules not processed for user `b1d7b4c963044954be09540fbcf4d61b`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:05.498316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-714c0801-6ecd-43c0-bc03-9e5e27d83497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:05.577843 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1274/2562] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:05 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:05.590178 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126d2e9-367f-421b-937b-85651f1c060d admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:05.592019 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5126d2e9-367f-421b-937b-85651f1c060d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:05.658300 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126d2e9-367f-421b-937b-85651f1c060d admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:05.663253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2ee22-c2eb-4b76-be67-fdfa1907c3a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:05.663996 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2ee22-c2eb-4b76-be67-fdfa1907c3a0 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:05.664274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2ee22-c2eb-4b76-be67-fdfa1907c3a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:05.664572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2ee22-c2eb-4b76-be67-fdfa1907c3a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:05.675090 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2ee22-c2eb-4b76-be67-fdfa1907c3a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:05.676812 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2ee22-c2eb-4b76-be67-fdfa1907c3a0 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:05.691273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1289/2563] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:05 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:26:05.970841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c0801-6ecd-43c0-bc03-9e5e27d83497 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:05.972327 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-714c0801-6ecd-43c0-bc03-9e5e27d83497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:06.036782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c0801-6ecd-43c0-bc03-9e5e27d83497 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:06.041484 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25e5a4-4e56-4211-8b22-220787a6ec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:06.042362 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25e5a4-4e56-4211-8b22-220787a6ec15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:06.042640 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25e5a4-4e56-4211-8b22-220787a6ec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:06.042910 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25e5a4-4e56-4211-8b22-220787a6ec15 admin admin] PATH_INFO: `/v3/users/6c9fe5dce1a640ab83b2bb392d97c01f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:06.044153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25e5a4-4e56-4211-8b22-220787a6ec15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9fe5dce1a640ab83b2bb392d97c01f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:06.046134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25e5a4-4e56-4211-8b22-220787a6ec15 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:06.097295 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-3f25e5a4-4e56-4211-8b22-220787a6ec15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9fe5dce1a640ab83b2bb392d97c01f'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.104917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-3f25e5a4-4e56-4211-8b22-220787a6ec15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9fe5dce1a640ab83b2bb392d97c01f'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.105623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-3f25e5a4-4e56-4211-8b22-220787a6ec15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9fe5dce1a640ab83b2bb392d97c01f'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.106266 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-3f25e5a4-4e56-4211-8b22-220787a6ec15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9fe5dce1a640ab83b2bb392d97c01f'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.113011 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2ee22-c2eb-4b76-be67-fdfa1907c3a0 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:06.114070 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:06.119180 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-3f25e5a4-4e56-4211-8b22-220787a6ec15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9fe5dce1a640ab83b2bb392d97c01f'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.124710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2ee22-c2eb-4b76-be67-fdfa1907c3a0 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:06.129632 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb62bf-f309-41cb-bbf5-81f93d7a2101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:06.130569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb62bf-f309-41cb-bbf5-81f93d7a2101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:06.130847 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb62bf-f309-41cb-bbf5-81f93d7a2101 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:06.131130 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb62bf-f309-41cb-bbf5-81f93d7a2101 admin admin] PATH_INFO: `/v3/users/2d3a2e2e915541498587254ff3440cb4` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:06.132338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb62bf-f309-41cb-bbf5-81f93d7a2101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d3a2e2e915541498587254ff3440cb4)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:06.134389 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb62bf-f309-41cb-bbf5-81f93d7a2101 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:06.137650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1275/2564] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:05 2022] DELETE /identity/v3/users/6c9fe5dce1a640ab83b2bb392d97c01f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:06.141919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6377e3-84f1-43f3-8024-3e85da4e4575 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:06.142206 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6377e3-84f1-43f3-8024-3e85da4e4575 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:06.142481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6377e3-84f1-43f3-8024-3e85da4e4575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:06.158976 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-bf6377e3-84f1-43f3-8024-3e85da4e4575 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:06.160110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-bf6377e3-84f1-43f3-8024-3e85da4e4575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:06.182724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6ceb62bf-f309-41cb-bbf5-81f93d7a2101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d3a2e2e915541498587254ff3440cb4'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.194688 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6ceb62bf-f309-41cb-bbf5-81f93d7a2101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d3a2e2e915541498587254ff3440cb4'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.195394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6ceb62bf-f309-41cb-bbf5-81f93d7a2101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d3a2e2e915541498587254ff3440cb4'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.196192 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6ceb62bf-f309-41cb-bbf5-81f93d7a2101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d3a2e2e915541498587254ff3440cb4'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.205568 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6ceb62bf-f309-41cb-bbf5-81f93d7a2101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d3a2e2e915541498587254ff3440cb4'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.219354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:06.225361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1290/2565] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:06 2022] DELETE /identity/v3/users/2d3a2e2e915541498587254ff3440cb4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:06.229947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1276/2566] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:06.230098 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74191dba-cd0d-44e2-8809-c2a01f5b575c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:06.230229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74191dba-cd0d-44e2-8809-c2a01f5b575c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:06.230566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74191dba-cd0d-44e2-8809-c2a01f5b575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:06.240283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6377e3-84f1-43f3-8024-3e85da4e4575 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:06.241698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-bf6377e3-84f1-43f3-8024-3e85da4e4575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:06.249096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-74191dba-cd0d-44e2-8809-c2a01f5b575c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:06.250339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-74191dba-cd0d-44e2-8809-c2a01f5b575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:06.301690 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6377e3-84f1-43f3-8024-3e85da4e4575 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:06.313857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1291/2567] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:06.324250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74191dba-cd0d-44e2-8809-c2a01f5b575c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:06.355681 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be87b7-c08d-4924-961d-16ef6df297e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:06.356308 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be87b7-c08d-4924-961d-16ef6df297e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:06.356619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be87b7-c08d-4924-961d-16ef6df297e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:06.356886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be87b7-c08d-4924-961d-16ef6df297e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:06.366190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be87b7-c08d-4924-961d-16ef6df297e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:06.367707 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be87b7-c08d-4924-961d-16ef6df297e7 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:06.377721 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1277/2568] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:26:06.379474 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74191dba-cd0d-44e2-8809-c2a01f5b575c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:06.383257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ee43f-c50d-4710-931e-fbd8ace56daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:06.383962 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ee43f-c50d-4710-931e-fbd8ace56daf service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:06.384244 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ee43f-c50d-4710-931e-fbd8ace56daf service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:06.384556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ee43f-c50d-4710-931e-fbd8ace56daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:06.394949 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ee43f-c50d-4710-931e-fbd8ace56daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:06.396457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ee43f-c50d-4710-931e-fbd8ace56daf service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:06.406783 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1292/2569] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:26:06.756089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be87b7-c08d-4924-961d-16ef6df297e7 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:06.757582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e3be87b7-c08d-4924-961d-16ef6df297e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:06.772830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be87b7-c08d-4924-961d-16ef6df297e7 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:06.781429 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:06.782321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:06.782725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:06.782878 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] PATH_INFO: `/v3/projects/61af108da54e49f7b4f800f9ae529963` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:06.784132 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61af108da54e49f7b4f800f9ae529963)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:06.786298 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:06.809002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ee43f-c50d-4710-931e-fbd8ace56daf service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:06.810925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3d1ee43f-c50d-4710-931e-fbd8ace56daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:06.826241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ee43f-c50d-4710-931e-fbd8ace56daf service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:06.832549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:06.833614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:06.835026 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:06.835871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:06.836608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] PATH_INFO: `/v3/projects/d5070b4e34a84d9ab8b9caab23200ace` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:06.838036 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5070b4e34a84d9ab8b9caab23200ace)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:06.840204 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:06.852057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61af108da54e49f7b4f800f9ae529963', 'request_id': 'req-5c38773d-e600-4d74-90e2-bbaa67269bf0'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.859118 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61af108da54e49f7b4f800f9ae529963', 'request_id': 'req-5c38773d-e600-4d74-90e2-bbaa67269bf0'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.869160 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61af108da54e49f7b4f800f9ae529963', 'request_id': 'req-5c38773d-e600-4d74-90e2-bbaa67269bf0'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.886996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] The token cache is being invalidate because project 61af108da54e49f7b4f800f9ae529963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:06.887375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.888050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.889738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1278/2570] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:06 2022] DELETE /identity/v3/projects/61af108da54e49f7b4f800f9ae529963 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:06.893745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:06.895248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:06.897189 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5070b4e34a84d9ab8b9caab23200ace', 'request_id': 'req-ccb01b5a-0d52-4753-87da-2ee91b34002c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.903557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5070b4e34a84d9ab8b9caab23200ace', 'request_id': 'req-ccb01b5a-0d52-4753-87da-2ee91b34002c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.909522 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5070b4e34a84d9ab8b9caab23200ace', 'request_id': 'req-ccb01b5a-0d52-4753-87da-2ee91b34002c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.925108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] The token cache is being invalidate because project d5070b4e34a84d9ab8b9caab23200ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:06.925396 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.926004 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:06.927597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1293/2571] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:06 2022] DELETE /identity/v3/projects/d5070b4e34a84d9ab8b9caab23200ace => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:06.931571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:06.933061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:06.962037 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:06.965532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38773d-e600-4d74-90e2-bbaa67269bf0 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:07.000657 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb01b5a-0d52-4753-87da-2ee91b34002c admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:07.005285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f223ee-5689-4a96-81a2-d2aaf9a498f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:07.006161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f223ee-5689-4a96-81a2-d2aaf9a498f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.006437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f223ee-5689-4a96-81a2-d2aaf9a498f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.006709 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f223ee-5689-4a96-81a2-d2aaf9a498f3 admin admin] PATH_INFO: `/v3/users/b1d7b4c963044954be09540fbcf4d61b` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.007883 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f223ee-5689-4a96-81a2-d2aaf9a498f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d7b4c963044954be09540fbcf4d61b)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:07.010008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f223ee-5689-4a96-81a2-d2aaf9a498f3 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:07.022394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a8a09-478b-4867-ab50-9db73b919750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:07.023374 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a8a09-478b-4867-ab50-9db73b919750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.023723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a8a09-478b-4867-ab50-9db73b919750 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.024026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a8a09-478b-4867-ab50-9db73b919750 admin admin] PATH_INFO: `/v3/users/09c19537ee3b4778b20ca2851ba374b7` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.025878 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a8a09-478b-4867-ab50-9db73b919750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c19537ee3b4778b20ca2851ba374b7)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:07.027892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a8a09-478b-4867-ab50-9db73b919750 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:07.063567 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-14f223ee-5689-4a96-81a2-d2aaf9a498f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d7b4c963044954be09540fbcf4d61b'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.071501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-14f223ee-5689-4a96-81a2-d2aaf9a498f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d7b4c963044954be09540fbcf4d61b'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.072375 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-14f223ee-5689-4a96-81a2-d2aaf9a498f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d7b4c963044954be09540fbcf4d61b'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.073156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-14f223ee-5689-4a96-81a2-d2aaf9a498f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d7b4c963044954be09540fbcf4d61b'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.075711 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-161a8a09-478b-4867-ab50-9db73b919750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c19537ee3b4778b20ca2851ba374b7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.082454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-14f223ee-5689-4a96-81a2-d2aaf9a498f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d7b4c963044954be09540fbcf4d61b'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.084064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-161a8a09-478b-4867-ab50-9db73b919750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c19537ee3b4778b20ca2851ba374b7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.084992 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-161a8a09-478b-4867-ab50-9db73b919750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c19537ee3b4778b20ca2851ba374b7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.085840 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-161a8a09-478b-4867-ab50-9db73b919750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c19537ee3b4778b20ca2851ba374b7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.094143 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-161a8a09-478b-4867-ab50-9db73b919750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c19537ee3b4778b20ca2851ba374b7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.099884 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:07.101558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1294/2572] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:06 2022] DELETE /identity/v3/users/b1d7b4c963044954be09540fbcf4d61b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:07.116206 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1279/2573] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:06 2022] DELETE /identity/v3/users/09c19537ee3b4778b20ca2851ba374b7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:07.391596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f223ee-5689-4a96-81a2-d2aaf9a498f3 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:07.393121 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a8a09-478b-4867-ab50-9db73b919750 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:07.393452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-14f223ee-5689-4a96-81a2-d2aaf9a498f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:07.394740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-161a8a09-478b-4867-ab50-9db73b919750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:07.469592 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f223ee-5689-4a96-81a2-d2aaf9a498f3 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:07.484619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a8a09-478b-4867-ab50-9db73b919750 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:07.489418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:07.490287 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.490566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.490834 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a admin admin] PATH_INFO: `/v3/projects/757b3ed057e74e95be7cde321fc64da4` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.491997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=757b3ed057e74e95be7cde321fc64da4)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:07.494331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:07.520411 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:07.533459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:07.534475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.536111 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.536421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e admin admin] PATH_INFO: `/v3/projects/d096bf69c1ac449e8f58455a3ae2d2af` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.537703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d096bf69c1ac449e8f58455a3ae2d2af)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:07.539632 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:07.543069 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '757b3ed057e74e95be7cde321fc64da4', 'request_id': 'req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.548659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '757b3ed057e74e95be7cde321fc64da4', 'request_id': 'req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.555086 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '757b3ed057e74e95be7cde321fc64da4', 'request_id': 'req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.568732 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a admin admin] The token cache is being invalidate because project 757b3ed057e74e95be7cde321fc64da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:07.568983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.569710 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-41134a81-95b9-4f6f-a20f-a9cd4f493a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.571528 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1280/2574] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:07 2022] DELETE /identity/v3/projects/757b3ed057e74e95be7cde321fc64da4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:07.576447 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54156e0a-4364-48bc-973d-8f101a569060 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.576736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54156e0a-4364-48bc-973d-8f101a569060 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.577014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54156e0a-4364-48bc-973d-8f101a569060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.588086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd096bf69c1ac449e8f58455a3ae2d2af', 'request_id': 'req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.594253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd096bf69c1ac449e8f58455a3ae2d2af', 'request_id': 'req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.595611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-54156e0a-4364-48bc-973d-8f101a569060 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:07.596837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-54156e0a-4364-48bc-973d-8f101a569060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:07.599633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd096bf69c1ac449e8f58455a3ae2d2af', 'request_id': 'req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.614513 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e admin admin] The token cache is being invalidate because project d096bf69c1ac449e8f58455a3ae2d2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:07.614801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.615407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-b9ae7f8c-92a4-41c7-ae21-66f38bb5468e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:07.617005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1295/2575] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:07 2022] DELETE /identity/v3/projects/d096bf69c1ac449e8f58455a3ae2d2af => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:07.621963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca31fd-245c-4d26-9c96-199b1c4a17a1 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.622189 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca31fd-245c-4d26-9c96-199b1c4a17a1 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.622462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca31fd-245c-4d26-9c96-199b1c4a17a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.640150 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-00ca31fd-245c-4d26-9c96-199b1c4a17a1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:07.641375 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-00ca31fd-245c-4d26-9c96-199b1c4a17a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:07.657903 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1281/2576] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:07.669030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed8f3e-f4c2-4afb-824d-ea5a7b1c5ae4 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.669420 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed8f3e-f4c2-4afb-824d-ea5a7b1c5ae4 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.669761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed8f3e-f4c2-4afb-824d-ea5a7b1c5ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.688011 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e3ed8f3e-f4c2-4afb-824d-ea5a7b1c5ae4 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:07.689259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e3ed8f3e-f4c2-4afb-824d-ea5a7b1c5ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:07.697770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1282/2577] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:07.701832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed8f3e-f4c2-4afb-824d-ea5a7b1c5ae4 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:07.710164 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1296/2578] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:07.711527 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed8f3e-f4c2-4afb-824d-ea5a7b1c5ae4 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:07.716710 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed461fc-493c-4a6a-9c2d-b134c5608411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:07.717373 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed461fc-493c-4a6a-9c2d-b134c5608411 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.717652 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed461fc-493c-4a6a-9c2d-b134c5608411 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.717772 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ba7a-bdfa-432f-b987-c43ed6108653 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.717926 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed461fc-493c-4a6a-9c2d-b134c5608411 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.718042 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ba7a-bdfa-432f-b987-c43ed6108653 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.718220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ba7a-bdfa-432f-b987-c43ed6108653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.718645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed461fc-493c-4a6a-9c2d-b134c5608411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:26:07.718955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed461fc-493c-4a6a-9c2d-b134c5608411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:07.720687 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed461fc-493c-4a6a-9c2d-b134c5608411 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:07.732020 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:07.741138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1283/2579] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:26:07.742600 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-82b5ba7a-bdfa-432f-b987-c43ed6108653 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:07.744227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-82b5ba7a-bdfa-432f-b987-c43ed6108653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:07.745619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed461fc-493c-4a6a-9c2d-b134c5608411 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:07.752885 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1297/2580] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:07.756926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ba7a-bdfa-432f-b987-c43ed6108653 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:07.758106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed461fc-493c-4a6a-9c2d-b134c5608411 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:07.763259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68975060-2652-4e2e-b2a8-023de3e67f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:07.763957 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975060-2652-4e2e-b2a8-023de3e67f79 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.764234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975060-2652-4e2e-b2a8-023de3e67f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.764555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975060-2652-4e2e-b2a8-023de3e67f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.765283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68975060-2652-4e2e-b2a8-023de3e67f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:07.767137 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ba7a-bdfa-432f-b987-c43ed6108653 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:07.767269 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68975060-2652-4e2e-b2a8-023de3e67f79 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:07.772871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1d7e-b7f1-41fd-99ff-2c4bab86d5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:07.773571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1d7e-b7f1-41fd-99ff-2c4bab86d5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.773858 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1d7e-b7f1-41fd-99ff-2c4bab86d5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.774329 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1d7e-b7f1-41fd-99ff-2c4bab86d5c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.775309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c1d7e-b7f1-41fd-99ff-2c4bab86d5c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:26:07.775875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c1d7e-b7f1-41fd-99ff-2c4bab86d5c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:07.777519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c1d7e-b7f1-41fd-99ff-2c4bab86d5c8 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:07.792987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1298/2581] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 16:26:07.797650 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1d7e-b7f1-41fd-99ff-2c4bab86d5c8 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:07.799651 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1284/2582] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:07 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:07.800633 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68975060-2652-4e2e-b2a8-023de3e67f79 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:07.810218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1d7e-b7f1-41fd-99ff-2c4bab86d5c8 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:07.866561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68975060-2652-4e2e-b2a8-023de3e67f79 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:07.870742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330697d1-c74a-478c-9337-d8a5017a41d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:07.871414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330697d1-c74a-478c-9337-d8a5017a41d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.871704 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330697d1-c74a-478c-9337-d8a5017a41d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.872031 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330697d1-c74a-478c-9337-d8a5017a41d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.872161 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ae9be-da14-4c9f-9fd7-3297417b3871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:07.872708 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330697d1-c74a-478c-9337-d8a5017a41d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:07.873023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ae9be-da14-4c9f-9fd7-3297417b3871 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.873399 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ae9be-da14-4c9f-9fd7-3297417b3871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.873772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ae9be-da14-4c9f-9fd7-3297417b3871 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.874593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ae9be-da14-4c9f-9fd7-3297417b3871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:07.874712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330697d1-c74a-478c-9337-d8a5017a41d8 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:07.876729 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ae9be-da14-4c9f-9fd7-3297417b3871 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:07.878784 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:07.900536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1285/2583] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:07 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:07.904644 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ae9be-da14-4c9f-9fd7-3297417b3871 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:07.909890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1299/2584] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:07 2022] POST /identity/v3/projects => generated 397 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:07.911000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330697d1-c74a-478c-9337-d8a5017a41d8 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:07.914943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ae9be-da14-4c9f-9fd7-3297417b3871 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:07.970836 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095427d8-0009-4a60-b9d2-65b370d7ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:07.971524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095427d8-0009-4a60-b9d2-65b370d7ff1d admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.971784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095427d8-0009-4a60-b9d2-65b370d7ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.972054 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095427d8-0009-4a60-b9d2-65b370d7ff1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.972824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095427d8-0009-4a60-b9d2-65b370d7ff1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:07.974246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330697d1-c74a-478c-9337-d8a5017a41d8 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:07.974472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095427d8-0009-4a60-b9d2-65b370d7ff1d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:07.979369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba22ce8-89e2-4dc4-9465-05c8875b6cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:07.980216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22ce8-89e2-4dc4-9465-05c8875b6cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:07.980613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22ce8-89e2-4dc4-9465-05c8875b6cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:07.980981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22ce8-89e2-4dc4-9465-05c8875b6cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:07.981761 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba22ce8-89e2-4dc4-9465-05c8875b6cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:07.983835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba22ce8-89e2-4dc4-9465-05c8875b6cf4 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:07.984456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1286/2585] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:26:07.988245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095427d8-0009-4a60-b9d2-65b370d7ff1d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:07.998416 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095427d8-0009-4a60-b9d2-65b370d7ff1d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.003141 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e40d7-317c-4e81-98fd-29d7c25603e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.003787 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e40d7-317c-4e81-98fd-29d7c25603e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.004065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e40d7-317c-4e81-98fd-29d7c25603e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.004376 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e40d7-317c-4e81-98fd-29d7c25603e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.005095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e40d7-317c-4e81-98fd-29d7c25603e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.009006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1300/2586] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:07 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:08.009160 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e40d7-317c-4e81-98fd-29d7c25603e7 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.010197 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba22ce8-89e2-4dc4-9465-05c8875b6cf4 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.017860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1287/2587] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:26:08.019820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba22ce8-89e2-4dc4-9465-05c8875b6cf4 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.021786 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e40d7-317c-4e81-98fd-29d7c25603e7 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.024657 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d322-f3a1-4b71-874d-f5c98cb54b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.025321 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d322-f3a1-4b71-874d-f5c98cb54b2c admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.025600 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d322-f3a1-4b71-874d-f5c98cb54b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.025873 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d322-f3a1-4b71-874d-f5c98cb54b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.026633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99d322-f3a1-4b71-874d-f5c98cb54b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.028241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99d322-f3a1-4b71-874d-f5c98cb54b2c admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.032215 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e40d7-317c-4e81-98fd-29d7c25603e7 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.037626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd7134-9f3a-464d-8e12-4ee1d25b696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.038274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1301/2588] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:26:08.038544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7134-9f3a-464d-8e12-4ee1d25b696a admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.038827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7134-9f3a-464d-8e12-4ee1d25b696a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.039102 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7134-9f3a-464d-8e12-4ee1d25b696a admin admin] PATH_INFO: `/v3/projects/6c8fc49091ea462aa6518de71f5f0103/users/5ed5e357888045379171e49a2d7ac7a2/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.042416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d322-f3a1-4b71-874d-f5c98cb54b2c admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.051942 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d322-f3a1-4b71-874d-f5c98cb54b2c admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.056845 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e3bc2-3a7f-4a1e-9186-1eec7ee84844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.057401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd7134-9f3a-464d-8e12-4ee1d25b696a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8fc49091ea462aa6518de71f5f0103, user_id=5ed5e357888045379171e49a2d7ac7a2, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.057529 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3bc2-3a7f-4a1e-9186-1eec7ee84844 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.057773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3bc2-3a7f-4a1e-9186-1eec7ee84844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.058050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3bc2-3a7f-4a1e-9186-1eec7ee84844 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.058780 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e3bc2-3a7f-4a1e-9186-1eec7ee84844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.060114 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd7134-9f3a-464d-8e12-4ee1d25b696a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.060444 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e3bc2-3a7f-4a1e-9186-1eec7ee84844 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.071553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1302/2589] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:08.075302 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1288/2590] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:08 2022] PUT /identity/v3/projects/6c8fc49091ea462aa6518de71f5f0103/users/5ed5e357888045379171e49a2d7ac7a2/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:08.075496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e3bc2-3a7f-4a1e-9186-1eec7ee84844 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.085645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2537ed-8cfe-4c94-ace3-54ab7001034f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.085802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e3bc2-3a7f-4a1e-9186-1eec7ee84844 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.085934 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2537ed-8cfe-4c94-ace3-54ab7001034f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.086214 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2537ed-8cfe-4c94-ace3-54ab7001034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.112676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-db2537ed-8cfe-4c94-ace3-54ab7001034f None None] MFA Rules not processed for user `5ed5e357888045379171e49a2d7ac7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:08.113884 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-db2537ed-8cfe-4c94-ace3-54ab7001034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:08.126749 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:08.143937 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e1b50-1b78-4569-bf50-88a57d8bab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.144871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e1b50-1b78-4569-bf50-88a57d8bab1f admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.145189 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e1b50-1b78-4569-bf50-88a57d8bab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.145461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e1b50-1b78-4569-bf50-88a57d8bab1f admin admin] PATH_INFO: `/v3/projects/73561ad5b4b64cd5bd930a9a4cb8e326/users/833630f70f034a38a729d16578951e1e/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.160203 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e1b50-1b78-4569-bf50-88a57d8bab1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=73561ad5b4b64cd5bd930a9a4cb8e326, user_id=833630f70f034a38a729d16578951e1e, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.162951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e1b50-1b78-4569-bf50-88a57d8bab1f admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.176647 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1303/2591] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:08 2022] PUT /identity/v3/projects/73561ad5b4b64cd5bd930a9a4cb8e326/users/833630f70f034a38a729d16578951e1e/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:08.186357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1289/2592] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:08.186739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e1b50-1b78-4569-bf50-88a57d8bab1f admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.192125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af7e50-bf76-4ea7-9e2c-a410d368211c None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.192449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af7e50-bf76-4ea7-9e2c-a410d368211c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.192723 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af7e50-bf76-4ea7-9e2c-a410d368211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.221260 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-46af7e50-bf76-4ea7-9e2c-a410d368211c None None] MFA Rules not processed for user `833630f70f034a38a729d16578951e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:08.222869 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-46af7e50-bf76-4ea7-9e2c-a410d368211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:08.235794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:08.259084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e1b50-1b78-4569-bf50-88a57d8bab1f admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.263556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214ef78-f083-4fd4-9e17-7da5c7910045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.264294 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214ef78-f083-4fd4-9e17-7da5c7910045 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.264636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214ef78-f083-4fd4-9e17-7da5c7910045 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.264941 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214ef78-f083-4fd4-9e17-7da5c7910045 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.265646 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214ef78-f083-4fd4-9e17-7da5c7910045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.267642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214ef78-f083-4fd4-9e17-7da5c7910045 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.287242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1290/2593] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:08.292452 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af7e50-bf76-4ea7-9e2c-a410d368211c None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.299003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1304/2594] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:08 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:08.302902 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214ef78-f083-4fd4-9e17-7da5c7910045 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.303273 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af7e50-bf76-4ea7-9e2c-a410d368211c None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.366560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1146a3-1107-4816-b7ea-82c82ee1204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.367194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1146a3-1107-4816-b7ea-82c82ee1204a admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.367471 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1146a3-1107-4816-b7ea-82c82ee1204a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.367743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1146a3-1107-4816-b7ea-82c82ee1204a admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.368505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1146a3-1107-4816-b7ea-82c82ee1204a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.370483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1146a3-1107-4816-b7ea-82c82ee1204a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.377217 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214ef78-f083-4fd4-9e17-7da5c7910045 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.382316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e16757-d395-4949-843b-0ef5c8402248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.382982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e16757-d395-4949-843b-0ef5c8402248 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.383261 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e16757-d395-4949-843b-0ef5c8402248 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.383563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e16757-d395-4949-843b-0ef5c8402248 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.384317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e16757-d395-4949-843b-0ef5c8402248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.386229 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e16757-d395-4949-843b-0ef5c8402248 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.398575 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1291/2595] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:08 2022] POST /identity/v3/projects => generated 399 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:08.402837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1146a3-1107-4816-b7ea-82c82ee1204a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.409972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1305/2596] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:08 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:08.411492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e16757-d395-4949-843b-0ef5c8402248 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.421218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e16757-d395-4949-843b-0ef5c8402248 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.437542 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:08.468044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1146a3-1107-4816-b7ea-82c82ee1204a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.473446 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1d7a5-648a-47b4-acb9-ee1d217dd95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.474666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1d7a5-648a-47b4-acb9-ee1d217dd95a admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.475026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1d7a5-648a-47b4-acb9-ee1d217dd95a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.475379 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1d7a5-648a-47b4-acb9-ee1d217dd95a admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.476148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1d7a5-648a-47b4-acb9-ee1d217dd95a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.478719 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1d7a5-648a-47b4-acb9-ee1d217dd95a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.479725 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6f708-de90-4695-bdb9-b4b99693d66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.480442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f708-de90-4695-bdb9-b4b99693d66e admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.480729 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f708-de90-4695-bdb9-b4b99693d66e admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.481007 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f708-de90-4695-bdb9-b4b99693d66e admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.481753 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f708-de90-4695-bdb9-b4b99693d66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.483665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f708-de90-4695-bdb9-b4b99693d66e admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.494670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1306/2597] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:26:08.498773 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6f708-de90-4695-bdb9-b4b99693d66e admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.503829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1292/2598] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:08 2022] POST /identity/v3/users => generated 306 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:08.507494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1d7a5-648a-47b4-acb9-ee1d217dd95a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.508718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6f708-de90-4695-bdb9-b4b99693d66e admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.513908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc512add-7eff-4c2b-bd86-066951fbf075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.514878 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512add-7eff-4c2b-bd86-066951fbf075 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.515165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512add-7eff-4c2b-bd86-066951fbf075 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.515457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512add-7eff-4c2b-bd86-066951fbf075 admin admin] PATH_INFO: `/v3/projects/65f2b96acc0a4151b84a75bd0084a743/users/b41d405773994239a8fd6a34030550b9/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.517403 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1d7a5-648a-47b4-acb9-ee1d217dd95a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.522107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d3659-c249-46fe-b71e-2a36398917c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.522768 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d3659-c249-46fe-b71e-2a36398917c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.523053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d3659-c249-46fe-b71e-2a36398917c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.523333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d3659-c249-46fe-b71e-2a36398917c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.524096 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d3659-c249-46fe-b71e-2a36398917c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.525832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d3659-c249-46fe-b71e-2a36398917c4 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.531165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc512add-7eff-4c2b-bd86-066951fbf075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f2b96acc0a4151b84a75bd0084a743, user_id=b41d405773994239a8fd6a34030550b9, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.533948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc512add-7eff-4c2b-bd86-066951fbf075 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.535921 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1293/2599] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:08.540026 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d3659-c249-46fe-b71e-2a36398917c4 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.549568 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1307/2600] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:08 2022] PUT /identity/v3/projects/65f2b96acc0a4151b84a75bd0084a743/users/b41d405773994239a8fd6a34030550b9/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:08.552541 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d3659-c249-46fe-b71e-2a36398917c4 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.553455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc512add-7eff-4c2b-bd86-066951fbf075 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.583268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:08.610571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1935df-620a-452a-a66b-0b559a955889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.611481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1935df-620a-452a-a66b-0b559a955889 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.611766 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1935df-620a-452a-a66b-0b559a955889 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.612044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1935df-620a-452a-a66b-0b559a955889 admin admin] PATH_INFO: `/v3/projects/2844e2fd47e847d79803f4a6df2f5724/users/c535bce36e40427d817b072f76f04ee1/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.619594 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc512add-7eff-4c2b-bd86-066951fbf075 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.624505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f06bc-01e2-4e56-b225-96d412ce6515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.625184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f06bc-01e2-4e56-b225-96d412ce6515 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.625470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f06bc-01e2-4e56-b225-96d412ce6515 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.625746 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f06bc-01e2-4e56-b225-96d412ce6515 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.626480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f06bc-01e2-4e56-b225-96d412ce6515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.626588 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1935df-620a-452a-a66b-0b559a955889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2844e2fd47e847d79803f4a6df2f5724, user_id=c535bce36e40427d817b072f76f04ee1, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.628165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f06bc-01e2-4e56-b225-96d412ce6515 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.629266 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1935df-620a-452a-a66b-0b559a955889 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.638573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1308/2601] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:08.642672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f06bc-01e2-4e56-b225-96d412ce6515 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.643860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1294/2602] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:08 2022] PUT /identity/v3/projects/2844e2fd47e847d79803f4a6df2f5724/users/c535bce36e40427d817b072f76f04ee1/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:08.647636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1935df-620a-452a-a66b-0b559a955889 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.653242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f06bc-01e2-4e56-b225-96d412ce6515 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.709962 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119a0fa-d181-4a02-b794-1382bd978b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.710868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119a0fa-d181-4a02-b794-1382bd978b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.711153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119a0fa-d181-4a02-b794-1382bd978b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.711262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1935df-620a-452a-a66b-0b559a955889 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.711434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119a0fa-d181-4a02-b794-1382bd978b38 admin admin] PATH_INFO: `/v3/projects/65f2b96acc0a4151b84a75bd0084a743/users/b41d405773994239a8fd6a34030550b9/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.713663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119a0fa-d181-4a02-b794-1382bd978b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f2b96acc0a4151b84a75bd0084a743, user_id=b41d405773994239a8fd6a34030550b9, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.715940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bd9e8-bb9c-4a5d-a46d-919d7450a48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.716384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119a0fa-d181-4a02-b794-1382bd978b38 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.716655 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bd9e8-bb9c-4a5d-a46d-919d7450a48f admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.716941 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bd9e8-bb9c-4a5d-a46d-919d7450a48f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.717217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bd9e8-bb9c-4a5d-a46d-919d7450a48f admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.717952 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bd9e8-bb9c-4a5d-a46d-919d7450a48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.719547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bd9e8-bb9c-4a5d-a46d-919d7450a48f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.727284 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1309/2603] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:08 2022] PUT /identity/v3/projects/65f2b96acc0a4151b84a75bd0084a743/users/b41d405773994239a8fd6a34030550b9/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:08.734868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1295/2604] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:26:08.738896 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119a0fa-d181-4a02-b794-1382bd978b38 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.739351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732df3b0-0720-4972-a5ca-a44d416aaa0e None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.739644 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732df3b0-0720-4972-a5ca-a44d416aaa0e None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.739925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732df3b0-0720-4972-a5ca-a44d416aaa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.765782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-732df3b0-0720-4972-a5ca-a44d416aaa0e None None] MFA Rules not processed for user `b41d405773994239a8fd6a34030550b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:08.766992 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-732df3b0-0720-4972-a5ca-a44d416aaa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:08.784133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:08.801364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119a0fa-d181-4a02-b794-1382bd978b38 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.806219 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77920bde-4fa2-4a0c-9ec2-e44d30498a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.807110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77920bde-4fa2-4a0c-9ec2-e44d30498a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.807390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77920bde-4fa2-4a0c-9ec2-e44d30498a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.807669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77920bde-4fa2-4a0c-9ec2-e44d30498a43 admin admin] PATH_INFO: `/v3/projects/2844e2fd47e847d79803f4a6df2f5724/users/c535bce36e40427d817b072f76f04ee1/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.809707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77920bde-4fa2-4a0c-9ec2-e44d30498a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2844e2fd47e847d79803f4a6df2f5724, user_id=c535bce36e40427d817b072f76f04ee1, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:08.812462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77920bde-4fa2-4a0c-9ec2-e44d30498a43 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:08.823608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1310/2605] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:08 2022] PUT /identity/v3/projects/2844e2fd47e847d79803f4a6df2f5724/users/c535bce36e40427d817b072f76f04ee1/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:08.833921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b61ffc-6f79-4352-9a68-3fb9450213e8 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.834759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b61ffc-6f79-4352-9a68-3fb9450213e8 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.834759 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b61ffc-6f79-4352-9a68-3fb9450213e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:08.857003 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1296/2606] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:08.866203 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732df3b0-0720-4972-a5ca-a44d416aaa0e None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.866755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-c0b61ffc-6f79-4352-9a68-3fb9450213e8 None None] MFA Rules not processed for user `c535bce36e40427d817b072f76f04ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:08.867886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-732df3b0-0720-4972-a5ca-a44d416aaa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:08.868096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c0b61ffc-6f79-4352-9a68-3fb9450213e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:08.918031 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:08.939201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732df3b0-0720-4972-a5ca-a44d416aaa0e None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:08.949089 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1311/2607] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:08 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:08.960396 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b61ffc-6f79-4352-9a68-3fb9450213e8 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:08.961855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c0b61ffc-6f79-4352-9a68-3fb9450213e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:08.995955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7476d93-b3ca-4456-a814-ddbf79abeb16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:08.996951 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7476d93-b3ca-4456-a814-ddbf79abeb16 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:08.997425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7476d93-b3ca-4456-a814-ddbf79abeb16 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:08.997700 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7476d93-b3ca-4456-a814-ddbf79abeb16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:09.027097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b61ffc-6f79-4352-9a68-3fb9450213e8 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:09.031334 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cb84c-3eb5-4699-8667-9fc2f4661926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:09.032005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cb84c-3eb5-4699-8667-9fc2f4661926 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:09.032305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cb84c-3eb5-4699-8667-9fc2f4661926 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:09.032820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cb84c-3eb5-4699-8667-9fc2f4661926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:09.046698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cb84c-3eb5-4699-8667-9fc2f4661926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:09.048469 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cb84c-3eb5-4699-8667-9fc2f4661926 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:09.062440 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1312/2608] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:08 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:26:09.073581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7476d93-b3ca-4456-a814-ddbf79abeb16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:09.075171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7476d93-b3ca-4456-a814-ddbf79abeb16 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:09.086906 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1297/2609] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:09.148078 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cb84c-3eb5-4699-8667-9fc2f4661926 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:09.157913 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cb84c-3eb5-4699-8667-9fc2f4661926 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:09.161845 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a5a85-c07e-4c1b-915c-594db0dcd5d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:09.162496 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a5a85-c07e-4c1b-915c-594db0dcd5d9 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:09.162778 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a5a85-c07e-4c1b-915c-594db0dcd5d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:09.163052 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a5a85-c07e-4c1b-915c-594db0dcd5d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:09.166769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7476d93-b3ca-4456-a814-ddbf79abeb16 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:09.176085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7476d93-b3ca-4456-a814-ddbf79abeb16 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:09.179818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ea467-eaad-4ed1-989f-4a17fd5e859a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:09.180712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ea467-eaad-4ed1-989f-4a17fd5e859a service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:09.181009 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ea467-eaad-4ed1-989f-4a17fd5e859a service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:09.181290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ea467-eaad-4ed1-989f-4a17fd5e859a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:09.200001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:09.229507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a5a85-c07e-4c1b-915c-594db0dcd5d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:09.230968 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a5a85-c07e-4c1b-915c-594db0dcd5d9 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:09.240153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1313/2610] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:09.242887 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ea467-eaad-4ed1-989f-4a17fd5e859a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:09.244385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ea467-eaad-4ed1-989f-4a17fd5e859a service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:09.253751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1298/2611] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:26:12.321420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a5a85-c07e-4c1b-915c-594db0dcd5d9 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:12.323070 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4e8a5a85-c07e-4c1b-915c-594db0dcd5d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:12.386145 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a5a85-c07e-4c1b-915c-594db0dcd5d9 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:12.391227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49be89-0501-4d11-9ca4-4b603a9564cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:12.392031 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49be89-0501-4d11-9ca4-4b603a9564cf service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:12.392340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49be89-0501-4d11-9ca4-4b603a9564cf service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:12.392682 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49be89-0501-4d11-9ca4-4b603a9564cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:12.401518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-fa49be89-0501-4d11-9ca4-4b603a9564cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:12.449002 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:12.483996 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49be89-0501-4d11-9ca4-4b603a9564cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:12.485480 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49be89-0501-4d11-9ca4-4b603a9564cf service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:12.495701 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1314/2612] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:12.954389 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ea467-eaad-4ed1-989f-4a17fd5e859a service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:12.956007 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ef5ea467-eaad-4ed1-989f-4a17fd5e859a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:13.013923 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49be89-0501-4d11-9ca4-4b603a9564cf service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:13.015533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-fa49be89-0501-4d11-9ca4-4b603a9564cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:13.028462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49be89-0501-4d11-9ca4-4b603a9564cf service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:13.033034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d9039-9b98-4338-b0ff-f5d5d5af65d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:13.034013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d9039-9b98-4338-b0ff-f5d5d5af65d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.034206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d9039-9b98-4338-b0ff-f5d5d5af65d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.034488 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d9039-9b98-4338-b0ff-f5d5d5af65d1 admin admin] PATH_INFO: `/v3/users/99827ab52d9242f385177cada4335b38` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.035664 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d9039-9b98-4338-b0ff-f5d5d5af65d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99827ab52d9242f385177cada4335b38)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:13.037635 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d9039-9b98-4338-b0ff-f5d5d5af65d1 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:13.040151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ea467-eaad-4ed1-989f-4a17fd5e859a service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:13.045331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579c183-d730-4230-996e-c222b8910c79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:13.045992 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579c183-d730-4230-996e-c222b8910c79 service placement] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.046294 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579c183-d730-4230-996e-c222b8910c79 service placement] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.046558 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579c183-d730-4230-996e-c222b8910c79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.048393 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6579c183-d730-4230-996e-c222b8910c79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:13.060740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579c183-d730-4230-996e-c222b8910c79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:13.062513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579c183-d730-4230-996e-c222b8910c79 service placement] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:13.074612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1299/2613] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:13.087387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ec6d9039-9b98-4338-b0ff-f5d5d5af65d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99827ab52d9242f385177cada4335b38'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.094902 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ec6d9039-9b98-4338-b0ff-f5d5d5af65d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99827ab52d9242f385177cada4335b38'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.095653 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ec6d9039-9b98-4338-b0ff-f5d5d5af65d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99827ab52d9242f385177cada4335b38'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.096365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ec6d9039-9b98-4338-b0ff-f5d5d5af65d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99827ab52d9242f385177cada4335b38'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.105562 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ec6d9039-9b98-4338-b0ff-f5d5d5af65d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99827ab52d9242f385177cada4335b38'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.123120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1315/2614] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:13 2022] DELETE /identity/v3/users/99827ab52d9242f385177cada4335b38 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:13.299149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579c183-d730-4230-996e-c222b8910c79 service placement] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:13.310928 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579c183-d730-4230-996e-c222b8910c79 service placement] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:13.343598 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d9039-9b98-4338-b0ff-f5d5d5af65d1 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:13.345290 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ec6d9039-9b98-4338-b0ff-f5d5d5af65d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:13.375042 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aeb277-e91c-436f-aec1-876ab583a21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:13.375963 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeb277-e91c-436f-aec1-876ab583a21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.376247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeb277-e91c-436f-aec1-876ab583a21d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.376566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeb277-e91c-436f-aec1-876ab583a21d admin admin] PATH_INFO: `/v3/projects/6b09e1a0de62456d90789370bba74b53` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.377767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aeb277-e91c-436f-aec1-876ab583a21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b09e1a0de62456d90789370bba74b53)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:13.380029 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aeb277-e91c-436f-aec1-876ab583a21d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:13.411196 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d9039-9b98-4338-b0ff-f5d5d5af65d1 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:13.416239 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c5287-1fb0-4252-950f-6f52d73b3142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:13.417173 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c5287-1fb0-4252-950f-6f52d73b3142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.417459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c5287-1fb0-4252-950f-6f52d73b3142 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.417730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c5287-1fb0-4252-950f-6f52d73b3142 admin admin] PATH_INFO: `/v3/users/833630f70f034a38a729d16578951e1e` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.418901 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c5287-1fb0-4252-950f-6f52d73b3142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=833630f70f034a38a729d16578951e1e)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:13.421501 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c5287-1fb0-4252-950f-6f52d73b3142 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:13.426894 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e3aeb277-e91c-436f-aec1-876ab583a21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b09e1a0de62456d90789370bba74b53', 'request_id': 'req-e3aeb277-e91c-436f-aec1-876ab583a21d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.428196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:13.434654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e3aeb277-e91c-436f-aec1-876ab583a21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b09e1a0de62456d90789370bba74b53', 'request_id': 'req-e3aeb277-e91c-436f-aec1-876ab583a21d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.441695 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e3aeb277-e91c-436f-aec1-876ab583a21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b09e1a0de62456d90789370bba74b53', 'request_id': 'req-e3aeb277-e91c-436f-aec1-876ab583a21d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.457385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e3aeb277-e91c-436f-aec1-876ab583a21d admin admin] The token cache is being invalidate because project 6b09e1a0de62456d90789370bba74b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:13.457766 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e3aeb277-e91c-436f-aec1-876ab583a21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.458481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e3aeb277-e91c-436f-aec1-876ab583a21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.460126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1300/2615] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:13 2022] DELETE /identity/v3/projects/6b09e1a0de62456d90789370bba74b53 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:13.465356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf2d1f-3b2b-4757-96d4-a94d26207af8 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.465701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf2d1f-3b2b-4757-96d4-a94d26207af8 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.465996 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf2d1f-3b2b-4757-96d4-a94d26207af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.466304 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:13.473186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-481c5287-1fb0-4252-950f-6f52d73b3142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833630f70f034a38a729d16578951e1e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.481677 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-481c5287-1fb0-4252-950f-6f52d73b3142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833630f70f034a38a729d16578951e1e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.482371 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-481c5287-1fb0-4252-950f-6f52d73b3142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833630f70f034a38a729d16578951e1e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.483012 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-481c5287-1fb0-4252-950f-6f52d73b3142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833630f70f034a38a729d16578951e1e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.486539 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-6bdf2d1f-3b2b-4757-96d4-a94d26207af8 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:13.488126 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6bdf2d1f-3b2b-4757-96d4-a94d26207af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:13.495105 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-481c5287-1fb0-4252-950f-6f52d73b3142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833630f70f034a38a729d16578951e1e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:13.516805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1316/2616] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:13 2022] DELETE /identity/v3/users/833630f70f034a38a729d16578951e1e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:13.521117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d0d32-478f-4ad3-a2b1-e2433637310d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.521660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d0d32-478f-4ad3-a2b1-e2433637310d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.521807 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d0d32-478f-4ad3-a2b1-e2433637310d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.540735 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-f22d0d32-478f-4ad3-a2b1-e2433637310d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:13.541966 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f22d0d32-478f-4ad3-a2b1-e2433637310d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:13.557405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1301/2617] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:13.565585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6540af-b23a-4684-b73e-8c584beff08c None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.565870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6540af-b23a-4684-b73e-8c584beff08c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.566171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6540af-b23a-4684-b73e-8c584beff08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.585820 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-de6540af-b23a-4684-b73e-8c584beff08c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:13.587205 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-de6540af-b23a-4684-b73e-8c584beff08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:13.602119 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1317/2618] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:13.612021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d0d32-478f-4ad3-a2b1-e2433637310d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:13.613438 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f22d0d32-478f-4ad3-a2b1-e2433637310d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:13.645736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1302/2619] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:13.649987 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6540af-b23a-4684-b73e-8c584beff08c None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:13.658681 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6540af-b23a-4684-b73e-8c584beff08c None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:13.663310 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bb488-7430-4bdc-b15a-d04fe13ce33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:13.663955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bb488-7430-4bdc-b15a-d04fe13ce33e admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.664238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bb488-7430-4bdc-b15a-d04fe13ce33e admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.664612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bb488-7430-4bdc-b15a-d04fe13ce33e admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.665546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bb488-7430-4bdc-b15a-d04fe13ce33e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:26:13.665858 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bb488-7430-4bdc-b15a-d04fe13ce33e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:13.667463 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bb488-7430-4bdc-b15a-d04fe13ce33e admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:13.670625 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d0d32-478f-4ad3-a2b1-e2433637310d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:13.674537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc94d1-e247-4681-887d-39f1c47da0c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:13.675186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc94d1-e247-4681-887d-39f1c47da0c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.675484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc94d1-e247-4681-887d-39f1c47da0c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.676059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc94d1-e247-4681-887d-39f1c47da0c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.679019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1303/2620] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 16:26:13.683353 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bb488-7430-4bdc-b15a-d04fe13ce33e admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:13.685582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc94d1-e247-4681-887d-39f1c47da0c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:13.687028 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc94d1-e247-4681-887d-39f1c47da0c2 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:13.693039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bb488-7430-4bdc-b15a-d04fe13ce33e admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:13.696878 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1318/2621] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:26:13.701983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3b4d4-1d48-42c1-86fa-ec425c14cd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:13.702657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3b4d4-1d48-42c1-86fa-ec425c14cd1b admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.702970 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3b4d4-1d48-42c1-86fa-ec425c14cd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.703232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3b4d4-1d48-42c1-86fa-ec425c14cd1b admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.704458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3b4d4-1d48-42c1-86fa-ec425c14cd1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:13.706307 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3b4d4-1d48-42c1-86fa-ec425c14cd1b admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:13.734696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1304/2622] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:13 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:13.739083 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc94d1-e247-4681-887d-39f1c47da0c2 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:13.750060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc94d1-e247-4681-887d-39f1c47da0c2 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:13.808620 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bbd47-c5d8-4baf-b4b1-a33fcbd3607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:13.809290 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bbd47-c5d8-4baf-b4b1-a33fcbd3607d admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.809576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bbd47-c5d8-4baf-b4b1-a33fcbd3607d admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.809856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bbd47-c5d8-4baf-b4b1-a33fcbd3607d admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.810555 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bbd47-c5d8-4baf-b4b1-a33fcbd3607d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:13.812533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bbd47-c5d8-4baf-b4b1-a33fcbd3607d admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:13.819238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:13.835967 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1319/2623] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:13 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:13.841557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3b4d4-1d48-42c1-86fa-ec425c14cd1b admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:13.858640 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3b4d4-1d48-42c1-86fa-ec425c14cd1b admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:13.863464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee1ffc-1721-4a2f-885c-36b1ef438ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:13.864136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee1ffc-1721-4a2f-885c-36b1ef438ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.864496 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee1ffc-1721-4a2f-885c-36b1ef438ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.864744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee1ffc-1721-4a2f-885c-36b1ef438ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.866156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee1ffc-1721-4a2f-885c-36b1ef438ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:13.867401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee1ffc-1721-4a2f-885c-36b1ef438ef0 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:13.882197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1305/2624] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:13.883721 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bbd47-c5d8-4baf-b4b1-a33fcbd3607d admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:13.893943 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bbd47-c5d8-4baf-b4b1-a33fcbd3607d admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:13.898791 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f80aa-af9f-44e5-ac77-5133715852e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:13.899658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f80aa-af9f-44e5-ac77-5133715852e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.899933 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f80aa-af9f-44e5-ac77-5133715852e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.900205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f80aa-af9f-44e5-ac77-5133715852e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.901001 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f80aa-af9f-44e5-ac77-5133715852e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:13.902640 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f80aa-af9f-44e5-ac77-5133715852e3 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:13.912683 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1320/2625] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:13.917220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee1ffc-1721-4a2f-885c-36b1ef438ef0 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:13.928103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee1ffc-1721-4a2f-885c-36b1ef438ef0 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:13.933904 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169380cc-2c48-4368-89fa-e71de251bfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:13.934939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169380cc-2c48-4368-89fa-e71de251bfa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.935278 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169380cc-2c48-4368-89fa-e71de251bfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.935585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169380cc-2c48-4368-89fa-e71de251bfa6 admin admin] PATH_INFO: `/v3/projects/15f80256e12d4678ac08717e16368e64/users/46b01ee6b70b4da38f9735df5ecc0d1c/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.952825 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169380cc-2c48-4368-89fa-e71de251bfa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f80256e12d4678ac08717e16368e64, user_id=46b01ee6b70b4da38f9735df5ecc0d1c, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:13.955976 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169380cc-2c48-4368-89fa-e71de251bfa6 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:13.970627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1306/2626] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:13 2022] PUT /identity/v3/projects/15f80256e12d4678ac08717e16368e64/users/46b01ee6b70b4da38f9735df5ecc0d1c/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:13.975757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b7733-154f-4128-8d58-a7793d45463b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:13.976173 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b7733-154f-4128-8d58-a7793d45463b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:13.976835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b7733-154f-4128-8d58-a7793d45463b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:13.978890 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169380cc-2c48-4368-89fa-e71de251bfa6 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:13.981048 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-169380cc-2c48-4368-89fa-e71de251bfa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:13.996692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-cb2b7733-154f-4128-8d58-a7793d45463b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:13.997946 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:13.998118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-cb2b7733-154f-4128-8d58-a7793d45463b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:14.058560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169380cc-2c48-4368-89fa-e71de251bfa6 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:14.060531 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1321/2627] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:14.063238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:14.064223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:14.064462 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:14.064675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] PATH_INFO: `/v3/projects/73561ad5b4b64cd5bd930a9a4cb8e326` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:14.065890 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73561ad5b4b64cd5bd930a9a4cb8e326)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:14.067914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:14.070655 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b7733-154f-4128-8d58-a7793d45463b None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:14.115678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73561ad5b4b64cd5bd930a9a4cb8e326', 'request_id': 'req-6b8adceb-5c62-429a-8d8a-cbe588497440'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.122400 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73561ad5b4b64cd5bd930a9a4cb8e326', 'request_id': 'req-6b8adceb-5c62-429a-8d8a-cbe588497440'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.128426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b7733-154f-4128-8d58-a7793d45463b None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:14.128746 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73561ad5b4b64cd5bd930a9a4cb8e326', 'request_id': 'req-6b8adceb-5c62-429a-8d8a-cbe588497440'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.142187 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] The token cache is being invalidate because project 73561ad5b4b64cd5bd930a9a4cb8e326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:14.142494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.143090 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.144678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1307/2628] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:13 2022] DELETE /identity/v3/projects/73561ad5b4b64cd5bd930a9a4cb8e326 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:14.148775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:14.150408 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:14.182700 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c3858-7bdd-4ab1-90ef-e42e9b75d9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:14.183361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c3858-7bdd-4ab1-90ef-e42e9b75d9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:14.183754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c3858-7bdd-4ab1-90ef-e42e9b75d9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:14.183925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c3858-7bdd-4ab1-90ef-e42e9b75d9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:14.189039 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b96c3858-7bdd-4ab1-90ef-e42e9b75d9c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:14.215365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8adceb-5c62-429a-8d8a-cbe588497440 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:14.220269 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13294228-bf1b-477d-87ae-0f799cb4b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:14.221174 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13294228-bf1b-477d-87ae-0f799cb4b692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:14.221467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13294228-bf1b-477d-87ae-0f799cb4b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:14.221738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13294228-bf1b-477d-87ae-0f799cb4b692 admin admin] PATH_INFO: `/v3/users/c535bce36e40427d817b072f76f04ee1` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:14.222955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13294228-bf1b-477d-87ae-0f799cb4b692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c535bce36e40427d817b072f76f04ee1)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:14.224939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13294228-bf1b-477d-87ae-0f799cb4b692 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:14.245806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:14.267861 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c3858-7bdd-4ab1-90ef-e42e9b75d9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:14.269517 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c3858-7bdd-4ab1-90ef-e42e9b75d9c1 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:14.273750 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:14.280613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1322/2629] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:26:14.281351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-13294228-bf1b-477d-87ae-0f799cb4b692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c535bce36e40427d817b072f76f04ee1'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.290551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-13294228-bf1b-477d-87ae-0f799cb4b692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c535bce36e40427d817b072f76f04ee1'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.291267 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-13294228-bf1b-477d-87ae-0f799cb4b692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c535bce36e40427d817b072f76f04ee1'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.291883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-13294228-bf1b-477d-87ae-0f799cb4b692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c535bce36e40427d817b072f76f04ee1'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.301748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-13294228-bf1b-477d-87ae-0f799cb4b692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c535bce36e40427d817b072f76f04ee1'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.321672 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1308/2630] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:14 2022] DELETE /identity/v3/users/c535bce36e40427d817b072f76f04ee1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:14.617159 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c3858-7bdd-4ab1-90ef-e42e9b75d9c1 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:14.631290 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c3858-7bdd-4ab1-90ef-e42e9b75d9c1 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:14.702484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a8609-cf19-46d9-a662-32b0c8fc4208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:14.704029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a8609-cf19-46d9-a662-32b0c8fc4208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:14.704446 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a8609-cf19-46d9-a662-32b0c8fc4208 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:14.704756 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a8609-cf19-46d9-a662-32b0c8fc4208 admin admin] PATH_INFO: `/v3/projects/2844e2fd47e847d79803f4a6df2f5724` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:14.706023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a8609-cf19-46d9-a662-32b0c8fc4208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2844e2fd47e847d79803f4a6df2f5724)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:14.707965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a8609-cf19-46d9-a662-32b0c8fc4208 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:14.757760 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ca2a8609-cf19-46d9-a662-32b0c8fc4208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2844e2fd47e847d79803f4a6df2f5724', 'request_id': 'req-ca2a8609-cf19-46d9-a662-32b0c8fc4208'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.764035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ca2a8609-cf19-46d9-a662-32b0c8fc4208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2844e2fd47e847d79803f4a6df2f5724', 'request_id': 'req-ca2a8609-cf19-46d9-a662-32b0c8fc4208'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.770414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ca2a8609-cf19-46d9-a662-32b0c8fc4208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2844e2fd47e847d79803f4a6df2f5724', 'request_id': 'req-ca2a8609-cf19-46d9-a662-32b0c8fc4208'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.784223 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ca2a8609-cf19-46d9-a662-32b0c8fc4208 admin admin] The token cache is being invalidate because project 2844e2fd47e847d79803f4a6df2f5724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:14.784552 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ca2a8609-cf19-46d9-a662-32b0c8fc4208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.785174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-ca2a8609-cf19-46d9-a662-32b0c8fc4208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:14.786757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1323/2631] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:14 2022] DELETE /identity/v3/projects/2844e2fd47e847d79803f4a6df2f5724 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:14.791763 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c6ef3-c990-4a99-add7-7d31086ace30 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:14.792056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c6ef3-c990-4a99-add7-7d31086ace30 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:14.792362 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c6ef3-c990-4a99-add7-7d31086ace30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:14.810093 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-567c6ef3-c990-4a99-add7-7d31086ace30 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:14.811349 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-567c6ef3-c990-4a99-add7-7d31086ace30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:14.872129 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1309/2632] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:14.879469 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a4412-3ba7-456f-a53c-d4d9b567c13e None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:14.879757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a4412-3ba7-456f-a53c-d4d9b567c13e None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:14.880035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a4412-3ba7-456f-a53c-d4d9b567c13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:14.900248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-0b8a4412-3ba7-456f-a53c-d4d9b567c13e None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:14.901525 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-0b8a4412-3ba7-456f-a53c-d4d9b567c13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:14.910811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1324/2633] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:14.916104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c6ef3-c990-4a99-add7-7d31086ace30 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:14.926337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c6ef3-c990-4a99-add7-7d31086ace30 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:14.935875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb9780-7c75-4d05-bae9-68d4a056e311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:14.936634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb9780-7c75-4d05-bae9-68d4a056e311 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:14.937229 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb9780-7c75-4d05-bae9-68d4a056e311 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:14.937229 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb9780-7c75-4d05-bae9-68d4a056e311 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:14.938102 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb9780-7c75-4d05-bae9-68d4a056e311 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:26:14.938239 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb9780-7c75-4d05-bae9-68d4a056e311 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:14.940082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb9780-7c75-4d05-bae9-68d4a056e311 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:14.952761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1310/2634] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:26:14.958174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a4412-3ba7-456f-a53c-d4d9b567c13e None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:14.968520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a4412-3ba7-456f-a53c-d4d9b567c13e None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:14.973434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a823478-89e1-4b34-b79f-903856a39e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:14.974120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a823478-89e1-4b34-b79f-903856a39e87 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:14.974405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a823478-89e1-4b34-b79f-903856a39e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:14.974710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a823478-89e1-4b34-b79f-903856a39e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:14.975446 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a823478-89e1-4b34-b79f-903856a39e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:14.977830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a823478-89e1-4b34-b79f-903856a39e87 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:15.015068 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1325/2635] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:14 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:15.019355 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb9780-7c75-4d05-bae9-68d4a056e311 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:15.030105 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb9780-7c75-4d05-bae9-68d4a056e311 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:15.097001 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4b98b-4bad-4e43-a2fc-7c42cf9a8d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:15.097778 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b98b-4bad-4e43-a2fc-7c42cf9a8d3d admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:15.097945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b98b-4bad-4e43-a2fc-7c42cf9a8d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:15.098134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b98b-4bad-4e43-a2fc-7c42cf9a8d3d admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:15.098831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4b98b-4bad-4e43-a2fc-7c42cf9a8d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:15.100962 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4b98b-4bad-4e43-a2fc-7c42cf9a8d3d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:15.122678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1311/2636] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:15 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:15.126361 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a823478-89e1-4b34-b79f-903856a39e87 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:15.138905 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a823478-89e1-4b34-b79f-903856a39e87 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:15.144274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162408a0-eb7c-4c51-9956-dd7b407ee80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:15.145074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162408a0-eb7c-4c51-9956-dd7b407ee80e admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:15.145424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162408a0-eb7c-4c51-9956-dd7b407ee80e admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:15.145800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162408a0-eb7c-4c51-9956-dd7b407ee80e admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:15.146682 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162408a0-eb7c-4c51-9956-dd7b407ee80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:15.148413 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162408a0-eb7c-4c51-9956-dd7b407ee80e admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:15.160859 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1326/2637] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:26:15.165004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4b98b-4bad-4e43-a2fc-7c42cf9a8d3d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:15.175316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4b98b-4bad-4e43-a2fc-7c42cf9a8d3d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:15.180947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6ef11-6566-4cc9-ba22-798c3cb56136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:15.181747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6ef11-6566-4cc9-ba22-798c3cb56136 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:15.182123 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6ef11-6566-4cc9-ba22-798c3cb56136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:15.182506 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6ef11-6566-4cc9-ba22-798c3cb56136 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:15.183857 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6ef11-6566-4cc9-ba22-798c3cb56136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:15.185776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6ef11-6566-4cc9-ba22-798c3cb56136 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:15.203964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1312/2638] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:15.204412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162408a0-eb7c-4c51-9956-dd7b407ee80e admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:15.220227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162408a0-eb7c-4c51-9956-dd7b407ee80e admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:15.225954 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abb77b-8ad8-4555-bf52-09eb12eee98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:15.227888 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abb77b-8ad8-4555-bf52-09eb12eee98c admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:15.228191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abb77b-8ad8-4555-bf52-09eb12eee98c admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:15.228508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abb77b-8ad8-4555-bf52-09eb12eee98c admin admin] PATH_INFO: `/v3/projects/1719dbf93664463c804d396fd10abae2/users/3d7b402e32c240129299bcac358293a7/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:15.245054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abb77b-8ad8-4555-bf52-09eb12eee98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1719dbf93664463c804d396fd10abae2, user_id=3d7b402e32c240129299bcac358293a7, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:15.247765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abb77b-8ad8-4555-bf52-09eb12eee98c admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:15.265198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1327/2639] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:15 2022] PUT /identity/v3/projects/1719dbf93664463c804d396fd10abae2/users/3d7b402e32c240129299bcac358293a7/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:15.276172 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189160ba-2b36-45e9-9035-f12a42b13e15 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:15.277290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189160ba-2b36-45e9-9035-f12a42b13e15 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:15.277428 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189160ba-2b36-45e9-9035-f12a42b13e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:15.305745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-189160ba-2b36-45e9-9035-f12a42b13e15 None None] MFA Rules not processed for user `3d7b402e32c240129299bcac358293a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:15.307271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-189160ba-2b36-45e9-9035-f12a42b13e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:15.322933 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:15.420566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1313/2640] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:15.425454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abb77b-8ad8-4555-bf52-09eb12eee98c admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:15.441023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:15.502215 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abb77b-8ad8-4555-bf52-09eb12eee98c admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:15.507658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3164ff-1257-418d-b720-650637891f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:15.508464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3164ff-1257-418d-b720-650637891f28 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:15.508822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3164ff-1257-418d-b720-650637891f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:15.509170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3164ff-1257-418d-b720-650637891f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:15.509956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3164ff-1257-418d-b720-650637891f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:15.512178 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3164ff-1257-418d-b720-650637891f28 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:15.549431 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1328/2641] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:15 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:15.553501 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189160ba-2b36-45e9-9035-f12a42b13e15 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:15.566982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189160ba-2b36-45e9-9035-f12a42b13e15 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:15.646542 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a77c5c-bbb1-416e-9810-14054c1379b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:15.647392 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a77c5c-bbb1-416e-9810-14054c1379b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:15.647745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a77c5c-bbb1-416e-9810-14054c1379b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:15.648091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a77c5c-bbb1-416e-9810-14054c1379b2 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:15.648983 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a77c5c-bbb1-416e-9810-14054c1379b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:15.652140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a77c5c-bbb1-416e-9810-14054c1379b2 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:15.686696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3164ff-1257-418d-b720-650637891f28 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:15.687290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1314/2642] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:15 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:15.701377 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3164ff-1257-418d-b720-650637891f28 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:15.713202 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275d9a7-a2bf-4a54-9444-0759293f9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:15.714280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275d9a7-a2bf-4a54-9444-0759293f9476 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:15.714570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275d9a7-a2bf-4a54-9444-0759293f9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:15.714876 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275d9a7-a2bf-4a54-9444-0759293f9476 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:15.715597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275d9a7-a2bf-4a54-9444-0759293f9476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:15.717536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275d9a7-a2bf-4a54-9444-0759293f9476 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:15.733181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1329/2643] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:15.734635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a77c5c-bbb1-416e-9810-14054c1379b2 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:15.747125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a77c5c-bbb1-416e-9810-14054c1379b2 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:15.752142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26991e6d-8331-4e52-a77b-ef36828f0611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:15.753080 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26991e6d-8331-4e52-a77b-ef36828f0611 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:15.753367 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26991e6d-8331-4e52-a77b-ef36828f0611 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:15.753644 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26991e6d-8331-4e52-a77b-ef36828f0611 admin admin] PATH_INFO: `/v3/projects/d2d44367a7c041e9a02489b71f51b22b/users/0c8f8a175818458084184167da2149b6/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:15.772363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26991e6d-8331-4e52-a77b-ef36828f0611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d44367a7c041e9a02489b71f51b22b, user_id=0c8f8a175818458084184167da2149b6, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:15.776221 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26991e6d-8331-4e52-a77b-ef36828f0611 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:15.804708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1315/2644] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:15 2022] PUT /identity/v3/projects/d2d44367a7c041e9a02489b71f51b22b/users/0c8f8a175818458084184167da2149b6/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:15.808477 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275d9a7-a2bf-4a54-9444-0759293f9476 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:15.832520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275d9a7-a2bf-4a54-9444-0759293f9476 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:15.943289 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ebea2-be44-46a9-9bfc-70c1d6048799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:15.944015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ebea2-be44-46a9-9bfc-70c1d6048799 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:15.944631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ebea2-be44-46a9-9bfc-70c1d6048799 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:15.944919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ebea2-be44-46a9-9bfc-70c1d6048799 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:15.945847 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ebea2-be44-46a9-9bfc-70c1d6048799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:15.947629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ebea2-be44-46a9-9bfc-70c1d6048799 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:15.963099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1330/2645] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:15.967165 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26991e6d-8331-4e52-a77b-ef36828f0611 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:15.979671 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26991e6d-8331-4e52-a77b-ef36828f0611 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:15.985519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff24c3-e149-4919-9a98-60eed89a4594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:15.987269 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff24c3-e149-4919-9a98-60eed89a4594 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:15.987553 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff24c3-e149-4919-9a98-60eed89a4594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:15.987874 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff24c3-e149-4919-9a98-60eed89a4594 admin admin] PATH_INFO: `/v3/projects/d2d44367a7c041e9a02489b71f51b22b/users/0c8f8a175818458084184167da2149b6/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:15.990030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff24c3-e149-4919-9a98-60eed89a4594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d44367a7c041e9a02489b71f51b22b, user_id=0c8f8a175818458084184167da2149b6, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:15.994946 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff24c3-e149-4919-9a98-60eed89a4594 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:16.016903 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1316/2646] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:15 2022] PUT /identity/v3/projects/d2d44367a7c041e9a02489b71f51b22b/users/0c8f8a175818458084184167da2149b6/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:16.019778 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9188f26-5449-432a-a859-3d09e69c925c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:16.020533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9188f26-5449-432a-a859-3d09e69c925c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:16.021424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9188f26-5449-432a-a859-3d09e69c925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:16.090324 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-c9188f26-5449-432a-a859-3d09e69c925c None None] MFA Rules not processed for user `0c8f8a175818458084184167da2149b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:16.091723 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c9188f26-5449-432a-a859-3d09e69c925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:16.208183 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1331/2647] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:16.215982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff24c3-e149-4919-9a98-60eed89a4594 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:16.217865 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-05ff24c3-e149-4919-9a98-60eed89a4594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:16.299279 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff24c3-e149-4919-9a98-60eed89a4594 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:16.303997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea122f4-65f8-4304-8f77-e10f41b1dd5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:16.304755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea122f4-65f8-4304-8f77-e10f41b1dd5c service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:16.305527 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea122f4-65f8-4304-8f77-e10f41b1dd5c service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:16.305777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea122f4-65f8-4304-8f77-e10f41b1dd5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:16.317134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea122f4-65f8-4304-8f77-e10f41b1dd5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:16.318721 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea122f4-65f8-4304-8f77-e10f41b1dd5c service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:16.331988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1317/2648] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:16.974750 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9188f26-5449-432a-a859-3d09e69c925c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:16.985791 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:17.064051 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9188f26-5449-432a-a859-3d09e69c925c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:17.070931 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ad6a4-1ffb-430c-9e1b-5dbbe04bc7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:17.072647 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad6a4-1ffb-430c-9e1b-5dbbe04bc7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:17.072929 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad6a4-1ffb-430c-9e1b-5dbbe04bc7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:17.073205 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad6a4-1ffb-430c-9e1b-5dbbe04bc7a7 admin admin] PATH_INFO: `/v3/users/3d7b402e32c240129299bcac358293a7` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:17.074570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ad6a4-1ffb-430c-9e1b-5dbbe04bc7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7b402e32c240129299bcac358293a7)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:17.076612 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ad6a4-1ffb-430c-9e1b-5dbbe04bc7a7 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:17.149234 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2e2ad6a4-1ffb-430c-9e1b-5dbbe04bc7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7b402e32c240129299bcac358293a7'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:17.163134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2e2ad6a4-1ffb-430c-9e1b-5dbbe04bc7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7b402e32c240129299bcac358293a7'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:17.163894 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2e2ad6a4-1ffb-430c-9e1b-5dbbe04bc7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7b402e32c240129299bcac358293a7'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:17.165196 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2e2ad6a4-1ffb-430c-9e1b-5dbbe04bc7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7b402e32c240129299bcac358293a7'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:17.179372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2e2ad6a4-1ffb-430c-9e1b-5dbbe04bc7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7b402e32c240129299bcac358293a7'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:17.219752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1332/2649] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:16 2022] DELETE /identity/v3/users/3d7b402e32c240129299bcac358293a7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:17.224051 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0505da1-e119-4353-9af0-f2902848e018 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:17.224638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0505da1-e119-4353-9af0-f2902848e018 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:17.224747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0505da1-e119-4353-9af0-f2902848e018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:17.246195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e0505da1-e119-4353-9af0-f2902848e018 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:17.247706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e0505da1-e119-4353-9af0-f2902848e018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:17.253023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:17.347618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1318/2650] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:17.359668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ad6a4-1ffb-430c-9e1b-5dbbe04bc7a7 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:17.361471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2e2ad6a4-1ffb-430c-9e1b-5dbbe04bc7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:17.565420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ad6a4-1ffb-430c-9e1b-5dbbe04bc7a7 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:17.575158 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7032-3008-4ad5-acdb-3af5812b3718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:17.576016 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7032-3008-4ad5-acdb-3af5812b3718 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:17.593724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7032-3008-4ad5-acdb-3af5812b3718 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:17.594010 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7032-3008-4ad5-acdb-3af5812b3718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:17.619188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e7032-3008-4ad5-acdb-3af5812b3718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:17.620842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e7032-3008-4ad5-acdb-3af5812b3718 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:17.638742 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1333/2651] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:18.023536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0505da1-e119-4353-9af0-f2902848e018 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:18.025417 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e0505da1-e119-4353-9af0-f2902848e018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:18.038199 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0505da1-e119-4353-9af0-f2902848e018 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:18.046845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:18.048255 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:18.048815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:18.049921 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] PATH_INFO: `/v3/projects/1719dbf93664463c804d396fd10abae2` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:18.051791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1719dbf93664463c804d396fd10abae2)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:18.054875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:18.135638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1719dbf93664463c804d396fd10abae2', 'request_id': 'req-8dfdf01e-65b6-4de0-b536-75f474fe98dc'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:18.143829 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1719dbf93664463c804d396fd10abae2', 'request_id': 'req-8dfdf01e-65b6-4de0-b536-75f474fe98dc'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:18.151864 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1719dbf93664463c804d396fd10abae2', 'request_id': 'req-8dfdf01e-65b6-4de0-b536-75f474fe98dc'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:18.168584 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] The token cache is being invalidate because project 1719dbf93664463c804d396fd10abae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:18.169024 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:18.169990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:18.171742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1319/2652] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:18 2022] DELETE /identity/v3/projects/1719dbf93664463c804d396fd10abae2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:18.175830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7032-3008-4ad5-acdb-3af5812b3718 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:18.189234 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7032-3008-4ad5-acdb-3af5812b3718 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:18.242837 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:18.298552 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baa802-9870-49f1-98c3-47687d479e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:18.300667 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baa802-9870-49f1-98c3-47687d479e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:18.301194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baa802-9870-49f1-98c3-47687d479e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:18.301717 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baa802-9870-49f1-98c3-47687d479e8b admin admin] PATH_INFO: `/v3/users/0c8f8a175818458084184167da2149b6` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:18.303744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baa802-9870-49f1-98c3-47687d479e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c8f8a175818458084184167da2149b6)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:18.308437 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baa802-9870-49f1-98c3-47687d479e8b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:18.399675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-37baa802-9870-49f1-98c3-47687d479e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c8f8a175818458084184167da2149b6'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:18.417088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-37baa802-9870-49f1-98c3-47687d479e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c8f8a175818458084184167da2149b6'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:18.418279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-37baa802-9870-49f1-98c3-47687d479e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c8f8a175818458084184167da2149b6'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:18.419287 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-37baa802-9870-49f1-98c3-47687d479e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c8f8a175818458084184167da2149b6'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:18.439391 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-37baa802-9870-49f1-98c3-47687d479e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c8f8a175818458084184167da2149b6'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:18.478292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1334/2653] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:18 2022] DELETE /identity/v3/users/0c8f8a175818458084184167da2149b6 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:18.858283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:18.859835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:18.874661 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdf01e-65b6-4de0-b536-75f474fe98dc admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:18.945557 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:18.946663 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:18.947056 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:18.947471 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] PATH_INFO: `/v3/projects/d2d44367a7c041e9a02489b71f51b22b` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:18.950111 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d44367a7c041e9a02489b71f51b22b)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:18.952178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:19.024973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:19.053295 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d44367a7c041e9a02489b71f51b22b', 'request_id': 'req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:19.068899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d44367a7c041e9a02489b71f51b22b', 'request_id': 'req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:19.083095 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d44367a7c041e9a02489b71f51b22b', 'request_id': 'req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:19.116196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] The token cache is being invalidate because project d2d44367a7c041e9a02489b71f51b22b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:19.120637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:19.122412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:19.133343 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1320/2654] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:18 2022] DELETE /identity/v3/projects/d2d44367a7c041e9a02489b71f51b22b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:19.133484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5f103-a02c-4931-8cc2-87efb0ccdee9 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:19.133484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5f103-a02c-4931-8cc2-87efb0ccdee9 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:19.133484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5f103-a02c-4931-8cc2-87efb0ccdee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:19.154809 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:19.155940 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-5ac5f103-a02c-4931-8cc2-87efb0ccdee9 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:19.157030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:19.157186 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5ac5f103-a02c-4931-8cc2-87efb0ccdee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:19.238550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd8f44-a754-4a76-8dd4-3e56aa83ad96 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:19.240633 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1335/2655] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:19.244175 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf398709-88b0-493f-aaff-41fee9c2cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:19.245107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398709-88b0-493f-aaff-41fee9c2cb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:19.245402 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398709-88b0-493f-aaff-41fee9c2cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:19.245659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398709-88b0-493f-aaff-41fee9c2cb88 admin admin] PATH_INFO: `/v3/users/5ed5e357888045379171e49a2d7ac7a2` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:19.246906 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf398709-88b0-493f-aaff-41fee9c2cb88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed5e357888045379171e49a2d7ac7a2)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:19.249409 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf398709-88b0-493f-aaff-41fee9c2cb88 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:19.250005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e24fd9-f0f6-42b8-9da7-8034abaecb0c None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:19.250298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e24fd9-f0f6-42b8-9da7-8034abaecb0c None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:19.250572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e24fd9-f0f6-42b8-9da7-8034abaecb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:19.273085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-88e24fd9-f0f6-42b8-9da7-8034abaecb0c None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:19.275173 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-88e24fd9-f0f6-42b8-9da7-8034abaecb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:19.285867 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1336/2656] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:19.291126 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e24fd9-f0f6-42b8-9da7-8034abaecb0c None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:19.301512 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e24fd9-f0f6-42b8-9da7-8034abaecb0c None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:19.312311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed8888-47e8-4254-9b6e-0b97a1580fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:19.313754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8888-47e8-4254-9b6e-0b97a1580fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:19.313754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8888-47e8-4254-9b6e-0b97a1580fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:19.314023 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8888-47e8-4254-9b6e-0b97a1580fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:19.314636 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed8888-47e8-4254-9b6e-0b97a1580fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:26:19.315095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed8888-47e8-4254-9b6e-0b97a1580fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:19.317047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed8888-47e8-4254-9b6e-0b97a1580fa2 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:19.318624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bf398709-88b0-493f-aaff-41fee9c2cb88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed5e357888045379171e49a2d7ac7a2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:19.329397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bf398709-88b0-493f-aaff-41fee9c2cb88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed5e357888045379171e49a2d7ac7a2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:19.330185 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bf398709-88b0-493f-aaff-41fee9c2cb88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed5e357888045379171e49a2d7ac7a2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:19.331440 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bf398709-88b0-493f-aaff-41fee9c2cb88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed5e357888045379171e49a2d7ac7a2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:19.333357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1337/2657] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:26:19.338362 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed8888-47e8-4254-9b6e-0b97a1580fa2 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:19.342720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-86ed8888-47e8-4254-9b6e-0b97a1580fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:19.345731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-bf398709-88b0-493f-aaff-41fee9c2cb88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed5e357888045379171e49a2d7ac7a2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:19.360692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed8888-47e8-4254-9b6e-0b97a1580fa2 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:19.366074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa798ec5-054c-497d-98fe-14cbc672860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:19.366998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa798ec5-054c-497d-98fe-14cbc672860e admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:19.367421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa798ec5-054c-497d-98fe-14cbc672860e admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:19.367845 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa798ec5-054c-497d-98fe-14cbc672860e admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:19.368554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1321/2658] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:19 2022] DELETE /identity/v3/users/5ed5e357888045379171e49a2d7ac7a2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:19.368743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa798ec5-054c-497d-98fe-14cbc672860e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:19.370790 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa798ec5-054c-497d-98fe-14cbc672860e admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:19.372814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f9680-7b38-47df-9ab2-00baaa554672 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:19.373190 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f9680-7b38-47df-9ab2-00baaa554672 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:19.373534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f9680-7b38-47df-9ab2-00baaa554672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:19.412782 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-990f9680-7b38-47df-9ab2-00baaa554672 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:19.414146 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-990f9680-7b38-47df-9ab2-00baaa554672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:19.423810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1338/2659] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:19 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:19.428210 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa798ec5-054c-497d-98fe-14cbc672860e admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:19.457661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:19.539076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:19.578806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa798ec5-054c-497d-98fe-14cbc672860e admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:19.585973 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1322/2660] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:19.601737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f9680-7b38-47df-9ab2-00baaa554672 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:19.604363 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-990f9680-7b38-47df-9ab2-00baaa554672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:19.610923 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4cfc2-728b-404d-a896-fead25bdf46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:19.611921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4cfc2-728b-404d-a896-fead25bdf46a admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:19.614216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4cfc2-728b-404d-a896-fead25bdf46a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:19.614841 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4cfc2-728b-404d-a896-fead25bdf46a admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:19.615739 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4cfc2-728b-404d-a896-fead25bdf46a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:19.622591 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4cfc2-728b-404d-a896-fead25bdf46a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:19.662390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1339/2661] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:19 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:19.667125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4cfc2-728b-404d-a896-fead25bdf46a admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:19.680551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4cfc2-728b-404d-a896-fead25bdf46a admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:19.687519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba963a4-d115-44be-a630-78dba195279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:19.689014 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba963a4-d115-44be-a630-78dba195279e admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:19.689314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba963a4-d115-44be-a630-78dba195279e admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:19.689596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba963a4-d115-44be-a630-78dba195279e admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:19.691794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba963a4-d115-44be-a630-78dba195279e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:19.694212 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f9680-7b38-47df-9ab2-00baaa554672 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:19.694378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba963a4-d115-44be-a630-78dba195279e admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:19.715398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1340/2662] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:26:19.719490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba963a4-d115-44be-a630-78dba195279e admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:19.755249 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba963a4-d115-44be-a630-78dba195279e admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:19.762605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d7ef0-c8bc-4abb-a62a-133a9d91a604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:19.763822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d7ef0-c8bc-4abb-a62a-133a9d91a604 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:19.764529 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d7ef0-c8bc-4abb-a62a-133a9d91a604 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:19.764916 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d7ef0-c8bc-4abb-a62a-133a9d91a604 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:19.766291 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d7ef0-c8bc-4abb-a62a-133a9d91a604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:19.769073 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d7ef0-c8bc-4abb-a62a-133a9d91a604 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:19.771020 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf608c2e-c724-44bd-8bd7-b6d8e11560d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:19.771706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf608c2e-c724-44bd-8bd7-b6d8e11560d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:19.771990 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf608c2e-c724-44bd-8bd7-b6d8e11560d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:19.772488 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf608c2e-c724-44bd-8bd7-b6d8e11560d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:19.794083 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1341/2663] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:19.795818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f99151-641b-4ea2-a555-55745c41d285 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:19.796222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f99151-641b-4ea2-a555-55745c41d285 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:19.796711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f99151-641b-4ea2-a555-55745c41d285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:19.797505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf608c2e-c724-44bd-8bd7-b6d8e11560d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:19.799017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf608c2e-c724-44bd-8bd7-b6d8e11560d0 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:19.820474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1323/2664] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:26:19.821287 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf608c2e-c724-44bd-8bd7-b6d8e11560d0 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:19.834879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf608c2e-c724-44bd-8bd7-b6d8e11560d0 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:19.835491 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-77f99151-641b-4ea2-a555-55745c41d285 None None] MFA Rules not processed for user `46b01ee6b70b4da38f9735df5ecc0d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:19.836934 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-77f99151-641b-4ea2-a555-55745c41d285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:19.841401 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4740e9-82f6-4cac-beb7-731d20121255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:19.842673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4740e9-82f6-4cac-beb7-731d20121255 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:19.843164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4740e9-82f6-4cac-beb7-731d20121255 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:19.843607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4740e9-82f6-4cac-beb7-731d20121255 admin admin] PATH_INFO: `/v3/projects/5b0c634d37f64f35acc0b8c33775a36e/users/e165cf1b4e224e038856b82f66368595/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:19.864391 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4740e9-82f6-4cac-beb7-731d20121255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0c634d37f64f35acc0b8c33775a36e, user_id=e165cf1b4e224e038856b82f66368595, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:19.867085 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4740e9-82f6-4cac-beb7-731d20121255 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:19.894673 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1324/2665] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:19 2022] PUT /identity/v3/projects/5b0c634d37f64f35acc0b8c33775a36e/users/e165cf1b4e224e038856b82f66368595/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:19.906221 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9fe08-9813-4775-b945-be7337653454 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:19.906660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9fe08-9813-4775-b945-be7337653454 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:19.907094 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9fe08-9813-4775-b945-be7337653454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:19.938310 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1342/2666] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:19.942775 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-16a9fe08-9813-4775-b945-be7337653454 None None] MFA Rules not processed for user `e165cf1b4e224e038856b82f66368595`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:19.943876 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f99151-641b-4ea2-a555-55745c41d285 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:19.944012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-16a9fe08-9813-4775-b945-be7337653454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:19.947134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-77f99151-641b-4ea2-a555-55745c41d285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:19.962999 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f99151-641b-4ea2-a555-55745c41d285 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.037743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2b19-883e-4b9b-82f4-a14e30ea4955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.038250 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1325/2667] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:20.038818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2b19-883e-4b9b-82f4-a14e30ea4955 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.039157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2b19-883e-4b9b-82f4-a14e30ea4955 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.039667 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2b19-883e-4b9b-82f4-a14e30ea4955 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.040539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2b19-883e-4b9b-82f4-a14e30ea4955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.042438 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9fe08-9813-4775-b945-be7337653454 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.042590 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2b19-883e-4b9b-82f4-a14e30ea4955 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.054394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:20.055985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9fe08-9813-4775-b945-be7337653454 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.062373 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55dbfd-1f85-428e-9294-3ff689a80dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.063042 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55dbfd-1f85-428e-9294-3ff689a80dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.063325 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55dbfd-1f85-428e-9294-3ff689a80dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.063604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55dbfd-1f85-428e-9294-3ff689a80dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.064412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55dbfd-1f85-428e-9294-3ff689a80dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.066316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55dbfd-1f85-428e-9294-3ff689a80dc5 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.073147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:20.078910 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1343/2668] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:19 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:20.083246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2b19-883e-4b9b-82f4-a14e30ea4955 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.105361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1326/2669] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:20 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:20.107254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55dbfd-1f85-428e-9294-3ff689a80dc5 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.174992 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2b19-883e-4b9b-82f4-a14e30ea4955 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.222349 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55dbfd-1f85-428e-9294-3ff689a80dc5 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.228422 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849811f4-3da4-42d0-b509-7bfb320780fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.229116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849811f4-3da4-42d0-b509-7bfb320780fd admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.229422 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849811f4-3da4-42d0-b509-7bfb320780fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.229694 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849811f4-3da4-42d0-b509-7bfb320780fd admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.230397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849811f4-3da4-42d0-b509-7bfb320780fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.232386 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849811f4-3da4-42d0-b509-7bfb320780fd admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.255909 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1327/2670] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:20 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:20.256611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849811f4-3da4-42d0-b509-7bfb320780fd admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.259924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-849811f4-3da4-42d0-b509-7bfb320780fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:20.263258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66273e3f-6dd8-46df-a893-876e72a1d533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.264004 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66273e3f-6dd8-46df-a893-876e72a1d533 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.264408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66273e3f-6dd8-46df-a893-876e72a1d533 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.264777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66273e3f-6dd8-46df-a893-876e72a1d533 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.265583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66273e3f-6dd8-46df-a893-876e72a1d533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.267630 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66273e3f-6dd8-46df-a893-876e72a1d533 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.272795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849811f4-3da4-42d0-b509-7bfb320780fd admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.279415 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.280500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.280792 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.281038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] PATH_INFO: `/v3/projects/6c8fc49091ea462aa6518de71f5f0103` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.282398 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8fc49091ea462aa6518de71f5f0103)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.284276 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.293103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1344/2671] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:20 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:20.293823 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66273e3f-6dd8-46df-a893-876e72a1d533 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.308142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66273e3f-6dd8-46df-a893-876e72a1d533 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.312902 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd337a-2130-4e6b-a9ab-fa75925b57ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.313581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd337a-2130-4e6b-a9ab-fa75925b57ef admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.313868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd337a-2130-4e6b-a9ab-fa75925b57ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.314150 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd337a-2130-4e6b-a9ab-fa75925b57ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.314893 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd337a-2130-4e6b-a9ab-fa75925b57ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.316748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd337a-2130-4e6b-a9ab-fa75925b57ef admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.328223 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1345/2672] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:20.329333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd337a-2130-4e6b-a9ab-fa75925b57ef admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.339118 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd337a-2130-4e6b-a9ab-fa75925b57ef admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.342152 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8fc49091ea462aa6518de71f5f0103', 'request_id': 'req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:20.350632 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8fc49091ea462aa6518de71f5f0103', 'request_id': 'req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:20.359842 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8fc49091ea462aa6518de71f5f0103', 'request_id': 'req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:20.387263 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] The token cache is being invalidate because project 6c8fc49091ea462aa6518de71f5f0103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:20.387559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:20.388342 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:20.390262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1328/2673] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:20 2022] DELETE /identity/v3/projects/6c8fc49091ea462aa6518de71f5f0103 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:20.393122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.394767 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:20.415383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f97c93-19c5-4dc0-b999-9d76ec5d93a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.416064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f97c93-19c5-4dc0-b999-9d76ec5d93a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.416377 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f97c93-19c5-4dc0-b999-9d76ec5d93a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.416657 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f97c93-19c5-4dc0-b999-9d76ec5d93a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.417393 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f97c93-19c5-4dc0-b999-9d76ec5d93a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.419034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f97c93-19c5-4dc0-b999-9d76ec5d93a6 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.429195 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1346/2674] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:20.431223 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f97c93-19c5-4dc0-b999-9d76ec5d93a6 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.432323 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-93f97c93-19c5-4dc0-b999-9d76ec5d93a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:20.445835 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f97c93-19c5-4dc0-b999-9d76ec5d93a6 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.451291 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d3bba-5d78-497f-94a5-285e4f07ed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.452176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d3bba-5d78-497f-94a5-285e4f07ed90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.452495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d3bba-5d78-497f-94a5-285e4f07ed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.452778 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d3bba-5d78-497f-94a5-285e4f07ed90 admin admin] PATH_INFO: `/v3/users/b41d405773994239a8fd6a34030550b9` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.454331 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d3bba-5d78-497f-94a5-285e4f07ed90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41d405773994239a8fd6a34030550b9)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.456269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d3bba-5d78-497f-94a5-285e4f07ed90 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.458452 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:20.461621 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:20.463860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4c1b0-8e43-45d4-ac23-ccf55768be2b admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.470245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2b64f-3485-4d5d-922d-1cb9a63be013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.471250 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2b64f-3485-4d5d-922d-1cb9a63be013 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.472115 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2b64f-3485-4d5d-922d-1cb9a63be013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.472564 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2b64f-3485-4d5d-922d-1cb9a63be013 admin admin] PATH_INFO: `/v3/projects/6b344b8aa88a46c9ad42602d8328a94d/users/21384f38933344c683f033383b0aa79d/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.488067 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2b64f-3485-4d5d-922d-1cb9a63be013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b344b8aa88a46c9ad42602d8328a94d, user_id=21384f38933344c683f033383b0aa79d, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.490747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2b64f-3485-4d5d-922d-1cb9a63be013 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.504379 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1329/2675] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:20 2022] PUT /identity/v3/projects/6b344b8aa88a46c9ad42602d8328a94d/users/21384f38933344c683f033383b0aa79d/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:20.505188 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2b64f-3485-4d5d-922d-1cb9a63be013 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.506954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9cb2b64f-3485-4d5d-922d-1cb9a63be013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:20.511112 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-965d3bba-5d78-497f-94a5-285e4f07ed90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41d405773994239a8fd6a34030550b9'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:20.518303 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-965d3bba-5d78-497f-94a5-285e4f07ed90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41d405773994239a8fd6a34030550b9'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:20.518972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-965d3bba-5d78-497f-94a5-285e4f07ed90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41d405773994239a8fd6a34030550b9'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:20.519583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-965d3bba-5d78-497f-94a5-285e4f07ed90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41d405773994239a8fd6a34030550b9'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:20.527586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-965d3bba-5d78-497f-94a5-285e4f07ed90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41d405773994239a8fd6a34030550b9'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:20.545649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1347/2676] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:20 2022] DELETE /identity/v3/users/b41d405773994239a8fd6a34030550b9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:20.546394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d3bba-5d78-497f-94a5-285e4f07ed90 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.547828 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-965d3bba-5d78-497f-94a5-285e4f07ed90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:20.574677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2b64f-3485-4d5d-922d-1cb9a63be013 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.634407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d3bba-5d78-497f-94a5-285e4f07ed90 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.640152 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad645956-4041-4653-9f2b-5c9cb3e1b954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.640874 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad645956-4041-4653-9f2b-5c9cb3e1b954 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.641150 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad645956-4041-4653-9f2b-5c9cb3e1b954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.641430 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad645956-4041-4653-9f2b-5c9cb3e1b954 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.642171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad645956-4041-4653-9f2b-5c9cb3e1b954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.643947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad645956-4041-4653-9f2b-5c9cb3e1b954 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.654751 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bf24f-1063-4930-925e-5edec4eb6f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.655008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1348/2677] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:20.656119 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bf24f-1063-4930-925e-5edec4eb6f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.656609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bf24f-1063-4930-925e-5edec4eb6f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.657051 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bf24f-1063-4930-925e-5edec4eb6f0d admin admin] PATH_INFO: `/v3/projects/41a6bc6457624bdaaa525dcbc7a170b0/users/830e759bd74347028ffb2b5290e25d8c/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.659099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad645956-4041-4653-9f2b-5c9cb3e1b954 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.669431 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad645956-4041-4653-9f2b-5c9cb3e1b954 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.673581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bf24f-1063-4930-925e-5edec4eb6f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a6bc6457624bdaaa525dcbc7a170b0, user_id=830e759bd74347028ffb2b5290e25d8c, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.675092 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df07262-9945-4089-93ad-e511850c2ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.676431 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df07262-9945-4089-93ad-e511850c2ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.676772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bf24f-1063-4930-925e-5edec4eb6f0d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.676930 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df07262-9945-4089-93ad-e511850c2ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.677306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df07262-9945-4089-93ad-e511850c2ad4 admin admin] PATH_INFO: `/v3/projects/6b344b8aa88a46c9ad42602d8328a94d/users/21384f38933344c683f033383b0aa79d/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.679570 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df07262-9945-4089-93ad-e511850c2ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b344b8aa88a46c9ad42602d8328a94d, user_id=21384f38933344c683f033383b0aa79d, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.682926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df07262-9945-4089-93ad-e511850c2ad4 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.693114 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1330/2678] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:20 2022] PUT /identity/v3/projects/41a6bc6457624bdaaa525dcbc7a170b0/users/830e759bd74347028ffb2b5290e25d8c/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:20.694663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1349/2679] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:20 2022] PUT /identity/v3/projects/6b344b8aa88a46c9ad42602d8328a94d/users/21384f38933344c683f033383b0aa79d/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:20.697364 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bf24f-1063-4930-925e-5edec4eb6f0d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.699228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-810bf24f-1063-4930-925e-5edec4eb6f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:20.705167 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551b1c-cd22-4953-9c80-80b9ea9950e5 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.705473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551b1c-cd22-4953-9c80-80b9ea9950e5 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.705734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81551b1c-cd22-4953-9c80-80b9ea9950e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.741466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-81551b1c-cd22-4953-9c80-80b9ea9950e5 None None] MFA Rules not processed for user `21384f38933344c683f033383b0aa79d`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:20.742712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-81551b1c-cd22-4953-9c80-80b9ea9950e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:20.774148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bf24f-1063-4930-925e-5edec4eb6f0d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.797262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:20.799439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:20.822379 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1350/2680] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:20.834845 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81551b1c-cd22-4953-9c80-80b9ea9950e5 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.836818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-81551b1c-cd22-4953-9c80-80b9ea9950e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:20.867847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdaf854-52fa-48f4-9bd5-e519dfb20357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.868721 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaf854-52fa-48f4-9bd5-e519dfb20357 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.869005 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaf854-52fa-48f4-9bd5-e519dfb20357 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.869280 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaf854-52fa-48f4-9bd5-e519dfb20357 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.870027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdaf854-52fa-48f4-9bd5-e519dfb20357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.871965 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdaf854-52fa-48f4-9bd5-e519dfb20357 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.884574 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1331/2681] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:20.885643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdaf854-52fa-48f4-9bd5-e519dfb20357 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.887839 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-dfdaf854-52fa-48f4-9bd5-e519dfb20357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:20.903671 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdaf854-52fa-48f4-9bd5-e519dfb20357 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.909732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81551b1c-cd22-4953-9c80-80b9ea9950e5 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.910312 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.911386 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.911761 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.912130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] PATH_INFO: `/v3/projects/65f2b96acc0a4151b84a75bd0084a743` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.913672 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274b4f6-385c-4651-ba33-e93acf69ac51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.913891 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f2b96acc0a4151b84a75bd0084a743)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.914368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274b4f6-385c-4651-ba33-e93acf69ac51 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.914740 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274b4f6-385c-4651-ba33-e93acf69ac51 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.915196 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274b4f6-385c-4651-ba33-e93acf69ac51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.916555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.925367 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274b4f6-385c-4651-ba33-e93acf69ac51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.926829 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274b4f6-385c-4651-ba33-e93acf69ac51 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.937824 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1351/2682] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:20.938653 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274b4f6-385c-4651-ba33-e93acf69ac51 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:20.949486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274b4f6-385c-4651-ba33-e93acf69ac51 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:20.956699 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b529bd-937f-417d-8d01-afca6efdc82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:20.957597 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b529bd-937f-417d-8d01-afca6efdc82b admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:20.957903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b529bd-937f-417d-8d01-afca6efdc82b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:20.958194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b529bd-937f-417d-8d01-afca6efdc82b admin admin] PATH_INFO: `/v3/projects/41a6bc6457624bdaaa525dcbc7a170b0/users/830e759bd74347028ffb2b5290e25d8c/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:20.960341 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b529bd-937f-417d-8d01-afca6efdc82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a6bc6457624bdaaa525dcbc7a170b0, user_id=830e759bd74347028ffb2b5290e25d8c, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:20.963253 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b529bd-937f-417d-8d01-afca6efdc82b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:20.971716 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f2b96acc0a4151b84a75bd0084a743', 'request_id': 'req-5981f106-0a02-4727-b1b4-75e454f71602'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:20.975616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1352/2683] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:20 2022] PUT /identity/v3/projects/41a6bc6457624bdaaa525dcbc7a170b0/users/830e759bd74347028ffb2b5290e25d8c/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:20.980063 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f2b96acc0a4151b84a75bd0084a743', 'request_id': 'req-5981f106-0a02-4727-b1b4-75e454f71602'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:20.989488 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f2b96acc0a4151b84a75bd0084a743', 'request_id': 'req-5981f106-0a02-4727-b1b4-75e454f71602'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:21.012747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] The token cache is being invalidate because project 65f2b96acc0a4151b84a75bd0084a743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:21.013046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:21.013758 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:21.015383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1332/2684] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:20 2022] DELETE /identity/v3/projects/65f2b96acc0a4151b84a75bd0084a743 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:21.020675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b2fcc-8520-4d55-9802-1cf47e8dede0 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:21.021081 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b2fcc-8520-4d55-9802-1cf47e8dede0 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:21.021331 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b2fcc-8520-4d55-9802-1cf47e8dede0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:21.049344 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:21.050276 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-ad5b2fcc-8520-4d55-9802-1cf47e8dede0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:21.050854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:21.051466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ad5b2fcc-8520-4d55-9802-1cf47e8dede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:21.127419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1353/2685] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:21.131519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981f106-0a02-4727-b1b4-75e454f71602 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:21.136614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31343ca8-9a81-41b2-bf43-f44cb880cd77 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:21.136935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31343ca8-9a81-41b2-bf43-f44cb880cd77 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:21.137208 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31343ca8-9a81-41b2-bf43-f44cb880cd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:21.159954 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-31343ca8-9a81-41b2-bf43-f44cb880cd77 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:21.161274 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-31343ca8-9a81-41b2-bf43-f44cb880cd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:21.170255 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1354/2686] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:21.174469 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31343ca8-9a81-41b2-bf43-f44cb880cd77 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:21.189530 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31343ca8-9a81-41b2-bf43-f44cb880cd77 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:21.201649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7586c4-95bf-475d-8a71-adc3e789d941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:21.202690 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e85038-6c9a-4701-863f-41ee49fa1c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:21.202854 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7586c4-95bf-475d-8a71-adc3e789d941 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:21.203222 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7586c4-95bf-475d-8a71-adc3e789d941 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:21.203693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85038-6c9a-4701-863f-41ee49fa1c51 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:21.204019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7586c4-95bf-475d-8a71-adc3e789d941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:21.204146 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85038-6c9a-4701-863f-41ee49fa1c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:21.204309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85038-6c9a-4701-863f-41ee49fa1c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:21.205077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e85038-6c9a-4701-863f-41ee49fa1c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:26:21.205387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e85038-6c9a-4701-863f-41ee49fa1c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:21.206581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4f7586c4-95bf-475d-8a71-adc3e789d941 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:21.207114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e85038-6c9a-4701-863f-41ee49fa1c51 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:21.214076 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:21.225916 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1355/2687] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 16:26:21.227156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e85038-6c9a-4701-863f-41ee49fa1c51 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:21.244512 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e85038-6c9a-4701-863f-41ee49fa1c51 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:21.250049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a756647-90a8-4ee9-8fcb-3afbb313c1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:21.250806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a756647-90a8-4ee9-8fcb-3afbb313c1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:21.251219 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a756647-90a8-4ee9-8fcb-3afbb313c1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:21.252577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a756647-90a8-4ee9-8fcb-3afbb313c1a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:21.252577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a756647-90a8-4ee9-8fcb-3afbb313c1a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:21.254400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a756647-90a8-4ee9-8fcb-3afbb313c1a9 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:21.281081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7586c4-95bf-475d-8a71-adc3e789d941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:21.282571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7586c4-95bf-475d-8a71-adc3e789d941 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:21.283281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1356/2688] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:21 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:21.293519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a756647-90a8-4ee9-8fcb-3afbb313c1a9 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:21.294631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1333/2689] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:21.361246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:21.386283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a756647-90a8-4ee9-8fcb-3afbb313c1a9 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:21.392035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328cf0a-0ca8-4ece-8bc2-a5b05449216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:21.392811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328cf0a-0ca8-4ece-8bc2-a5b05449216a admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:21.393196 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328cf0a-0ca8-4ece-8bc2-a5b05449216a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:21.393471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328cf0a-0ca8-4ece-8bc2-a5b05449216a admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:21.394170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328cf0a-0ca8-4ece-8bc2-a5b05449216a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:21.396389 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328cf0a-0ca8-4ece-8bc2-a5b05449216a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:21.439319 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1357/2690] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:21 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:21.440084 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7586c4-95bf-475d-8a71-adc3e789d941 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:21.456051 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7586c4-95bf-475d-8a71-adc3e789d941 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:21.463275 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb65a8-7b77-4435-83ca-4ef610242661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:21.464206 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb65a8-7b77-4435-83ca-4ef610242661 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:21.464678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb65a8-7b77-4435-83ca-4ef610242661 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:21.465121 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb65a8-7b77-4435-83ca-4ef610242661 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:21.466381 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb65a8-7b77-4435-83ca-4ef610242661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:21.469106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb65a8-7b77-4435-83ca-4ef610242661 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:21.496192 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328cf0a-0ca8-4ece-8bc2-a5b05449216a admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:21.500657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1334/2691] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:26:21.507826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328cf0a-0ca8-4ece-8bc2-a5b05449216a admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:21.515935 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f97547-1a0c-4fde-ad7b-96288190176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:21.516576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f97547-1a0c-4fde-ad7b-96288190176c admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:21.517081 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f97547-1a0c-4fde-ad7b-96288190176c admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:21.517537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f97547-1a0c-4fde-ad7b-96288190176c admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:21.518689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f97547-1a0c-4fde-ad7b-96288190176c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:21.520946 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f97547-1a0c-4fde-ad7b-96288190176c admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:21.540845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb65a8-7b77-4435-83ca-4ef610242661 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:21.541070 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1358/2692] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:21.559490 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb65a8-7b77-4435-83ca-4ef610242661 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:21.567255 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b825c0-d944-4685-894b-b984c4ccb750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:21.568717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b825c0-d944-4685-894b-b984c4ccb750 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:21.569230 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b825c0-d944-4685-894b-b984c4ccb750 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:21.569774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b825c0-d944-4685-894b-b984c4ccb750 admin admin] PATH_INFO: `/v3/projects/fe7af77a5447475485fdcbd337995067/users/d95e28f04929463882891edf6e5459bf/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:21.593357 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b825c0-d944-4685-894b-b984c4ccb750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7af77a5447475485fdcbd337995067, user_id=d95e28f04929463882891edf6e5459bf, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:21.598227 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b825c0-d944-4685-894b-b984c4ccb750 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:21.620808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1335/2693] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:21 2022] PUT /identity/v3/projects/fe7af77a5447475485fdcbd337995067/users/d95e28f04929463882891edf6e5459bf/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:21.628897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bde7ca-8f98-403d-9fa0-e69dc9f0b50e None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:21.629176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bde7ca-8f98-403d-9fa0-e69dc9f0b50e None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:21.629452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bde7ca-8f98-403d-9fa0-e69dc9f0b50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:21.661550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-b1bde7ca-8f98-403d-9fa0-e69dc9f0b50e None None] MFA Rules not processed for user `d95e28f04929463882891edf6e5459bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:21.664034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b1bde7ca-8f98-403d-9fa0-e69dc9f0b50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:21.723584 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b825c0-d944-4685-894b-b984c4ccb750 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:21.725827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-c9b825c0-d944-4685-894b-b984c4ccb750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:21.752963 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1359/2694] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:21.753703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bde7ca-8f98-403d-9fa0-e69dc9f0b50e None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:21.813377 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b825c0-d944-4685-894b-b984c4ccb750 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:21.819686 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311a8de-c0b0-4e42-b741-3281cc002445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:21.820907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311a8de-c0b0-4e42-b741-3281cc002445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:21.821394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311a8de-c0b0-4e42-b741-3281cc002445 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:21.821739 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311a8de-c0b0-4e42-b741-3281cc002445 admin admin] PATH_INFO: `/v3/users/e165cf1b4e224e038856b82f66368595` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:21.823064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311a8de-c0b0-4e42-b741-3281cc002445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e165cf1b4e224e038856b82f66368595)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:21.825470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311a8de-c0b0-4e42-b741-3281cc002445 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:21.854855 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bde7ca-8f98-403d-9fa0-e69dc9f0b50e None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:21.862162 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce20471-2a61-4853-bd7a-9ac0d79c9e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:21.863292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce20471-2a61-4853-bd7a-9ac0d79c9e65 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:21.863967 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce20471-2a61-4853-bd7a-9ac0d79c9e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:21.864600 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce20471-2a61-4853-bd7a-9ac0d79c9e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:21.865572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce20471-2a61-4853-bd7a-9ac0d79c9e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:21.868110 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce20471-2a61-4853-bd7a-9ac0d79c9e65 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:21.893524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2311a8de-c0b0-4e42-b741-3281cc002445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e165cf1b4e224e038856b82f66368595'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:21.903122 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2311a8de-c0b0-4e42-b741-3281cc002445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e165cf1b4e224e038856b82f66368595'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:21.904096 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2311a8de-c0b0-4e42-b741-3281cc002445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e165cf1b4e224e038856b82f66368595'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:21.905194 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2311a8de-c0b0-4e42-b741-3281cc002445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e165cf1b4e224e038856b82f66368595'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:21.916016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-2311a8de-c0b0-4e42-b741-3281cc002445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e165cf1b4e224e038856b82f66368595'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:21.919233 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1360/2695] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:21 2022] POST /identity/v3/projects => generated 393 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:21.921192 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce20471-2a61-4853-bd7a-9ac0d79c9e65 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:21.922953 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9ce20471-2a61-4853-bd7a-9ac0d79c9e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:21.927360 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:21.940119 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1336/2696] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:21 2022] DELETE /identity/v3/users/e165cf1b4e224e038856b82f66368595 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:21.945538 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b9180-5b16-482f-aff0-0ba6fcbfde4f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:21.946432 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b9180-5b16-482f-aff0-0ba6fcbfde4f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:21.947139 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b9180-5b16-482f-aff0-0ba6fcbfde4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:21.971148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-3c4b9180-5b16-482f-aff0-0ba6fcbfde4f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:21.972246 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:21.973458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3c4b9180-5b16-482f-aff0-0ba6fcbfde4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:22.018452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce20471-2a61-4853-bd7a-9ac0d79c9e65 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:22.055619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1337/2697] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:26:22.067487 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b9180-5b16-482f-aff0-0ba6fcbfde4f None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:22.069087 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3c4b9180-5b16-482f-aff0-0ba6fcbfde4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:22.111648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec6baa-60e7-43ad-8bf6-98529e202985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:22.112541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec6baa-60e7-43ad-8bf6-98529e202985 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:22.113098 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec6baa-60e7-43ad-8bf6-98529e202985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:22.113473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec6baa-60e7-43ad-8bf6-98529e202985 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:22.114435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec6baa-60e7-43ad-8bf6-98529e202985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:22.116638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec6baa-60e7-43ad-8bf6-98529e202985 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:22.144628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1361/2698] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:21 2022] POST /identity/v3/users => generated 303 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:22.148868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b9180-5b16-482f-aff0-0ba6fcbfde4f None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:22.149187 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec6baa-60e7-43ad-8bf6-98529e202985 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:22.153258 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d53194-0e0f-4180-ad81-463e4e0257e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:22.154062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d53194-0e0f-4180-ad81-463e4e0257e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:22.154410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d53194-0e0f-4180-ad81-463e4e0257e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:22.154752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d53194-0e0f-4180-ad81-463e4e0257e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:22.161676 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec6baa-60e7-43ad-8bf6-98529e202985 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:22.165792 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d53194-0e0f-4180-ad81-463e4e0257e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:22.167331 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d53194-0e0f-4180-ad81-463e4e0257e1 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:22.168170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7192c6-1127-4b35-b72e-81d085ea85cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:22.169005 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7192c6-1127-4b35-b72e-81d085ea85cf admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:22.169483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7192c6-1127-4b35-b72e-81d085ea85cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:22.169826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7192c6-1127-4b35-b72e-81d085ea85cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:22.170674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7192c6-1127-4b35-b72e-81d085ea85cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:22.172642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7192c6-1127-4b35-b72e-81d085ea85cf admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:22.186304 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1338/2699] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:26:22.195157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1362/2700] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:22.201470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d53194-0e0f-4180-ad81-463e4e0257e1 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:22.214752 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d53194-0e0f-4180-ad81-463e4e0257e1 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:22.221392 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ff20f-f3ef-44ac-acb8-5e52551d2bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:22.222329 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ff20f-f3ef-44ac-acb8-5e52551d2bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:22.222622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ff20f-f3ef-44ac-acb8-5e52551d2bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:22.222942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ff20f-f3ef-44ac-acb8-5e52551d2bf9 admin admin] PATH_INFO: `/v3/projects/aadbb204d4364f89a201d05db55cb5db/users/dae5d591976b45c59a8055f5cb50ce1a/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:22.261039 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ff20f-f3ef-44ac-acb8-5e52551d2bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aadbb204d4364f89a201d05db55cb5db, user_id=dae5d591976b45c59a8055f5cb50ce1a, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:22.265852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ff20f-f3ef-44ac-acb8-5e52551d2bf9 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:22.294900 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1339/2701] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:22 2022] PUT /identity/v3/projects/aadbb204d4364f89a201d05db55cb5db/users/dae5d591976b45c59a8055f5cb50ce1a/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:22.300303 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7192c6-1127-4b35-b72e-81d085ea85cf admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:22.318078 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7192c6-1127-4b35-b72e-81d085ea85cf admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:22.394691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bff7da-2dfd-4382-8698-2e58532cd2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:22.396316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bff7da-2dfd-4382-8698-2e58532cd2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:22.396914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bff7da-2dfd-4382-8698-2e58532cd2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:22.396914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bff7da-2dfd-4382-8698-2e58532cd2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:22.398012 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bff7da-2dfd-4382-8698-2e58532cd2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:22.400038 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bff7da-2dfd-4382-8698-2e58532cd2f9 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:22.413071 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1363/2702] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:22.417408 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ff20f-f3ef-44ac-acb8-5e52551d2bf9 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:22.429909 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ff20f-f3ef-44ac-acb8-5e52551d2bf9 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:22.441134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd08ec-9a11-431a-b4f7-8958aba0e841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:22.442057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd08ec-9a11-431a-b4f7-8958aba0e841 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:22.442341 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd08ec-9a11-431a-b4f7-8958aba0e841 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:22.442619 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd08ec-9a11-431a-b4f7-8958aba0e841 admin admin] PATH_INFO: `/v3/projects/aadbb204d4364f89a201d05db55cb5db/users/dae5d591976b45c59a8055f5cb50ce1a/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:22.446571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd08ec-9a11-431a-b4f7-8958aba0e841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aadbb204d4364f89a201d05db55cb5db, user_id=dae5d591976b45c59a8055f5cb50ce1a, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:22.450156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd08ec-9a11-431a-b4f7-8958aba0e841 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:22.474650 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1340/2703] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:22 2022] PUT /identity/v3/projects/aadbb204d4364f89a201d05db55cb5db/users/dae5d591976b45c59a8055f5cb50ce1a/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:22.480017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9f30d-1daa-42db-b8b9-296e465f2da3 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:22.480360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9f30d-1daa-42db-b8b9-296e465f2da3 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:22.480620 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9f30d-1daa-42db-b8b9-296e465f2da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:22.530417 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-97a9f30d-1daa-42db-b8b9-296e465f2da3 None None] MFA Rules not processed for user `dae5d591976b45c59a8055f5cb50ce1a`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:22.531863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-97a9f30d-1daa-42db-b8b9-296e465f2da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:22.584254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd08ec-9a11-431a-b4f7-8958aba0e841 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:22.587556 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-70dd08ec-9a11-431a-b4f7-8958aba0e841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:22.592095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:22.670307 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1364/2704] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:22.677581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9f30d-1daa-42db-b8b9-296e465f2da3 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:22.681906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-97a9f30d-1daa-42db-b8b9-296e465f2da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:22.684917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:22.689642 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd08ec-9a11-431a-b4f7-8958aba0e841 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:22.703272 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:22.704932 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:22.705236 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:22.705517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] PATH_INFO: `/v3/projects/5b0c634d37f64f35acc0b8c33775a36e` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:22.707216 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0c634d37f64f35acc0b8c33775a36e)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:22.710021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:22.776861 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0c634d37f64f35acc0b8c33775a36e', 'request_id': 'req-e9674bad-7067-4257-8834-dfbe782406f4'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:22.777727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9f30d-1daa-42db-b8b9-296e465f2da3 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:22.785851 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0c634d37f64f35acc0b8c33775a36e', 'request_id': 'req-e9674bad-7067-4257-8834-dfbe782406f4'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:22.815051 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0c634d37f64f35acc0b8c33775a36e', 'request_id': 'req-e9674bad-7067-4257-8834-dfbe782406f4'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:22.856249 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4d9ed-e96b-41c6-bb2b-2580856b0f47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:22.857096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d9ed-e96b-41c6-bb2b-2580856b0f47 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:22.857386 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d9ed-e96b-41c6-bb2b-2580856b0f47 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:22.857661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d9ed-e96b-41c6-bb2b-2580856b0f47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:22.857958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] The token cache is being invalidate because project 5b0c634d37f64f35acc0b8c33775a36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:22.858411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:22.859967 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:22.862799 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1341/2705] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:22 2022] DELETE /identity/v3/projects/5b0c634d37f64f35acc0b8c33775a36e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:22.871017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:22.878157 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:22.987862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4d9ed-e96b-41c6-bb2b-2580856b0f47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:22.989564 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4d9ed-e96b-41c6-bb2b-2580856b0f47 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:23.007337 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1365/2706] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:23.010412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9674bad-7067-4257-8834-dfbe782406f4 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:23.016728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb208a5-4f45-4f00-a24c-ab3b219e3905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:23.017736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb208a5-4f45-4f00-a24c-ab3b219e3905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:23.018742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb208a5-4f45-4f00-a24c-ab3b219e3905 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:23.019380 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb208a5-4f45-4f00-a24c-ab3b219e3905 admin admin] PATH_INFO: `/v3/users/21384f38933344c683f033383b0aa79d` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:23.026442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb208a5-4f45-4f00-a24c-ab3b219e3905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21384f38933344c683f033383b0aa79d)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:23.028785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb208a5-4f45-4f00-a24c-ab3b219e3905 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:23.110541 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-9bb208a5-4f45-4f00-a24c-ab3b219e3905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21384f38933344c683f033383b0aa79d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:23.120236 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-9bb208a5-4f45-4f00-a24c-ab3b219e3905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21384f38933344c683f033383b0aa79d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:23.120721 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4d9ed-e96b-41c6-bb2b-2580856b0f47 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:23.121625 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-9bb208a5-4f45-4f00-a24c-ab3b219e3905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21384f38933344c683f033383b0aa79d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:23.122617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-9bb208a5-4f45-4f00-a24c-ab3b219e3905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21384f38933344c683f033383b0aa79d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:23.122979 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5ed4d9ed-e96b-41c6-bb2b-2580856b0f47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:23.140571 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-9bb208a5-4f45-4f00-a24c-ab3b219e3905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21384f38933344c683f033383b0aa79d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:23.147981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4d9ed-e96b-41c6-bb2b-2580856b0f47 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:23.158842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e96f5b-d87f-41ae-9f80-da69cab9215d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:23.160225 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e96f5b-d87f-41ae-9f80-da69cab9215d service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:23.160996 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e96f5b-d87f-41ae-9f80-da69cab9215d service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:23.161907 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e96f5b-d87f-41ae-9f80-da69cab9215d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:23.165312 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a4e96f5b-d87f-41ae-9f80-da69cab9215d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:23.176559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1342/2707] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:22 2022] DELETE /identity/v3/users/21384f38933344c683f033383b0aa79d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:23.242244 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:23.265251 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e96f5b-d87f-41ae-9f80-da69cab9215d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:23.267152 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e96f5b-d87f-41ae-9f80-da69cab9215d service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:23.283360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1366/2708] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:23.707211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb208a5-4f45-4f00-a24c-ab3b219e3905 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:23.709581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-9bb208a5-4f45-4f00-a24c-ab3b219e3905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:23.760248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:23.890091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb208a5-4f45-4f00-a24c-ab3b219e3905 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:23.897290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:23.899652 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:23.899947 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:23.900395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa admin admin] PATH_INFO: `/v3/projects/6b344b8aa88a46c9ad42602d8328a94d` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:23.902736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b344b8aa88a46c9ad42602d8328a94d)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:23.904884 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:23.999077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b344b8aa88a46c9ad42602d8328a94d', 'request_id': 'req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:24.005683 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b344b8aa88a46c9ad42602d8328a94d', 'request_id': 'req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:24.014590 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b344b8aa88a46c9ad42602d8328a94d', 'request_id': 'req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:24.067116 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa admin admin] The token cache is being invalidate because project 6b344b8aa88a46c9ad42602d8328a94d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:24.067547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:24.068417 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d87c7fd1-41a0-4b09-806a-86f7e81f24fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:24.076191 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1343/2709] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:23 2022] DELETE /identity/v3/projects/6b344b8aa88a46c9ad42602d8328a94d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:24.076804 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bcc34-2b8c-42fc-9523-2f5de69022de None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:24.077682 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bcc34-2b8c-42fc-9523-2f5de69022de None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:24.078301 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bcc34-2b8c-42fc-9523-2f5de69022de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:24.111341 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-975bcc34-2b8c-42fc-9523-2f5de69022de None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:24.112614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-975bcc34-2b8c-42fc-9523-2f5de69022de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:24.251041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1367/2710] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:24.253609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093084a4-8ad5-4b07-b606-e3b23913ecde None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:24.253900 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093084a4-8ad5-4b07-b606-e3b23913ecde None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:24.254176 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093084a4-8ad5-4b07-b606-e3b23913ecde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:24.283582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-093084a4-8ad5-4b07-b606-e3b23913ecde None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:24.285075 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-093084a4-8ad5-4b07-b606-e3b23913ecde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:24.303997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1344/2711] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:24.304827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bcc34-2b8c-42fc-9523-2f5de69022de None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:24.320445 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bcc34-2b8c-42fc-9523-2f5de69022de None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:24.327379 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e7fa2-ee20-4d6c-bd4d-70ad18baa224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:24.328734 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e7fa2-ee20-4d6c-bd4d-70ad18baa224 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:24.329196 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e7fa2-ee20-4d6c-bd4d-70ad18baa224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:24.329792 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e7fa2-ee20-4d6c-bd4d-70ad18baa224 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:24.330862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e7fa2-ee20-4d6c-bd4d-70ad18baa224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:26:24.331333 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e7fa2-ee20-4d6c-bd4d-70ad18baa224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:24.333382 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e7fa2-ee20-4d6c-bd4d-70ad18baa224 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:24.347974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1368/2712] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 16:26:24.354151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093084a4-8ad5-4b07-b606-e3b23913ecde None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:24.375083 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093084a4-8ad5-4b07-b606-e3b23913ecde None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:24.390068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4ac82-e49d-4313-941d-e84d7c386a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:24.390566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4ac82-e49d-4313-941d-e84d7c386a2d admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:24.391000 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4ac82-e49d-4313-941d-e84d7c386a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:24.391874 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4ac82-e49d-4313-941d-e84d7c386a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:24.393319 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4ac82-e49d-4313-941d-e84d7c386a2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:24.400232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4ac82-e49d-4313-941d-e84d7c386a2d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:24.465593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1345/2713] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:24 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:24.466405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e7fa2-ee20-4d6c-bd4d-70ad18baa224 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:24.482194 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e7fa2-ee20-4d6c-bd4d-70ad18baa224 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:24.585881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571068b-c5ef-4d64-a502-2149ef0444ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:24.586958 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571068b-c5ef-4d64-a502-2149ef0444ac admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:24.587242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571068b-c5ef-4d64-a502-2149ef0444ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:24.587520 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571068b-c5ef-4d64-a502-2149ef0444ac admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:24.588336 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571068b-c5ef-4d64-a502-2149ef0444ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:24.590305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571068b-c5ef-4d64-a502-2149ef0444ac admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:24.652077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1369/2714] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:24 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:24.653436 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4ac82-e49d-4313-941d-e84d7c386a2d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:24.669173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4ac82-e49d-4313-941d-e84d7c386a2d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:24.680769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69234c-ffb6-4adb-b1fb-9325e9e8b371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:24.681919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69234c-ffb6-4adb-b1fb-9325e9e8b371 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:24.685773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69234c-ffb6-4adb-b1fb-9325e9e8b371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:24.686197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69234c-ffb6-4adb-b1fb-9325e9e8b371 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:24.687235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69234c-ffb6-4adb-b1fb-9325e9e8b371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:24.689022 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69234c-ffb6-4adb-b1fb-9325e9e8b371 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:24.713938 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571068b-c5ef-4d64-a502-2149ef0444ac admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:24.721566 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1346/2715] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:24.729009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571068b-c5ef-4d64-a502-2149ef0444ac admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:24.748980 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15801355-670c-4b68-bb2f-16e50049c03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:24.753399 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15801355-670c-4b68-bb2f-16e50049c03b admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:24.754385 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15801355-670c-4b68-bb2f-16e50049c03b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:24.755065 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15801355-670c-4b68-bb2f-16e50049c03b admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:24.757476 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15801355-670c-4b68-bb2f-16e50049c03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:24.761660 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15801355-670c-4b68-bb2f-16e50049c03b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:24.783122 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1370/2716] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:24.784547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69234c-ffb6-4adb-b1fb-9325e9e8b371 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:24.797010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69234c-ffb6-4adb-b1fb-9325e9e8b371 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:24.813124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a73bd-4f8a-4a0c-b8e1-2c49362c71f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:24.814324 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a73bd-4f8a-4a0c-b8e1-2c49362c71f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:24.814870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a73bd-4f8a-4a0c-b8e1-2c49362c71f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:24.815916 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a73bd-4f8a-4a0c-b8e1-2c49362c71f6 admin admin] PATH_INFO: `/v3/projects/ad51cbe1cf324c1aa057e43259a01c47/users/2d3da15da2e6427f8613a36cf4e66ca0/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:24.847879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a73bd-4f8a-4a0c-b8e1-2c49362c71f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad51cbe1cf324c1aa057e43259a01c47, user_id=2d3da15da2e6427f8613a36cf4e66ca0, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:24.851471 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a73bd-4f8a-4a0c-b8e1-2c49362c71f6 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:24.889042 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1347/2717] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:24 2022] PUT /identity/v3/projects/ad51cbe1cf324c1aa057e43259a01c47/users/2d3da15da2e6427f8613a36cf4e66ca0/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:24.899282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4e5f9-35f0-4375-b755-84ca0f0f1a7b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:24.899787 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4e5f9-35f0-4375-b755-84ca0f0f1a7b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:24.900368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4e5f9-35f0-4375-b755-84ca0f0f1a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:24.943875 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-44d4e5f9-35f0-4375-b755-84ca0f0f1a7b None None] MFA Rules not processed for user `2d3da15da2e6427f8613a36cf4e66ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:24.945249 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-44d4e5f9-35f0-4375-b755-84ca0f0f1a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:25.031220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:25.076104 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1371/2718] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:25.088627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a73bd-4f8a-4a0c-b8e1-2c49362c71f6 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:25.090735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-aa1a73bd-4f8a-4a0c-b8e1-2c49362c71f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:25.156728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:25.192091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a73bd-4f8a-4a0c-b8e1-2c49362c71f6 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:25.207820 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5d4f6-3598-40cd-8188-86e101fb921b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:25.208559 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5d4f6-3598-40cd-8188-86e101fb921b service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:25.208850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5d4f6-3598-40cd-8188-86e101fb921b service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:25.209129 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5d4f6-3598-40cd-8188-86e101fb921b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:25.237197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5d4f6-3598-40cd-8188-86e101fb921b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:25.242954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5d4f6-3598-40cd-8188-86e101fb921b service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:25.264446 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1348/2719] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:26:27.068479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a835-b607-49f1-bb1c-9181c0ba5b4d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:27.068936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a835-b607-49f1-bb1c-9181c0ba5b4d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:27.069155 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a835-b607-49f1-bb1c-9181c0ba5b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:27.099015 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-07f3a835-b607-49f1-bb1c-9181c0ba5b4d None None] MFA Rules not processed for user `830e759bd74347028ffb2b5290e25d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:27.100245 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-07f3a835-b607-49f1-bb1c-9181c0ba5b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:27.192376 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1372/2720] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:27 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:27.201966 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5d4f6-3598-40cd-8188-86e101fb921b service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:27.205625 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-74a5d4f6-3598-40cd-8188-86e101fb921b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:27.307225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5d4f6-3598-40cd-8188-86e101fb921b service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:27.313543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b99294-c337-4d4b-a663-86490cd51edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:27.314211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b99294-c337-4d4b-a663-86490cd51edc service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:27.314490 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b99294-c337-4d4b-a663-86490cd51edc service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:27.314760 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b99294-c337-4d4b-a663-86490cd51edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:27.317529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b1b99294-c337-4d4b-a663-86490cd51edc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:27.384755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b99294-c337-4d4b-a663-86490cd51edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:27.386505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b99294-c337-4d4b-a663-86490cd51edc service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:27.397092 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1349/2721] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:27.868113 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a835-b607-49f1-bb1c-9181c0ba5b4d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:27.869780 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-07f3a835-b607-49f1-bb1c-9181c0ba5b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:27.963969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a835-b607-49f1-bb1c-9181c0ba5b4d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:27.969062 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1dec8-30ca-4391-9203-423f57a4c999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:27.970050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1dec8-30ca-4391-9203-423f57a4c999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:27.970400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1dec8-30ca-4391-9203-423f57a4c999 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:27.970743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1dec8-30ca-4391-9203-423f57a4c999 admin admin] PATH_INFO: `/v3/users/d95e28f04929463882891edf6e5459bf` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:27.972022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1dec8-30ca-4391-9203-423f57a4c999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95e28f04929463882891edf6e5459bf)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:27.974082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1dec8-30ca-4391-9203-423f57a4c999 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:28.031801 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a3a1dec8-30ca-4391-9203-423f57a4c999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95e28f04929463882891edf6e5459bf'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.052103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a3a1dec8-30ca-4391-9203-423f57a4c999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95e28f04929463882891edf6e5459bf'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.052887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a3a1dec8-30ca-4391-9203-423f57a4c999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95e28f04929463882891edf6e5459bf'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.053507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a3a1dec8-30ca-4391-9203-423f57a4c999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95e28f04929463882891edf6e5459bf'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.063614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a3a1dec8-30ca-4391-9203-423f57a4c999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95e28f04929463882891edf6e5459bf'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.068486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:28.091942 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1373/2722] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:27 2022] DELETE /identity/v3/users/d95e28f04929463882891edf6e5459bf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:28.092103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ab1f-deb7-4fa5-a66c-3a0c0975f610 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:28.092815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ab1f-deb7-4fa5-a66c-3a0c0975f610 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:28.093101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ab1f-deb7-4fa5-a66c-3a0c0975f610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:28.113668 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-2207ab1f-deb7-4fa5-a66c-3a0c0975f610 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:28.115150 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2207ab1f-deb7-4fa5-a66c-3a0c0975f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:28.204519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1350/2723] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:28.218004 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1dec8-30ca-4391-9203-423f57a4c999 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:28.220029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a3a1dec8-30ca-4391-9203-423f57a4c999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:28.289767 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1dec8-30ca-4391-9203-423f57a4c999 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:28.294402 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec37dde-8341-410f-a79a-6b67ba7917d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:28.295091 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec37dde-8341-410f-a79a-6b67ba7917d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:28.295374 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec37dde-8341-410f-a79a-6b67ba7917d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:28.295860 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec37dde-8341-410f-a79a-6b67ba7917d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:28.307659 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec37dde-8341-410f-a79a-6b67ba7917d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:28.309259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec37dde-8341-410f-a79a-6b67ba7917d8 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:28.322235 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1374/2724] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:26:28.511549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3707f7-d5e5-43ad-955d-b0470f9d5866 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:28.512269 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3707f7-d5e5-43ad-955d-b0470f9d5866 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:28.512598 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3707f7-d5e5-43ad-955d-b0470f9d5866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:28.532720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-6e3707f7-d5e5-43ad-955d-b0470f9d5866 None None] MFA Rules not processed for user `46b01ee6b70b4da38f9735df5ecc0d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:28.534017 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6e3707f7-d5e5-43ad-955d-b0470f9d5866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:28.543824 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:28.601196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1351/2725] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:28.652955 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec37dde-8341-410f-a79a-6b67ba7917d8 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:28.654918 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-fec37dde-8341-410f-a79a-6b67ba7917d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:28.677908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec37dde-8341-410f-a79a-6b67ba7917d8 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:28.682667 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:28.683555 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:28.683891 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:28.684172 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] PATH_INFO: `/v3/projects/fe7af77a5447475485fdcbd337995067` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:28.685522 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7af77a5447475485fdcbd337995067)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:28.687457 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:28.750519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7af77a5447475485fdcbd337995067', 'request_id': 'req-e037a394-59fa-427a-a0f1-1278e0b2a73b'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.758298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7af77a5447475485fdcbd337995067', 'request_id': 'req-e037a394-59fa-427a-a0f1-1278e0b2a73b'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.765102 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7af77a5447475485fdcbd337995067', 'request_id': 'req-e037a394-59fa-427a-a0f1-1278e0b2a73b'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.780576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] The token cache is being invalidate because project fe7af77a5447475485fdcbd337995067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:28.780873 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.782142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.784065 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1375/2726] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:28 2022] DELETE /identity/v3/projects/fe7af77a5447475485fdcbd337995067 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:28.788207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3707f7-d5e5-43ad-955d-b0470f9d5866 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:28.800410 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3707f7-d5e5-43ad-955d-b0470f9d5866 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:28.859023 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bcfff-fc7a-433b-9377-292fae3df376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:28.860246 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcfff-fc7a-433b-9377-292fae3df376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:28.860769 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcfff-fc7a-433b-9377-292fae3df376 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:28.861207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcfff-fc7a-433b-9377-292fae3df376 admin admin] PATH_INFO: `/v3/users/dae5d591976b45c59a8055f5cb50ce1a` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:28.862637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bcfff-fc7a-433b-9377-292fae3df376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dae5d591976b45c59a8055f5cb50ce1a)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:28.864606 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bcfff-fc7a-433b-9377-292fae3df376 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:28.919691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-584bcfff-fc7a-433b-9377-292fae3df376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dae5d591976b45c59a8055f5cb50ce1a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.928005 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-584bcfff-fc7a-433b-9377-292fae3df376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dae5d591976b45c59a8055f5cb50ce1a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.928861 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-584bcfff-fc7a-433b-9377-292fae3df376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dae5d591976b45c59a8055f5cb50ce1a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.929935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-584bcfff-fc7a-433b-9377-292fae3df376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dae5d591976b45c59a8055f5cb50ce1a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.942862 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-584bcfff-fc7a-433b-9377-292fae3df376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dae5d591976b45c59a8055f5cb50ce1a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:28.968902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1352/2727] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:28 2022] DELETE /identity/v3/users/dae5d591976b45c59a8055f5cb50ce1a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:29.365218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:29.367306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:29.383631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037a394-59fa-427a-a0f1-1278e0b2a73b admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:29.473097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6284d21-b275-4f5b-9af8-7055c21ae0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:29.473942 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6284d21-b275-4f5b-9af8-7055c21ae0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:29.474227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6284d21-b275-4f5b-9af8-7055c21ae0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:29.474505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6284d21-b275-4f5b-9af8-7055c21ae0d1 admin admin] PATH_INFO: `/v3/projects/aadbb204d4364f89a201d05db55cb5db` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:29.475743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6284d21-b275-4f5b-9af8-7055c21ae0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aadbb204d4364f89a201d05db55cb5db)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:29.478146 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6284d21-b275-4f5b-9af8-7055c21ae0d1 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:29.490723 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:29.528056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f6284d21-b275-4f5b-9af8-7055c21ae0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aadbb204d4364f89a201d05db55cb5db', 'request_id': 'req-f6284d21-b275-4f5b-9af8-7055c21ae0d1'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:29.534200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f6284d21-b275-4f5b-9af8-7055c21ae0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aadbb204d4364f89a201d05db55cb5db', 'request_id': 'req-f6284d21-b275-4f5b-9af8-7055c21ae0d1'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:29.541169 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f6284d21-b275-4f5b-9af8-7055c21ae0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aadbb204d4364f89a201d05db55cb5db', 'request_id': 'req-f6284d21-b275-4f5b-9af8-7055c21ae0d1'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:29.555539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f6284d21-b275-4f5b-9af8-7055c21ae0d1 admin admin] The token cache is being invalidate because project aadbb204d4364f89a201d05db55cb5db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:29.555837 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f6284d21-b275-4f5b-9af8-7055c21ae0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:29.556515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f6284d21-b275-4f5b-9af8-7055c21ae0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:29.558254 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1376/2728] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:29 2022] DELETE /identity/v3/projects/aadbb204d4364f89a201d05db55cb5db => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:29.563412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559cddc-17cb-4fda-a8ff-8068f3c8666d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:29.564238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559cddc-17cb-4fda-a8ff-8068f3c8666d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:29.564552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559cddc-17cb-4fda-a8ff-8068f3c8666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:29.582979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-a559cddc-17cb-4fda-a8ff-8068f3c8666d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:29.584202 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-a559cddc-17cb-4fda-a8ff-8068f3c8666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:29.624504 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:29.655169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1353/2729] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:29.663200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66752-be04-4dfb-9351-174b27e724db None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:29.663568 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66752-be04-4dfb-9351-174b27e724db None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:29.663914 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66752-be04-4dfb-9351-174b27e724db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:29.682981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-32e66752-be04-4dfb-9351-174b27e724db None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:29.684320 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-32e66752-be04-4dfb-9351-174b27e724db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:29.692658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1377/2730] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:29.697053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559cddc-17cb-4fda-a8ff-8068f3c8666d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:29.707411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559cddc-17cb-4fda-a8ff-8068f3c8666d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:29.712315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12be5d-91a5-4df4-b87e-4fd9c6ce47f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:29.712993 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12be5d-91a5-4df4-b87e-4fd9c6ce47f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:29.713269 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12be5d-91a5-4df4-b87e-4fd9c6ce47f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:29.713543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12be5d-91a5-4df4-b87e-4fd9c6ce47f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:29.714307 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12be5d-91a5-4df4-b87e-4fd9c6ce47f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:26:29.714611 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12be5d-91a5-4df4-b87e-4fd9c6ce47f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:29.716212 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12be5d-91a5-4df4-b87e-4fd9c6ce47f6 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:29.729417 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1354/2731] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:26:29.733899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e66752-be04-4dfb-9351-174b27e724db None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:29.743631 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e66752-be04-4dfb-9351-174b27e724db None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:29.748588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648fe2a-c64b-4416-92ab-6b71b1a5a7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:29.749265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648fe2a-c64b-4416-92ab-6b71b1a5a7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:29.749545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648fe2a-c64b-4416-92ab-6b71b1a5a7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:29.749847 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648fe2a-c64b-4416-92ab-6b71b1a5a7a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:29.750541 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648fe2a-c64b-4416-92ab-6b71b1a5a7a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:29.752498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648fe2a-c64b-4416-92ab-6b71b1a5a7a9 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:29.782099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1378/2732] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:29 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:29.783287 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12be5d-91a5-4df4-b87e-4fd9c6ce47f6 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:29.793560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12be5d-91a5-4df4-b87e-4fd9c6ce47f6 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:29.852458 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e5dce-e7b3-48ad-9711-ddf5c528b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:29.853138 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e5dce-e7b3-48ad-9711-ddf5c528b077 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:29.853762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e5dce-e7b3-48ad-9711-ddf5c528b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:29.853762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e5dce-e7b3-48ad-9711-ddf5c528b077 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:29.854441 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e5dce-e7b3-48ad-9711-ddf5c528b077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:29.856678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e5dce-e7b3-48ad-9711-ddf5c528b077 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:29.879667 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1355/2733] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:29 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:29.883999 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648fe2a-c64b-4416-92ab-6b71b1a5a7a9 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:29.894809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648fe2a-c64b-4416-92ab-6b71b1a5a7a9 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:29.900027 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dfe6b-1fee-40a3-a3e2-d371eb44eb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:29.900737 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dfe6b-1fee-40a3-a3e2-d371eb44eb49 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:29.901136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dfe6b-1fee-40a3-a3e2-d371eb44eb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:29.901412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dfe6b-1fee-40a3-a3e2-d371eb44eb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:29.902352 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dfe6b-1fee-40a3-a3e2-d371eb44eb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:29.904576 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dfe6b-1fee-40a3-a3e2-d371eb44eb49 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:29.920127 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1379/2734] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:29.921608 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e5dce-e7b3-48ad-9711-ddf5c528b077 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:29.932346 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e5dce-e7b3-48ad-9711-ddf5c528b077 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:29.937949 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27794d8-527e-4974-bd24-9f0a9589fd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:29.938772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27794d8-527e-4974-bd24-9f0a9589fd28 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:29.939038 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27794d8-527e-4974-bd24-9f0a9589fd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:29.939429 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27794d8-527e-4974-bd24-9f0a9589fd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:29.940925 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27794d8-527e-4974-bd24-9f0a9589fd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:29.942639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27794d8-527e-4974-bd24-9f0a9589fd28 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:29.957516 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1356/2735] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:29.958708 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dfe6b-1fee-40a3-a3e2-d371eb44eb49 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:29.970006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dfe6b-1fee-40a3-a3e2-d371eb44eb49 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:29.976542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70819c6-45a0-465d-936d-0f14265c7a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:29.977609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70819c6-45a0-465d-936d-0f14265c7a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:29.978006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70819c6-45a0-465d-936d-0f14265c7a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:29.978391 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70819c6-45a0-465d-936d-0f14265c7a8c admin admin] PATH_INFO: `/v3/projects/65fd1c1ce8d04ef3a5db794fb46de04f/users/06e7b71029cb41858b8832dc5b51551e/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:29.997347 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70819c6-45a0-465d-936d-0f14265c7a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65fd1c1ce8d04ef3a5db794fb46de04f, user_id=06e7b71029cb41858b8832dc5b51551e, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:30.000056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70819c6-45a0-465d-936d-0f14265c7a8c admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:30.032157 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1380/2736] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:29 2022] PUT /identity/v3/projects/65fd1c1ce8d04ef3a5db794fb46de04f/users/06e7b71029cb41858b8832dc5b51551e/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:30.042437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93047bf5-5a83-49ac-b504-d09e8b364143 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:30.043005 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93047bf5-5a83-49ac-b504-d09e8b364143 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:30.043449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93047bf5-5a83-49ac-b504-d09e8b364143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:30.077032 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-93047bf5-5a83-49ac-b504-d09e8b364143 None None] MFA Rules not processed for user `06e7b71029cb41858b8832dc5b51551e`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:30.078309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-93047bf5-5a83-49ac-b504-d09e8b364143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:30.180281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1357/2737] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:30.184958 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70819c6-45a0-465d-936d-0f14265c7a8c admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:30.257926 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70819c6-45a0-465d-936d-0f14265c7a8c admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:30.262901 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3b025-62d7-4dd3-a5b0-d71e10affb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:30.263580 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3b025-62d7-4dd3-a5b0-d71e10affb74 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:30.263866 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3b025-62d7-4dd3-a5b0-d71e10affb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:30.264148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3b025-62d7-4dd3-a5b0-d71e10affb74 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:30.265003 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3b025-62d7-4dd3-a5b0-d71e10affb74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:30.266995 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3b025-62d7-4dd3-a5b0-d71e10affb74 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:30.298644 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1381/2738] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:30 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:30.300025 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93047bf5-5a83-49ac-b504-d09e8b364143 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:30.313472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93047bf5-5a83-49ac-b504-d09e8b364143 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:30.352908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:30.403442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ccc4b-0484-40b1-a695-ec5a01fa220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:30.404684 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ccc4b-0484-40b1-a695-ec5a01fa220f admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:30.405047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ccc4b-0484-40b1-a695-ec5a01fa220f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:30.405425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ccc4b-0484-40b1-a695-ec5a01fa220f admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:30.406470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ccc4b-0484-40b1-a695-ec5a01fa220f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:30.408777 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ccc4b-0484-40b1-a695-ec5a01fa220f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:30.444281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1358/2739] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:30 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:30.448617 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3b025-62d7-4dd3-a5b0-d71e10affb74 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:30.460919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3b025-62d7-4dd3-a5b0-d71e10affb74 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:30.467369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821e0ca-f72c-4755-92dc-aced4a764fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:30.468184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821e0ca-f72c-4755-92dc-aced4a764fbc admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:30.468388 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821e0ca-f72c-4755-92dc-aced4a764fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:30.468665 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821e0ca-f72c-4755-92dc-aced4a764fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:30.476637 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821e0ca-f72c-4755-92dc-aced4a764fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:30.478574 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821e0ca-f72c-4755-92dc-aced4a764fbc admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:30.496486 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1382/2740] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:30.497900 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ccc4b-0484-40b1-a695-ec5a01fa220f admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:30.509826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ccc4b-0484-40b1-a695-ec5a01fa220f admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:30.519285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b6cf6-983d-4caa-8009-f5f42d5e3930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:30.520010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6cf6-983d-4caa-8009-f5f42d5e3930 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:30.520397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6cf6-983d-4caa-8009-f5f42d5e3930 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:30.520740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6cf6-983d-4caa-8009-f5f42d5e3930 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:30.521544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b6cf6-983d-4caa-8009-f5f42d5e3930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:30.523321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b6cf6-983d-4caa-8009-f5f42d5e3930 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:30.539591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1359/2741] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:30.540936 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821e0ca-f72c-4755-92dc-aced4a764fbc admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:30.551304 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821e0ca-f72c-4755-92dc-aced4a764fbc admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:30.556817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b553d0e-e149-409c-b7cf-7e8e3414843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:30.557726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b553d0e-e149-409c-b7cf-7e8e3414843d admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:30.558008 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b553d0e-e149-409c-b7cf-7e8e3414843d admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:30.558287 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b553d0e-e149-409c-b7cf-7e8e3414843d admin admin] PATH_INFO: `/v3/projects/b0dee976f91b435594b3e463f4507cf1/users/c9ce797693a44b438a3c8c87c28dd8bd/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:30.566944 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:30.576170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b553d0e-e149-409c-b7cf-7e8e3414843d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0dee976f91b435594b3e463f4507cf1, user_id=c9ce797693a44b438a3c8c87c28dd8bd, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:30.580340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b553d0e-e149-409c-b7cf-7e8e3414843d admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:30.600382 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1383/2742] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:30 2022] PUT /identity/v3/projects/b0dee976f91b435594b3e463f4507cf1/users/c9ce797693a44b438a3c8c87c28dd8bd/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:30.661036 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329cd5-80ce-4686-9985-7627a8c4946c None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:30.661618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329cd5-80ce-4686-9985-7627a8c4946c None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:30.665071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329cd5-80ce-4686-9985-7627a8c4946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:30.694552 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-05329cd5-80ce-4686-9985-7627a8c4946c None None] MFA Rules not processed for user `c9ce797693a44b438a3c8c87c28dd8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:30.696358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-05329cd5-80ce-4686-9985-7627a8c4946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:30.779289 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1360/2743] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:30.783988 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b553d0e-e149-409c-b7cf-7e8e3414843d admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:30.874883 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b553d0e-e149-409c-b7cf-7e8e3414843d admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:30.880420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bb4e9-ae4d-40ae-9841-6e4cf1183118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:30.881304 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bb4e9-ae4d-40ae-9841-6e4cf1183118 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:30.881538 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bb4e9-ae4d-40ae-9841-6e4cf1183118 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:30.882090 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bb4e9-ae4d-40ae-9841-6e4cf1183118 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:30.882865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bb4e9-ae4d-40ae-9841-6e4cf1183118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:30.884822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bb4e9-ae4d-40ae-9841-6e4cf1183118 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:30.924338 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1384/2744] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:30 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:30.927419 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05329cd5-80ce-4686-9985-7627a8c4946c None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:30.943021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05329cd5-80ce-4686-9985-7627a8c4946c None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:31.022361 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c775ac-5d65-4302-a4bd-de4a56eadc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:31.023634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c775ac-5d65-4302-a4bd-de4a56eadc3b admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:31.023634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c775ac-5d65-4302-a4bd-de4a56eadc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:31.024148 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c775ac-5d65-4302-a4bd-de4a56eadc3b admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:31.024986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c775ac-5d65-4302-a4bd-de4a56eadc3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:31.027231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c775ac-5d65-4302-a4bd-de4a56eadc3b admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:31.056460 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1361/2745] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:30 2022] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:31.061798 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bb4e9-ae4d-40ae-9841-6e4cf1183118 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:31.074709 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bb4e9-ae4d-40ae-9841-6e4cf1183118 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:31.080099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec0d61-67fc-4a9c-a287-b60d726ef047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:31.080889 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec0d61-67fc-4a9c-a287-b60d726ef047 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:31.081447 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec0d61-67fc-4a9c-a287-b60d726ef047 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:31.081722 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec0d61-67fc-4a9c-a287-b60d726ef047 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:31.083909 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec0d61-67fc-4a9c-a287-b60d726ef047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:31.084100 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec0d61-67fc-4a9c-a287-b60d726ef047 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:31.098243 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1385/2746] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:26:31.105797 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c775ac-5d65-4302-a4bd-de4a56eadc3b admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:31.119270 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c775ac-5d65-4302-a4bd-de4a56eadc3b admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:31.125626 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fae3ce-0179-4d57-a161-0e19a0d294a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:31.126609 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fae3ce-0179-4d57-a161-0e19a0d294a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:31.126939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fae3ce-0179-4d57-a161-0e19a0d294a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:31.127255 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fae3ce-0179-4d57-a161-0e19a0d294a0 admin admin] PATH_INFO: `/v3/projects/ac36dcb0c9a14cb1b476f20cbba3dc5a/users/3f52c27c411e4d93823b478a5450593e/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:31.147352 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fae3ce-0179-4d57-a161-0e19a0d294a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac36dcb0c9a14cb1b476f20cbba3dc5a, user_id=3f52c27c411e4d93823b478a5450593e, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:31.150549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fae3ce-0179-4d57-a161-0e19a0d294a0 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:31.166207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1362/2747] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:31 2022] PUT /identity/v3/projects/ac36dcb0c9a14cb1b476f20cbba3dc5a/users/3f52c27c411e4d93823b478a5450593e/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:31.170462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec0d61-67fc-4a9c-a287-b60d726ef047 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:31.182004 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec0d61-67fc-4a9c-a287-b60d726ef047 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:31.263195 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b45675-cc86-4d96-afa1-a70349f85f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:31.264120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b45675-cc86-4d96-afa1-a70349f85f43 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:31.264537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b45675-cc86-4d96-afa1-a70349f85f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:31.264820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b45675-cc86-4d96-afa1-a70349f85f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:31.265571 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b45675-cc86-4d96-afa1-a70349f85f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:31.267204 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b45675-cc86-4d96-afa1-a70349f85f43 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:31.278798 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1386/2748] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:31.282950 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fae3ce-0179-4d57-a161-0e19a0d294a0 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:31.294858 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fae3ce-0179-4d57-a161-0e19a0d294a0 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:31.301006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615fe7a-6444-4d8c-8fd7-0ae62519781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:31.301942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615fe7a-6444-4d8c-8fd7-0ae62519781d admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:31.302229 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615fe7a-6444-4d8c-8fd7-0ae62519781d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:31.302517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615fe7a-6444-4d8c-8fd7-0ae62519781d admin admin] PATH_INFO: `/v3/projects/ac36dcb0c9a14cb1b476f20cbba3dc5a/users/3f52c27c411e4d93823b478a5450593e/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:31.304868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615fe7a-6444-4d8c-8fd7-0ae62519781d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac36dcb0c9a14cb1b476f20cbba3dc5a, user_id=3f52c27c411e4d93823b478a5450593e, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:31.307544 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615fe7a-6444-4d8c-8fd7-0ae62519781d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:31.310129 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:31.320117 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1363/2749] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:31 2022] PUT /identity/v3/projects/ac36dcb0c9a14cb1b476f20cbba3dc5a/users/3f52c27c411e4d93823b478a5450593e/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:31.332227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d554cf-af5e-4213-b609-9c0c85377c15 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:31.332557 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d554cf-af5e-4213-b609-9c0c85377c15 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:31.332836 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d554cf-af5e-4213-b609-9c0c85377c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:31.369310 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-c3d554cf-af5e-4213-b609-9c0c85377c15 None None] MFA Rules not processed for user `3f52c27c411e4d93823b478a5450593e`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:31.370528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c3d554cf-af5e-4213-b609-9c0c85377c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:31.442560 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:31.472262 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1387/2750] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:31.484231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615fe7a-6444-4d8c-8fd7-0ae62519781d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:31.486198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4615fe7a-6444-4d8c-8fd7-0ae62519781d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:31.552599 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615fe7a-6444-4d8c-8fd7-0ae62519781d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:31.557369 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec7712-22fb-4e19-84be-0018c289f6f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:31.558049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec7712-22fb-4e19-84be-0018c289f6f8 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:31.558333 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec7712-22fb-4e19-84be-0018c289f6f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:31.558604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec7712-22fb-4e19-84be-0018c289f6f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:31.575700 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec7712-22fb-4e19-84be-0018c289f6f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:31.575700 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec7712-22fb-4e19-84be-0018c289f6f8 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:31.587437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1364/2751] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:31.631573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d554cf-af5e-4213-b609-9c0c85377c15 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:31.634199 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-c3d554cf-af5e-4213-b609-9c0c85377c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:31.646448 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d554cf-af5e-4213-b609-9c0c85377c15 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:31.650312 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe5b0a-f332-4a4e-9e03-f633c6cf3759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:31.650989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe5b0a-f332-4a4e-9e03-f633c6cf3759 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:31.651267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe5b0a-f332-4a4e-9e03-f633c6cf3759 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:31.651536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe5b0a-f332-4a4e-9e03-f633c6cf3759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:31.714456 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe5b0a-f332-4a4e-9e03-f633c6cf3759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:31.715949 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe5b0a-f332-4a4e-9e03-f633c6cf3759 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:31.729566 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1388/2752] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:33.343954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec7712-22fb-4e19-84be-0018c289f6f8 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:33.345490 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-adec7712-22fb-4e19-84be-0018c289f6f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:33.438549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec7712-22fb-4e19-84be-0018c289f6f8 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:33.444010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be658e1-dc98-452a-9c2b-768113c49d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:33.444938 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be658e1-dc98-452a-9c2b-768113c49d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:33.445225 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be658e1-dc98-452a-9c2b-768113c49d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:33.445590 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be658e1-dc98-452a-9c2b-768113c49d96 admin admin] PATH_INFO: `/v3/users/2d3da15da2e6427f8613a36cf4e66ca0` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:33.446915 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be658e1-dc98-452a-9c2b-768113c49d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d3da15da2e6427f8613a36cf4e66ca0)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:33.448954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be658e1-dc98-452a-9c2b-768113c49d96 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:33.506778 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7be658e1-dc98-452a-9c2b-768113c49d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d3da15da2e6427f8613a36cf4e66ca0'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:33.516079 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7be658e1-dc98-452a-9c2b-768113c49d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d3da15da2e6427f8613a36cf4e66ca0'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:33.517213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7be658e1-dc98-452a-9c2b-768113c49d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d3da15da2e6427f8613a36cf4e66ca0'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:33.517908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7be658e1-dc98-452a-9c2b-768113c49d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d3da15da2e6427f8613a36cf4e66ca0'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:33.526971 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-7be658e1-dc98-452a-9c2b-768113c49d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d3da15da2e6427f8613a36cf4e66ca0'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:33.547835 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1365/2753] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:33 2022] DELETE /identity/v3/users/2d3da15da2e6427f8613a36cf4e66ca0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:33.553192 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151cbf1-22e9-4fb1-a1ad-e2827e8e5b65 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:33.553743 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151cbf1-22e9-4fb1-a1ad-e2827e8e5b65 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:33.554176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151cbf1-22e9-4fb1-a1ad-e2827e8e5b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:33.574370 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-8151cbf1-22e9-4fb1-a1ad-e2827e8e5b65 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:33.575581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8151cbf1-22e9-4fb1-a1ad-e2827e8e5b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:33.646573 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1389/2754] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:33.656416 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be658e1-dc98-452a-9c2b-768113c49d96 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:33.658019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7be658e1-dc98-452a-9c2b-768113c49d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:33.677560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:33.721657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be658e1-dc98-452a-9c2b-768113c49d96 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:33.725770 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ceaaf1-4473-4a74-ad58-d712e9623087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:33.726422 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceaaf1-4473-4a74-ad58-d712e9623087 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:33.726818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceaaf1-4473-4a74-ad58-d712e9623087 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:33.727103 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceaaf1-4473-4a74-ad58-d712e9623087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:33.736706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ceaaf1-4473-4a74-ad58-d712e9623087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:33.738155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ceaaf1-4473-4a74-ad58-d712e9623087 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:33.748251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1366/2755] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:34.045981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151cbf1-22e9-4fb1-a1ad-e2827e8e5b65 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:34.047471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-8151cbf1-22e9-4fb1-a1ad-e2827e8e5b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:34.066572 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151cbf1-22e9-4fb1-a1ad-e2827e8e5b65 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:34.071932 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:34.073087 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:34.073248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:34.073534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304 admin admin] PATH_INFO: `/v3/projects/ad51cbe1cf324c1aa057e43259a01c47` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:34.074727 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad51cbe1cf324c1aa057e43259a01c47)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:34.076718 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:34.128041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad51cbe1cf324c1aa057e43259a01c47', 'request_id': 'req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:34.135422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad51cbe1cf324c1aa057e43259a01c47', 'request_id': 'req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:34.141712 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad51cbe1cf324c1aa057e43259a01c47', 'request_id': 'req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:34.157823 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304 admin admin] The token cache is being invalidate because project ad51cbe1cf324c1aa057e43259a01c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:34.158064 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:34.158641 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a7609aad-d1ee-4bf9-b75d-f7b6a8695304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:34.160235 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1390/2756] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:34 2022] DELETE /identity/v3/projects/ad51cbe1cf324c1aa057e43259a01c47 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:34.165365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc1f9e-b508-4a46-8372-fa4004fe14ca None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:34.165654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc1f9e-b508-4a46-8372-fa4004fe14ca None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:34.165929 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc1f9e-b508-4a46-8372-fa4004fe14ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:34.186187 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-2fbc1f9e-b508-4a46-8372-fa4004fe14ca None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:34.187432 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2fbc1f9e-b508-4a46-8372-fa4004fe14ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:34.253995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1367/2757] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:34.263061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29564446-22af-4463-8c05-692c2ecbac2b None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:34.263351 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29564446-22af-4463-8c05-692c2ecbac2b None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:34.263687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29564446-22af-4463-8c05-692c2ecbac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:34.275707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:34.287968 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-29564446-22af-4463-8c05-692c2ecbac2b None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:34.289857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-29564446-22af-4463-8c05-692c2ecbac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:34.299458 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1391/2758] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:34.303704 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc1f9e-b508-4a46-8372-fa4004fe14ca None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:34.314474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc1f9e-b508-4a46-8372-fa4004fe14ca None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:34.319923 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525088b-5134-41e9-8b35-9420b13f9739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:34.320914 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525088b-5134-41e9-8b35-9420b13f9739 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:34.321193 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525088b-5134-41e9-8b35-9420b13f9739 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:34.321478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525088b-5134-41e9-8b35-9420b13f9739 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:34.322197 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525088b-5134-41e9-8b35-9420b13f9739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:26:34.322500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525088b-5134-41e9-8b35-9420b13f9739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:34.324408 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525088b-5134-41e9-8b35-9420b13f9739 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:34.342262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1368/2759] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:26:34.347259 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29564446-22af-4463-8c05-692c2ecbac2b None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:34.357820 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29564446-22af-4463-8c05-692c2ecbac2b None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:34.362882 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516fde5-322f-4baa-a6cb-2925abe2cb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:34.363670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516fde5-322f-4baa-a6cb-2925abe2cb73 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:34.364073 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516fde5-322f-4baa-a6cb-2925abe2cb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:34.364366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516fde5-322f-4baa-a6cb-2925abe2cb73 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:34.365184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516fde5-322f-4baa-a6cb-2925abe2cb73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:34.367279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516fde5-322f-4baa-a6cb-2925abe2cb73 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:34.395905 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1392/2760] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:34 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:34.400195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525088b-5134-41e9-8b35-9420b13f9739 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:34.411004 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525088b-5134-41e9-8b35-9420b13f9739 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:34.475133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c10e5e-e306-4872-b78f-1c65815bc786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:34.475812 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c10e5e-e306-4872-b78f-1c65815bc786 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:34.476091 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c10e5e-e306-4872-b78f-1c65815bc786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:34.476385 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c10e5e-e306-4872-b78f-1c65815bc786 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:34.477131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c10e5e-e306-4872-b78f-1c65815bc786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:34.479195 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c10e5e-e306-4872-b78f-1c65815bc786 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:34.502432 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1369/2761] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:34 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:26:34.506810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516fde5-322f-4baa-a6cb-2925abe2cb73 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:34.517587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516fde5-322f-4baa-a6cb-2925abe2cb73 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:34.523329 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80c405-296b-4118-b772-01b73dfbc9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:34.524670 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80c405-296b-4118-b772-01b73dfbc9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:34.524952 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80c405-296b-4118-b772-01b73dfbc9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:34.525222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80c405-296b-4118-b772-01b73dfbc9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:34.525974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80c405-296b-4118-b772-01b73dfbc9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:34.527606 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80c405-296b-4118-b772-01b73dfbc9e0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:34.540282 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1393/2762] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:34.544482 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c10e5e-e306-4872-b78f-1c65815bc786 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:34.555245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c10e5e-e306-4872-b78f-1c65815bc786 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:34.560931 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec186c-b449-4dcf-8e51-06aa57f7431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:34.561591 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec186c-b449-4dcf-8e51-06aa57f7431b admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:34.562008 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec186c-b449-4dcf-8e51-06aa57f7431b admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:34.568573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec186c-b449-4dcf-8e51-06aa57f7431b admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:34.568573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec186c-b449-4dcf-8e51-06aa57f7431b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:34.568573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec186c-b449-4dcf-8e51-06aa57f7431b admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:34.576491 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1370/2763] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:34.581214 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80c405-296b-4118-b772-01b73dfbc9e0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:34.594490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80c405-296b-4118-b772-01b73dfbc9e0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:34.600951 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19d5b0-1141-4638-be35-8ebfeebb95f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:34.601957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19d5b0-1141-4638-be35-8ebfeebb95f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:34.602221 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19d5b0-1141-4638-be35-8ebfeebb95f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:34.602494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19d5b0-1141-4638-be35-8ebfeebb95f9 admin admin] PATH_INFO: `/v3/projects/cc68b971ecc145d885d1477d7da50f36/users/48240771248b4aeb856152407a7a5200/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:34.618258 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19d5b0-1141-4638-be35-8ebfeebb95f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc68b971ecc145d885d1477d7da50f36, user_id=48240771248b4aeb856152407a7a5200, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:34.620965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19d5b0-1141-4638-be35-8ebfeebb95f9 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:34.636558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1394/2764] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:34 2022] PUT /identity/v3/projects/cc68b971ecc145d885d1477d7da50f36/users/48240771248b4aeb856152407a7a5200/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:34.646729 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213967c-567c-4655-b256-688d6d9a63e5 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:34.647030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213967c-567c-4655-b256-688d6d9a63e5 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:34.647293 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213967c-567c-4655-b256-688d6d9a63e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:34.672499 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19d5b0-1141-4638-be35-8ebfeebb95f9 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:34.674207 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ab19d5b0-1141-4638-be35-8ebfeebb95f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:34.675795 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-3213967c-567c-4655-b256-688d6d9a63e5 None None] MFA Rules not processed for user `48240771248b4aeb856152407a7a5200`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:34.677016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3213967c-567c-4655-b256-688d6d9a63e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:34.691593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:34.750268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1371/2765] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:34.753410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19d5b0-1141-4638-be35-8ebfeebb95f9 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:34.758701 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0c2d6-ee9a-481a-9012-d5754a46e0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:34.759579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0c2d6-ee9a-481a-9012-d5754a46e0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:34.759852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0c2d6-ee9a-481a-9012-d5754a46e0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:34.760125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0c2d6-ee9a-481a-9012-d5754a46e0cc admin admin] PATH_INFO: `/v3/users/06e7b71029cb41858b8832dc5b51551e` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:34.761458 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0c2d6-ee9a-481a-9012-d5754a46e0cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e7b71029cb41858b8832dc5b51551e)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:34.761703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213967c-567c-4655-b256-688d6d9a63e5 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:34.763168 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3213967c-567c-4655-b256-688d6d9a63e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:34.763383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0c2d6-ee9a-481a-9012-d5754a46e0cc admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:34.820982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-adb0c2d6-ee9a-481a-9012-d5754a46e0cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e7b71029cb41858b8832dc5b51551e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:34.828173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213967c-567c-4655-b256-688d6d9a63e5 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:34.830652 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-adb0c2d6-ee9a-481a-9012-d5754a46e0cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e7b71029cb41858b8832dc5b51551e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:34.832330 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-adb0c2d6-ee9a-481a-9012-d5754a46e0cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e7b71029cb41858b8832dc5b51551e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:34.832497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-adb0c2d6-ee9a-481a-9012-d5754a46e0cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e7b71029cb41858b8832dc5b51551e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:34.832605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8f3c7-c829-4766-8058-0c84ca6f35b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:34.833282 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8f3c7-c829-4766-8058-0c84ca6f35b6 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:34.833738 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8f3c7-c829-4766-8058-0c84ca6f35b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:34.834081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8f3c7-c829-4766-8058-0c84ca6f35b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:34.836725 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-84f8f3c7-c829-4766-8058-0c84ca6f35b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:34.841365 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-adb0c2d6-ee9a-481a-9012-d5754a46e0cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e7b71029cb41858b8832dc5b51551e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:34.848660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8f3c7-c829-4766-8058-0c84ca6f35b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:34.850171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8f3c7-c829-4766-8058-0c84ca6f35b6 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:34.865434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1395/2766] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:34 2022] DELETE /identity/v3/users/06e7b71029cb41858b8832dc5b51551e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:34.865796 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1372/2767] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:26:34.867242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a0b21-5027-4e1d-a127-bb5f8843bee3 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:34.867539 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a0b21-5027-4e1d-a127-bb5f8843bee3 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:34.867822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a0b21-5027-4e1d-a127-bb5f8843bee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:34.885589 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-aa9a0b21-5027-4e1d-a127-bb5f8843bee3 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:34.886797 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-aa9a0b21-5027-4e1d-a127-bb5f8843bee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:34.900069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:34.951424 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1396/2768] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:34.963814 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8f3c7-c829-4766-8058-0c84ca6f35b6 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:34.965262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-84f8f3c7-c829-4766-8058-0c84ca6f35b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:35.029945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8f3c7-c829-4766-8058-0c84ca6f35b6 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:35.080309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79007e4b-9185-42f5-8c23-527c7b476b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:35.080987 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79007e4b-9185-42f5-8c23-527c7b476b60 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:35.081268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79007e4b-9185-42f5-8c23-527c7b476b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:35.081538 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79007e4b-9185-42f5-8c23-527c7b476b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:35.092045 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79007e4b-9185-42f5-8c23-527c7b476b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:35.093712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79007e4b-9185-42f5-8c23-527c7b476b60 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:35.106486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1373/2769] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:35.413818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a0b21-5027-4e1d-a127-bb5f8843bee3 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:35.415344 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-aa9a0b21-5027-4e1d-a127-bb5f8843bee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:35.442408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a0b21-5027-4e1d-a127-bb5f8843bee3 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:35.447961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:35.448904 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:35.449191 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:35.449466 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] PATH_INFO: `/v3/projects/65fd1c1ce8d04ef3a5db794fb46de04f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:35.450802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=65fd1c1ce8d04ef3a5db794fb46de04f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:35.452831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:35.501278 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65fd1c1ce8d04ef3a5db794fb46de04f', 'request_id': 'req-1645d740-25b4-4672-b8a8-032591d71ffe'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:35.507677 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65fd1c1ce8d04ef3a5db794fb46de04f', 'request_id': 'req-1645d740-25b4-4672-b8a8-032591d71ffe'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:35.513161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65fd1c1ce8d04ef3a5db794fb46de04f', 'request_id': 'req-1645d740-25b4-4672-b8a8-032591d71ffe'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:35.526369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] The token cache is being invalidate because project 65fd1c1ce8d04ef3a5db794fb46de04f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:35.526696 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:35.527533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:35.529340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1397/2770] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:35 2022] DELETE /identity/v3/projects/65fd1c1ce8d04ef3a5db794fb46de04f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:35.533986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79007e4b-9185-42f5-8c23-527c7b476b60 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:35.544005 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79007e4b-9185-42f5-8c23-527c7b476b60 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:35.555783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:35.602940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe3664-385a-48b6-9edb-a45a95de80f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:35.603845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe3664-385a-48b6-9edb-a45a95de80f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:35.604123 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe3664-385a-48b6-9edb-a45a95de80f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:35.604424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe3664-385a-48b6-9edb-a45a95de80f6 admin admin] PATH_INFO: `/v3/users/c9ce797693a44b438a3c8c87c28dd8bd` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:35.605656 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe3664-385a-48b6-9edb-a45a95de80f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ce797693a44b438a3c8c87c28dd8bd)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:35.607627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe3664-385a-48b6-9edb-a45a95de80f6 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:35.660530 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6afe3664-385a-48b6-9edb-a45a95de80f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ce797693a44b438a3c8c87c28dd8bd'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:35.669208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6afe3664-385a-48b6-9edb-a45a95de80f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ce797693a44b438a3c8c87c28dd8bd'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:35.669950 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6afe3664-385a-48b6-9edb-a45a95de80f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ce797693a44b438a3c8c87c28dd8bd'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:35.670555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6afe3664-385a-48b6-9edb-a45a95de80f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ce797693a44b438a3c8c87c28dd8bd'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:35.679550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6afe3664-385a-48b6-9edb-a45a95de80f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ce797693a44b438a3c8c87c28dd8bd'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:35.699131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1374/2771] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:35 2022] DELETE /identity/v3/users/c9ce797693a44b438a3c8c87c28dd8bd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:35.990458 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:35.992273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:36.008095 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645d740-25b4-4672-b8a8-032591d71ffe admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:36.069528 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:36.070476 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:36.070785 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:36.071070 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] PATH_INFO: `/v3/projects/b0dee976f91b435594b3e463f4507cf1` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:36.072459 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0dee976f91b435594b3e463f4507cf1)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:36.074390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:36.122121 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:36.127268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0dee976f91b435594b3e463f4507cf1', 'request_id': 'req-71470dcf-4564-42df-a8da-549ddd200a53'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.135241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0dee976f91b435594b3e463f4507cf1', 'request_id': 'req-71470dcf-4564-42df-a8da-549ddd200a53'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.140961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0dee976f91b435594b3e463f4507cf1', 'request_id': 'req-71470dcf-4564-42df-a8da-549ddd200a53'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.154099 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] The token cache is being invalidate because project b0dee976f91b435594b3e463f4507cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:36.154390 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.155076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.156789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1398/2772] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:35 2022] DELETE /identity/v3/projects/b0dee976f91b435594b3e463f4507cf1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:36.161096 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe3664-385a-48b6-9edb-a45a95de80f6 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:36.162525 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-6afe3664-385a-48b6-9edb-a45a95de80f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:36.176027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe3664-385a-48b6-9edb-a45a95de80f6 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:36.241358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3e169-74f5-4291-aaa6-8a6f300a8ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:36.242321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e169-74f5-4291-aaa6-8a6f300a8ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:36.242605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e169-74f5-4291-aaa6-8a6f300a8ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:36.242881 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e169-74f5-4291-aaa6-8a6f300a8ec0 admin admin] PATH_INFO: `/v3/users/3f52c27c411e4d93823b478a5450593e` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:36.244080 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3e169-74f5-4291-aaa6-8a6f300a8ec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f52c27c411e4d93823b478a5450593e)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:36.246147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3e169-74f5-4291-aaa6-8a6f300a8ec0 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:36.293981 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:36.310158 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-abe3e169-74f5-4291-aaa6-8a6f300a8ec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f52c27c411e4d93823b478a5450593e'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.318151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-abe3e169-74f5-4291-aaa6-8a6f300a8ec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f52c27c411e4d93823b478a5450593e'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.318868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-abe3e169-74f5-4291-aaa6-8a6f300a8ec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f52c27c411e4d93823b478a5450593e'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.319493 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-abe3e169-74f5-4291-aaa6-8a6f300a8ec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f52c27c411e4d93823b478a5450593e'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.327513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-abe3e169-74f5-4291-aaa6-8a6f300a8ec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f52c27c411e4d93823b478a5450593e'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.348804 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1375/2773] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:36 2022] DELETE /identity/v3/users/3f52c27c411e4d93823b478a5450593e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:36.653420 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:36.655120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:36.671471 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71470dcf-4564-42df-a8da-549ddd200a53 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:36.734038 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e348da-8282-4588-b945-55fe7fbdb503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:36.734912 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e348da-8282-4588-b945-55fe7fbdb503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:36.735283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e348da-8282-4588-b945-55fe7fbdb503 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:36.735441 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e348da-8282-4588-b945-55fe7fbdb503 admin admin] PATH_INFO: `/v3/projects/ac36dcb0c9a14cb1b476f20cbba3dc5a` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:36.736693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e348da-8282-4588-b945-55fe7fbdb503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac36dcb0c9a14cb1b476f20cbba3dc5a)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:36.738623 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e348da-8282-4588-b945-55fe7fbdb503 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:36.787761 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-c1e348da-8282-4588-b945-55fe7fbdb503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac36dcb0c9a14cb1b476f20cbba3dc5a', 'request_id': 'req-c1e348da-8282-4588-b945-55fe7fbdb503'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.794366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-c1e348da-8282-4588-b945-55fe7fbdb503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac36dcb0c9a14cb1b476f20cbba3dc5a', 'request_id': 'req-c1e348da-8282-4588-b945-55fe7fbdb503'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.800148 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-c1e348da-8282-4588-b945-55fe7fbdb503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac36dcb0c9a14cb1b476f20cbba3dc5a', 'request_id': 'req-c1e348da-8282-4588-b945-55fe7fbdb503'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.814790 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-c1e348da-8282-4588-b945-55fe7fbdb503 admin admin] The token cache is being invalidate because project ac36dcb0c9a14cb1b476f20cbba3dc5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:36.815080 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-c1e348da-8282-4588-b945-55fe7fbdb503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.815714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-c1e348da-8282-4588-b945-55fe7fbdb503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:36.817336 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1399/2774] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:36 2022] DELETE /identity/v3/projects/ac36dcb0c9a14cb1b476f20cbba3dc5a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:36.824343 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a897e-b245-4738-a17c-98aa631b61ea None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:36.824870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a897e-b245-4738-a17c-98aa631b61ea None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:36.824977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a897e-b245-4738-a17c-98aa631b61ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:36.843620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-5f2a897e-b245-4738-a17c-98aa631b61ea None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:36.844921 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5f2a897e-b245-4738-a17c-98aa631b61ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:36.920659 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1376/2775] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:36.931790 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0ca8d-40c0-45eb-9606-7b0da8d5dae4 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:36.932071 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0ca8d-40c0-45eb-9606-7b0da8d5dae4 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:36.932373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0ca8d-40c0-45eb-9606-7b0da8d5dae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:36.951805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-57a0ca8d-40c0-45eb-9606-7b0da8d5dae4 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:36.954021 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-57a0ca8d-40c0-45eb-9606-7b0da8d5dae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:36.965046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1400/2776] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:36.969573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a897e-b245-4738-a17c-98aa631b61ea None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:36.980504 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a897e-b245-4738-a17c-98aa631b61ea None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:36.986208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd3e68-b1e8-4123-b6fe-acf64d4e7666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:36.986859 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd3e68-b1e8-4123-b6fe-acf64d4e7666 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:36.987151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd3e68-b1e8-4123-b6fe-acf64d4e7666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:36.987499 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd3e68-b1e8-4123-b6fe-acf64d4e7666 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:36.988653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd3e68-b1e8-4123-b6fe-acf64d4e7666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:26:36.989061 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd3e68-b1e8-4123-b6fe-acf64d4e7666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:36.991561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd3e68-b1e8-4123-b6fe-acf64d4e7666 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:37.004980 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1377/2777] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:26:37.013693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0ca8d-40c0-45eb-9606-7b0da8d5dae4 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:37.024534 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0ca8d-40c0-45eb-9606-7b0da8d5dae4 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:37.030058 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d415c-8c92-41d7-8fa8-74b73eda86f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:37.030730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d415c-8c92-41d7-8fa8-74b73eda86f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:37.031012 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d415c-8c92-41d7-8fa8-74b73eda86f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:37.031283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d415c-8c92-41d7-8fa8-74b73eda86f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:37.031983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d415c-8c92-41d7-8fa8-74b73eda86f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:37.033982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d415c-8c92-41d7-8fa8-74b73eda86f4 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:37.063921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1401/2778] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:37 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:37.068158 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd3e68-b1e8-4123-b6fe-acf64d4e7666 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:37.080120 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd3e68-b1e8-4123-b6fe-acf64d4e7666 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:37.140486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67ebab-dfd5-4879-91e3-cfebecfea5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:37.141173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67ebab-dfd5-4879-91e3-cfebecfea5ae admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:37.141454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67ebab-dfd5-4879-91e3-cfebecfea5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:37.141728 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67ebab-dfd5-4879-91e3-cfebecfea5ae admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:37.142486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67ebab-dfd5-4879-91e3-cfebecfea5ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:37.144489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67ebab-dfd5-4879-91e3-cfebecfea5ae admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:37.168464 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1378/2779] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:37 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:37.172671 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d415c-8c92-41d7-8fa8-74b73eda86f4 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:37.185384 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d415c-8c92-41d7-8fa8-74b73eda86f4 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:37.191107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4145c-c192-424e-a0aa-be59d91e5ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:37.191410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4145c-c192-424e-a0aa-be59d91e5ddf admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:37.191697 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4145c-c192-424e-a0aa-be59d91e5ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:37.191976 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4145c-c192-424e-a0aa-be59d91e5ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:37.192774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4145c-c192-424e-a0aa-be59d91e5ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:37.194412 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4145c-c192-424e-a0aa-be59d91e5ddf admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:37.207213 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1402/2780] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:37.211408 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67ebab-dfd5-4879-91e3-cfebecfea5ae admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:37.221866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67ebab-dfd5-4879-91e3-cfebecfea5ae admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:37.228067 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121a674-3550-4831-b9cb-0c727445af95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:37.228773 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121a674-3550-4831-b9cb-0c727445af95 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:37.229062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121a674-3550-4831-b9cb-0c727445af95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:37.229337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121a674-3550-4831-b9cb-0c727445af95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:37.230082 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121a674-3550-4831-b9cb-0c727445af95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:37.231701 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121a674-3550-4831-b9cb-0c727445af95 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:37.242616 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1379/2781] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:37.249563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4145c-c192-424e-a0aa-be59d91e5ddf admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:37.265349 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4145c-c192-424e-a0aa-be59d91e5ddf admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:37.271381 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72ff22-bfac-4538-a1b8-622a5b238b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:37.272311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72ff22-bfac-4538-a1b8-622a5b238b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:37.272609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72ff22-bfac-4538-a1b8-622a5b238b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:37.272881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72ff22-bfac-4538-a1b8-622a5b238b90 admin admin] PATH_INFO: `/v3/projects/ed19ea2926d94f9b989e4510927f16f8/users/857b165312d64ec59dbab64e70f4addd/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:37.289419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72ff22-bfac-4538-a1b8-622a5b238b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed19ea2926d94f9b989e4510927f16f8, user_id=857b165312d64ec59dbab64e70f4addd, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:37.293395 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72ff22-bfac-4538-a1b8-622a5b238b90 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:37.307285 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:37.313136 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1403/2782] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:37 2022] PUT /identity/v3/projects/ed19ea2926d94f9b989e4510927f16f8/users/857b165312d64ec59dbab64e70f4addd/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:37.327988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c4a3a-3933-4da2-a1ee-eebe1d7c1c8a None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:37.328282 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c4a3a-3933-4da2-a1ee-eebe1d7c1c8a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:37.328924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c4a3a-3933-4da2-a1ee-eebe1d7c1c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:37.357976 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-eb6c4a3a-3933-4da2-a1ee-eebe1d7c1c8a None None] MFA Rules not processed for user `857b165312d64ec59dbab64e70f4addd`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:37.359208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-eb6c4a3a-3933-4da2-a1ee-eebe1d7c1c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:37.368031 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:37.436637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1380/2783] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:37.449793 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72ff22-bfac-4538-a1b8-622a5b238b90 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:37.451851 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ae72ff22-bfac-4538-a1b8-622a5b238b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:37.529514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72ff22-bfac-4538-a1b8-622a5b238b90 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:37.533394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027296b-2ed9-4f0e-9c1e-f97f42bbf50d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:37.534051 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027296b-2ed9-4f0e-9c1e-f97f42bbf50d service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:37.534337 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027296b-2ed9-4f0e-9c1e-f97f42bbf50d service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:37.534618 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027296b-2ed9-4f0e-9c1e-f97f42bbf50d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:37.543762 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027296b-2ed9-4f0e-9c1e-f97f42bbf50d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:37.545201 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027296b-2ed9-4f0e-9c1e-f97f42bbf50d service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:37.557818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1404/2784] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:47.433612 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=23 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:47.553067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=26 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:57.322821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c4a3a-3933-4da2-a1ee-eebe1d7c1c8a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:57.390833 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c4a3a-3933-4da2-a1ee-eebe1d7c1c8a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:57.398390 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2b49f-1ce6-4588-94ec-4f4266a326df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:57.399214 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2b49f-1ce6-4588-94ec-4f4266a326df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:57.399495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2b49f-1ce6-4588-94ec-4f4266a326df admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:57.399774 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2b49f-1ce6-4588-94ec-4f4266a326df admin admin] PATH_INFO: `/v3/users/857b165312d64ec59dbab64e70f4addd` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:57.401053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2b49f-1ce6-4588-94ec-4f4266a326df admin admin] RBAC: Authorizing `identity:delete_user(user_id=857b165312d64ec59dbab64e70f4addd)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:57.403014 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2b49f-1ce6-4588-94ec-4f4266a326df admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:57.451109 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f1c2b49f-1ce6-4588-94ec-4f4266a326df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857b165312d64ec59dbab64e70f4addd'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:57.458221 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f1c2b49f-1ce6-4588-94ec-4f4266a326df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857b165312d64ec59dbab64e70f4addd'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:57.458880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f1c2b49f-1ce6-4588-94ec-4f4266a326df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857b165312d64ec59dbab64e70f4addd'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:57.459482 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f1c2b49f-1ce6-4588-94ec-4f4266a326df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857b165312d64ec59dbab64e70f4addd'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:57.468644 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f1c2b49f-1ce6-4588-94ec-4f4266a326df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857b165312d64ec59dbab64e70f4addd'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:57.487250 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1381/2785] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:26:57 2022] DELETE /identity/v3/users/857b165312d64ec59dbab64e70f4addd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:57.491971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236a8bc-547e-4eeb-9bf9-7e9b2d8d6d5e None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:57.492504 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236a8bc-547e-4eeb-9bf9-7e9b2d8d6d5e None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:57.492621 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236a8bc-547e-4eeb-9bf9-7e9b2d8d6d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:57.511476 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-9236a8bc-547e-4eeb-9bf9-7e9b2d8d6d5e None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:57.512714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9236a8bc-547e-4eeb-9bf9-7e9b2d8d6d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:57.573432 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1405/2786] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:57.586449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2b49f-1ce6-4588-94ec-4f4266a326df admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:57.587982 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-f1c2b49f-1ce6-4588-94ec-4f4266a326df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:57.653299 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2b49f-1ce6-4588-94ec-4f4266a326df admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:57.658578 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d14ccc-8e03-42d3-b4dc-4a07a06cf72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:57.659254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d14ccc-8e03-42d3-b4dc-4a07a06cf72f service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:57.659543 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d14ccc-8e03-42d3-b4dc-4a07a06cf72f service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:57.659818 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d14ccc-8e03-42d3-b4dc-4a07a06cf72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:57.671461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d14ccc-8e03-42d3-b4dc-4a07a06cf72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:57.673269 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d14ccc-8e03-42d3-b4dc-4a07a06cf72f service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:57.685492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1382/2787] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:58.028816 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236a8bc-547e-4eeb-9bf9-7e9b2d8d6d5e None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:58.030549 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9236a8bc-547e-4eeb-9bf9-7e9b2d8d6d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:58.048986 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236a8bc-547e-4eeb-9bf9-7e9b2d8d6d5e None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:58.064703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:58.065707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:58.066047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:58.066319 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c admin admin] PATH_INFO: `/v3/projects/ed19ea2926d94f9b989e4510927f16f8` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:58.068569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed19ea2926d94f9b989e4510927f16f8)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:58.072273 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:58.146356 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed19ea2926d94f9b989e4510927f16f8', 'request_id': 'req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:58.156237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed19ea2926d94f9b989e4510927f16f8', 'request_id': 'req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:58.166327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed19ea2926d94f9b989e4510927f16f8', 'request_id': 'req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:58.183720 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c admin admin] The token cache is being invalidate because project ed19ea2926d94f9b989e4510927f16f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:26:58.184120 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:58.192220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a18fa804-fafd-4a59-8cd3-573c91ffbc4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:26:58.198700 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1406/2788] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:26:58 2022] DELETE /identity/v3/projects/ed19ea2926d94f9b989e4510927f16f8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:26:58.199918 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d27d8-ab02-4d7e-ac8e-d2c63a961666 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:58.200317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d27d8-ab02-4d7e-ac8e-d2c63a961666 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:58.203114 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d27d8-ab02-4d7e-ac8e-d2c63a961666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:58.225236 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-c34d27d8-ab02-4d7e-ac8e-d2c63a961666 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:58.226903 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-c34d27d8-ab02-4d7e-ac8e-d2c63a961666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:58.245601 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:58.293242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1383/2789] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:58.298609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894ceb6-4706-43f1-a70d-da9cd467f5e1 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:58.298996 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894ceb6-4706-43f1-a70d-da9cd467f5e1 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:58.299174 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894ceb6-4706-43f1-a70d-da9cd467f5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:58.319517 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-e894ceb6-4706-43f1-a70d-da9cd467f5e1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:58.321107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-e894ceb6-4706-43f1-a70d-da9cd467f5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:58.330372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1407/2790] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:58.334756 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d27d8-ab02-4d7e-ac8e-d2c63a961666 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:58.344992 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d27d8-ab02-4d7e-ac8e-d2c63a961666 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:58.350121 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212256cc-a8af-4eb8-8bfb-2a9100d2756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:58.350798 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212256cc-a8af-4eb8-8bfb-2a9100d2756f admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:58.351168 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212256cc-a8af-4eb8-8bfb-2a9100d2756f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:58.351449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212256cc-a8af-4eb8-8bfb-2a9100d2756f admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:58.352196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212256cc-a8af-4eb8-8bfb-2a9100d2756f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:26:58.352546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212256cc-a8af-4eb8-8bfb-2a9100d2756f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:58.354167 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212256cc-a8af-4eb8-8bfb-2a9100d2756f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:58.366375 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1384/2791] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:26:58.370818 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894ceb6-4706-43f1-a70d-da9cd467f5e1 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:58.380579 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894ceb6-4706-43f1-a70d-da9cd467f5e1 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:58.385790 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182827a1-200c-46c4-9131-e7fbeb299a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:58.386451 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182827a1-200c-46c4-9131-e7fbeb299a32 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:58.386737 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182827a1-200c-46c4-9131-e7fbeb299a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:58.387014 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182827a1-200c-46c4-9131-e7fbeb299a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:58.387715 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182827a1-200c-46c4-9131-e7fbeb299a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:58.389679 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182827a1-200c-46c4-9131-e7fbeb299a32 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:58.417056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1408/2792] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:26:58 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:58.421322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212256cc-a8af-4eb8-8bfb-2a9100d2756f admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:58.431726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212256cc-a8af-4eb8-8bfb-2a9100d2756f admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:58.493293 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd951f16-24a0-4d3d-8c81-b54639ad24cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:58.493980 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd951f16-24a0-4d3d-8c81-b54639ad24cc admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:58.494264 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd951f16-24a0-4d3d-8c81-b54639ad24cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:58.494540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd951f16-24a0-4d3d-8c81-b54639ad24cc admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:58.495234 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd951f16-24a0-4d3d-8c81-b54639ad24cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:58.497228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd951f16-24a0-4d3d-8c81-b54639ad24cc admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:58.518806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1385/2793] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:26:58 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:26:58.523364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182827a1-200c-46c4-9131-e7fbeb299a32 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:58.534359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182827a1-200c-46c4-9131-e7fbeb299a32 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:58.540094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659e494-ea6a-4995-b51e-925225749fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:58.541074 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659e494-ea6a-4995-b51e-925225749fde admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:58.541568 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659e494-ea6a-4995-b51e-925225749fde admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:58.542029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659e494-ea6a-4995-b51e-925225749fde admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:58.542960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659e494-ea6a-4995-b51e-925225749fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:58.544819 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659e494-ea6a-4995-b51e-925225749fde admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:58.557256 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1409/2794] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:58.561421 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd951f16-24a0-4d3d-8c81-b54639ad24cc admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:58.581139 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd951f16-24a0-4d3d-8c81-b54639ad24cc admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:58.586981 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2abd12-c878-4cf6-b41d-236b82a37741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:58.587736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2abd12-c878-4cf6-b41d-236b82a37741 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:58.588055 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2abd12-c878-4cf6-b41d-236b82a37741 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:58.588409 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2abd12-c878-4cf6-b41d-236b82a37741 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:58.589269 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2abd12-c878-4cf6-b41d-236b82a37741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:58.591535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2abd12-c878-4cf6-b41d-236b82a37741 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:58.607143 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1386/2795] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:26:58.607810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659e494-ea6a-4995-b51e-925225749fde admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:58.618700 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659e494-ea6a-4995-b51e-925225749fde admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:58.625076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cd6f8-7493-4de1-be8f-ad47748fe663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:58.626339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd6f8-7493-4de1-be8f-ad47748fe663 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:58.626540 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd6f8-7493-4de1-be8f-ad47748fe663 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:58.626877 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd6f8-7493-4de1-be8f-ad47748fe663 admin admin] PATH_INFO: `/v3/projects/b23c2e474bf148c28292556737330c97/users/17be916ab96645349a7afd6860ff16e3/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:58.643050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cd6f8-7493-4de1-be8f-ad47748fe663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23c2e474bf148c28292556737330c97, user_id=17be916ab96645349a7afd6860ff16e3, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:58.645989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cd6f8-7493-4de1-be8f-ad47748fe663 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:58.661319 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1410/2796] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:26:58 2022] PUT /identity/v3/projects/b23c2e474bf148c28292556737330c97/users/17be916ab96645349a7afd6860ff16e3/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:26:58.672620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0cb5f-8a48-4a8f-a07b-5e7a936318bb None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:58.672913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0cb5f-8a48-4a8f-a07b-5e7a936318bb None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:58.673260 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0cb5f-8a48-4a8f-a07b-5e7a936318bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:58.703845 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-0cb0cb5f-8a48-4a8f-a07b-5e7a936318bb None None] MFA Rules not processed for user `17be916ab96645349a7afd6860ff16e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:26:58.705100 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-0cb0cb5f-8a48-4a8f-a07b-5e7a936318bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:58.818459 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1387/2797] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:26:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:26:58.832901 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cd6f8-7493-4de1-be8f-ad47748fe663 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:58.837961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-997cd6f8-7493-4de1-be8f-ad47748fe663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:58.868622 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:58.922856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cd6f8-7493-4de1-be8f-ad47748fe663 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:58.926783 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706246e-4d30-4929-b466-45a341bbce97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:58.928271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706246e-4d30-4929-b466-45a341bbce97 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:58.928912 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706246e-4d30-4929-b466-45a341bbce97 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:58.929549 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706246e-4d30-4929-b466-45a341bbce97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:58.940821 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706246e-4d30-4929-b466-45a341bbce97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:58.942470 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706246e-4d30-4929-b466-45a341bbce97 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:58.953836 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1411/2798] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:26:59.231498 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0cb5f-8a48-4a8f-a07b-5e7a936318bb None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:26:59.233549 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-0cb0cb5f-8a48-4a8f-a07b-5e7a936318bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:59.270555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:26:59.351779 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0cb5f-8a48-4a8f-a07b-5e7a936318bb None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:26:59.357699 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df98c22-c564-43fd-9f93-66e72b9af741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:26:59.358381 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98c22-c564-43fd-9f93-66e72b9af741 service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:26:59.358660 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98c22-c564-43fd-9f93-66e72b9af741 service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:26:59.358954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98c22-c564-43fd-9f93-66e72b9af741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:26:59.361027 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1df98c22-c564-43fd-9f93-66e72b9af741 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:26:59.459216 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df98c22-c564-43fd-9f93-66e72b9af741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:26:59.462623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df98c22-c564-43fd-9f93-66e72b9af741 service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:26:59.477303 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1388/2799] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:26:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:00.190289 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706246e-4d30-4929-b466-45a341bbce97 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:00.191965 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5706246e-4d30-4929-b466-45a341bbce97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:00.263193 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706246e-4d30-4929-b466-45a341bbce97 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:00.268211 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80d4e9-3c84-45f7-91b1-17cc1bff26d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:00.269126 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d4e9-3c84-45f7-91b1-17cc1bff26d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:00.269408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d4e9-3c84-45f7-91b1-17cc1bff26d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:00.269686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d4e9-3c84-45f7-91b1-17cc1bff26d0 admin admin] PATH_INFO: `/v3/users/48240771248b4aeb856152407a7a5200` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:00.271000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80d4e9-3c84-45f7-91b1-17cc1bff26d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48240771248b4aeb856152407a7a5200)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:00.273163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80d4e9-3c84-45f7-91b1-17cc1bff26d0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:00.323355 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2e80d4e9-3c84-45f7-91b1-17cc1bff26d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48240771248b4aeb856152407a7a5200'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:00.330433 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2e80d4e9-3c84-45f7-91b1-17cc1bff26d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48240771248b4aeb856152407a7a5200'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:00.331088 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2e80d4e9-3c84-45f7-91b1-17cc1bff26d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48240771248b4aeb856152407a7a5200'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:00.331687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2e80d4e9-3c84-45f7-91b1-17cc1bff26d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48240771248b4aeb856152407a7a5200'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:00.340689 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2e80d4e9-3c84-45f7-91b1-17cc1bff26d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48240771248b4aeb856152407a7a5200'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:00.359747 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1412/2800] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:27:00 2022] DELETE /identity/v3/users/48240771248b4aeb856152407a7a5200 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:00.364474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff5220-087d-44e1-8f63-3ff7be1e1087 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:00.364929 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff5220-087d-44e1-8f63-3ff7be1e1087 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:00.365034 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff5220-087d-44e1-8f63-3ff7be1e1087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:00.383142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-c0ff5220-087d-44e1-8f63-3ff7be1e1087 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:00.384341 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-c0ff5220-087d-44e1-8f63-3ff7be1e1087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:00.447226 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1389/2801] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:00.457454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80d4e9-3c84-45f7-91b1-17cc1bff26d0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:00.459035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2e80d4e9-3c84-45f7-91b1-17cc1bff26d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:00.509587 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:00.523641 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80d4e9-3c84-45f7-91b1-17cc1bff26d0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:00.528000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a3b0c-404e-49ad-9d63-5f605ac9be8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:00.528761 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a3b0c-404e-49ad-9d63-5f605ac9be8e service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:00.529230 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a3b0c-404e-49ad-9d63-5f605ac9be8e service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:00.529527 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a3b0c-404e-49ad-9d63-5f605ac9be8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:00.539744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a3b0c-404e-49ad-9d63-5f605ac9be8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:00.541272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a3b0c-404e-49ad-9d63-5f605ac9be8e service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:00.551479 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1413/2802] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:00.831585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff5220-087d-44e1-8f63-3ff7be1e1087 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:00.833206 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-c0ff5220-087d-44e1-8f63-3ff7be1e1087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:00.846509 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff5220-087d-44e1-8f63-3ff7be1e1087 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:00.853649 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:00.854742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:00.855143 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:00.855514 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] PATH_INFO: `/v3/projects/cc68b971ecc145d885d1477d7da50f36` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:00.856885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc68b971ecc145d885d1477d7da50f36)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:00.858820 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:00.908280 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc68b971ecc145d885d1477d7da50f36', 'request_id': 'req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:00.909528 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:00.915182 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc68b971ecc145d885d1477d7da50f36', 'request_id': 'req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:00.921882 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc68b971ecc145d885d1477d7da50f36', 'request_id': 'req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:00.935819 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] The token cache is being invalidate because project cc68b971ecc145d885d1477d7da50f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:27:00.936108 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:00.936789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:00.938425 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1390/2803] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:27:00 2022] DELETE /identity/v3/projects/cc68b971ecc145d885d1477d7da50f36 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:00.943547 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c98e-7ef2-49f9-978c-602e9decc64d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:00.944033 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c98e-7ef2-49f9-978c-602e9decc64d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:00.944380 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c98e-7ef2-49f9-978c-602e9decc64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:00.953991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:00.955519 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:00.963732 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-4630c98e-7ef2-49f9-978c-602e9decc64d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:00.965059 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4630c98e-7ef2-49f9-978c-602e9decc64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:01.014731 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbbe8e-3c61-4b6a-94ad-da6e67b1331a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:01.018737 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b09897-7dd8-4228-9798-8fda46d86eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:01.019589 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09897-7dd8-4228-9798-8fda46d86eda service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:01.019935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09897-7dd8-4228-9798-8fda46d86eda service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:01.020271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09897-7dd8-4228-9798-8fda46d86eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:01.022426 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-82b09897-7dd8-4228-9798-8fda46d86eda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:01.031206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1414/2804] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:01.038960 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c252b-c138-4a49-b7fc-e9f23bd81a8d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:01.039257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c252b-c138-4a49-b7fc-e9f23bd81a8d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:01.039538 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c252b-c138-4a49-b7fc-e9f23bd81a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:01.059060 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-eb8c252b-c138-4a49-b7fc-e9f23bd81a8d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:01.060969 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-eb8c252b-c138-4a49-b7fc-e9f23bd81a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:01.068171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1415/2805] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:01.068961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c252b-c138-4a49-b7fc-e9f23bd81a8d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:01.078791 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c252b-c138-4a49-b7fc-e9f23bd81a8d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:01.083565 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9cc2d-cb2e-44c1-8f06-b0c161c59e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:01.084206 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9cc2d-cb2e-44c1-8f06-b0c161c59e15 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:01.084540 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9cc2d-cb2e-44c1-8f06-b0c161c59e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:01.084815 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9cc2d-cb2e-44c1-8f06-b0c161c59e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:01.086887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-2cd9cc2d-cb2e-44c1-8f06-b0c161c59e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:01.099135 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b09897-7dd8-4228-9798-8fda46d86eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:01.100366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9cc2d-cb2e-44c1-8f06-b0c161c59e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:01.100624 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b09897-7dd8-4228-9798-8fda46d86eda service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:01.102057 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9cc2d-cb2e-44c1-8f06-b0c161c59e15 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:01.112644 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1391/2806] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:27:01.113291 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1416/2807] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:01.114109 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b09897-7dd8-4228-9798-8fda46d86eda service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:01.124110 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b09897-7dd8-4228-9798-8fda46d86eda service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:01.128942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1df373-91cb-40d5-bbe3-5860dbcd3191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:01.129607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1df373-91cb-40d5-bbe3-5860dbcd3191 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:01.129886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1df373-91cb-40d5-bbe3-5860dbcd3191 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:01.130155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1df373-91cb-40d5-bbe3-5860dbcd3191 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:01.130885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1df373-91cb-40d5-bbe3-5860dbcd3191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:27:01.131187 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1df373-91cb-40d5-bbe3-5860dbcd3191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:01.132929 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1df373-91cb-40d5-bbe3-5860dbcd3191 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:01.145985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1392/2808] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:27:01.150524 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9cc2d-cb2e-44c1-8f06-b0c161c59e15 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:01.160968 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9cc2d-cb2e-44c1-8f06-b0c161c59e15 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:01.166350 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c943cf-25d3-4a81-8dbb-00e2993506fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:01.167012 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c943cf-25d3-4a81-8dbb-00e2993506fa admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:01.167292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c943cf-25d3-4a81-8dbb-00e2993506fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:01.167567 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c943cf-25d3-4a81-8dbb-00e2993506fa admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:01.168267 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c943cf-25d3-4a81-8dbb-00e2993506fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:01.170208 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c943cf-25d3-4a81-8dbb-00e2993506fa admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:01.201068 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1417/2809] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:27:01 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:01.205582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1df373-91cb-40d5-bbe3-5860dbcd3191 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:01.217072 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1df373-91cb-40d5-bbe3-5860dbcd3191 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:01.276335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b6a4e-c789-46f0-b518-a73f5402811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:01.277065 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b6a4e-c789-46f0-b518-a73f5402811e admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:01.277347 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b6a4e-c789-46f0-b518-a73f5402811e admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:01.277653 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b6a4e-c789-46f0-b518-a73f5402811e admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:01.278317 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b6a4e-c789-46f0-b518-a73f5402811e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:01.280231 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b6a4e-c789-46f0-b518-a73f5402811e admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:01.289691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:01.305640 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1393/2810] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:27:01 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:01.310569 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c943cf-25d3-4a81-8dbb-00e2993506fa admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:01.324710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c943cf-25d3-4a81-8dbb-00e2993506fa admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:01.330599 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f407ee5-5c31-46c0-97e2-f69f1a8e1ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:01.331269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f407ee5-5c31-46c0-97e2-f69f1a8e1ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:01.331550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f407ee5-5c31-46c0-97e2-f69f1a8e1ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:01.331832 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f407ee5-5c31-46c0-97e2-f69f1a8e1ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:01.332584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f407ee5-5c31-46c0-97e2-f69f1a8e1ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:01.334204 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f407ee5-5c31-46c0-97e2-f69f1a8e1ae0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:01.345051 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1418/2811] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:01.349218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b6a4e-c789-46f0-b518-a73f5402811e admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:01.360037 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b6a4e-c789-46f0-b518-a73f5402811e admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:01.365587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0d9d7-babc-449d-ab1a-abb5f660b9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:01.366244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0d9d7-babc-449d-ab1a-abb5f660b9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:01.366924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0d9d7-babc-449d-ab1a-abb5f660b9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:01.366924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0d9d7-babc-449d-ab1a-abb5f660b9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:01.367599 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0d9d7-babc-449d-ab1a-abb5f660b9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:01.369265 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0d9d7-babc-449d-ab1a-abb5f660b9e0 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:01.379593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1394/2812] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:01.383925 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f407ee5-5c31-46c0-97e2-f69f1a8e1ae0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:01.394096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f407ee5-5c31-46c0-97e2-f69f1a8e1ae0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:01.399305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54026bef-c2a8-4df7-b382-0d31c404c31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:01.400182 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54026bef-c2a8-4df7-b382-0d31c404c31c admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:01.400495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54026bef-c2a8-4df7-b382-0d31c404c31c admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:01.400771 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54026bef-c2a8-4df7-b382-0d31c404c31c admin admin] PATH_INFO: `/v3/projects/ce9d90202a824e3689fc7a2538407fd0/users/b701c953ae4f485ba6cefed3178f9951/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:01.416013 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54026bef-c2a8-4df7-b382-0d31c404c31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9d90202a824e3689fc7a2538407fd0, user_id=b701c953ae4f485ba6cefed3178f9951, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:01.418710 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54026bef-c2a8-4df7-b382-0d31c404c31c admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:01.434044 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1419/2813] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:27:01 2022] PUT /identity/v3/projects/ce9d90202a824e3689fc7a2538407fd0/users/b701c953ae4f485ba6cefed3178f9951/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:01.439379 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cc2f0-2249-4cbd-9add-80c0368150f0 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:01.439679 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cc2f0-2249-4cbd-9add-80c0368150f0 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:01.439958 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cc2f0-2249-4cbd-9add-80c0368150f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:01.459044 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-122cc2f0-2249-4cbd-9add-80c0368150f0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:01.460320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-122cc2f0-2249-4cbd-9add-80c0368150f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:01.521112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1395/2814] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:27:01.531035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54026bef-c2a8-4df7-b382-0d31c404c31c admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:01.589326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54026bef-c2a8-4df7-b382-0d31c404c31c admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:01.593616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda66170-894f-4a48-8dae-cf82818cd20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:01.594263 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda66170-894f-4a48-8dae-cf82818cd20c service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:01.594543 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda66170-894f-4a48-8dae-cf82818cd20c service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:01.594811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda66170-894f-4a48-8dae-cf82818cd20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:01.605803 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda66170-894f-4a48-8dae-cf82818cd20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:01.608012 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda66170-894f-4a48-8dae-cf82818cd20c service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:01.621505 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1420/2815] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:02.316693 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a993c9-be07-4da4-a487-7ba98cf503ff None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:02.316919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a993c9-be07-4da4-a487-7ba98cf503ff None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:02.317219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a993c9-be07-4da4-a487-7ba98cf503ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:02.350101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-93a993c9-be07-4da4-a487-7ba98cf503ff None None] MFA Rules not processed for user `b701c953ae4f485ba6cefed3178f9951`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:02.351442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-93a993c9-be07-4da4-a487-7ba98cf503ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:02.426348 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1396/2816] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:02.433832 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda66170-894f-4a48-8dae-cf82818cd20c service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:02.435982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-fda66170-894f-4a48-8dae-cf82818cd20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:02.450658 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:02.498270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda66170-894f-4a48-8dae-cf82818cd20c service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:02.501862 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd1a3d-4b23-4e85-99a6-f7f64570cc59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:02.502515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd1a3d-4b23-4e85-99a6-f7f64570cc59 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:02.502799 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd1a3d-4b23-4e85-99a6-f7f64570cc59 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:02.503077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd1a3d-4b23-4e85-99a6-f7f64570cc59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:02.511454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd1a3d-4b23-4e85-99a6-f7f64570cc59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:02.512964 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd1a3d-4b23-4e85-99a6-f7f64570cc59 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:02.522067 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1421/2817] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:04.974002 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d37ea8-0e9c-49d8-8f12-b3c3cf32aacd None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:04.974449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d37ea8-0e9c-49d8-8f12-b3c3cf32aacd None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:04.974555 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d37ea8-0e9c-49d8-8f12-b3c3cf32aacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:05.004876 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-88d37ea8-0e9c-49d8-8f12-b3c3cf32aacd None None] MFA Rules not processed for user `b701c953ae4f485ba6cefed3178f9951`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:05.006166 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-88d37ea8-0e9c-49d8-8f12-b3c3cf32aacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:05.025099 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1397/2818] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:05.133546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd1a3d-4b23-4e85-99a6-f7f64570cc59 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:05.135165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6bbd1a3d-4b23-4e85-99a6-f7f64570cc59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:05.287810 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd1a3d-4b23-4e85-99a6-f7f64570cc59 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:05.294561 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e325fd-b06a-4431-8ddb-a84edacf85e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:05.300941 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e325fd-b06a-4431-8ddb-a84edacf85e8 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:05.301234 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e325fd-b06a-4431-8ddb-a84edacf85e8 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:05.301698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e325fd-b06a-4431-8ddb-a84edacf85e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:05.305242 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-41e325fd-b06a-4431-8ddb-a84edacf85e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:05.331414 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e325fd-b06a-4431-8ddb-a84edacf85e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:05.333755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e325fd-b06a-4431-8ddb-a84edacf85e8 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:05.351514 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1422/2819] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 16:27:06.042662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d37ea8-0e9c-49d8-8f12-b3c3cf32aacd None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:06.044218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-88d37ea8-0e9c-49d8-8f12-b3c3cf32aacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:06.172681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e325fd-b06a-4431-8ddb-a84edacf85e8 service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:06.195360 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e325fd-b06a-4431-8ddb-a84edacf85e8 service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:06.206283 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed953136-8975-4ebe-9bdf-72b454f358dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:06.207222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed953136-8975-4ebe-9bdf-72b454f358dc service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:06.207673 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed953136-8975-4ebe-9bdf-72b454f358dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:06.208085 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed953136-8975-4ebe-9bdf-72b454f358dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:06.215351 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ed953136-8975-4ebe-9bdf-72b454f358dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:06.269451 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d37ea8-0e9c-49d8-8f12-b3c3cf32aacd None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:06.269666 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed953136-8975-4ebe-9bdf-72b454f358dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:06.271977 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed953136-8975-4ebe-9bdf-72b454f358dc service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:06.278969 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50570693-f35a-445b-82b7-e761704c1f73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:06.279785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50570693-f35a-445b-82b7-e761704c1f73 service placement] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:06.280131 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50570693-f35a-445b-82b7-e761704c1f73 service placement] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:06.280502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50570693-f35a-445b-82b7-e761704c1f73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:06.285115 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-50570693-f35a-445b-82b7-e761704c1f73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:06.286990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1423/2820] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:06.299870 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50570693-f35a-445b-82b7-e761704c1f73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:06.302173 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50570693-f35a-445b-82b7-e761704c1f73 service placement] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:06.307670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=100 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:06.316755 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1398/2821] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:07.288767 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed953136-8975-4ebe-9bdf-72b454f358dc service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:07.290494 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ed953136-8975-4ebe-9bdf-72b454f358dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:07.307705 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed953136-8975-4ebe-9bdf-72b454f358dc service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:07.313325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9e0c5-6bda-4af3-a735-a6ac4bb18aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:07.314369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9e0c5-6bda-4af3-a735-a6ac4bb18aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:07.314715 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9e0c5-6bda-4af3-a735-a6ac4bb18aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:07.315053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9e0c5-6bda-4af3-a735-a6ac4bb18aaa admin admin] PATH_INFO: `/v3/users/17be916ab96645349a7afd6860ff16e3` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:07.316540 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9e0c5-6bda-4af3-a735-a6ac4bb18aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=17be916ab96645349a7afd6860ff16e3)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:07.318623 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9e0c5-6bda-4af3-a735-a6ac4bb18aaa admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:07.377371 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f4a9e0c5-6bda-4af3-a735-a6ac4bb18aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17be916ab96645349a7afd6860ff16e3'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:07.385426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f4a9e0c5-6bda-4af3-a735-a6ac4bb18aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17be916ab96645349a7afd6860ff16e3'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:07.386277 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f4a9e0c5-6bda-4af3-a735-a6ac4bb18aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17be916ab96645349a7afd6860ff16e3'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:07.386987 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f4a9e0c5-6bda-4af3-a735-a6ac4bb18aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17be916ab96645349a7afd6860ff16e3'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:07.397983 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-f4a9e0c5-6bda-4af3-a735-a6ac4bb18aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17be916ab96645349a7afd6860ff16e3'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:07.404241 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:07.420200 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1424/2822] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:27:07 2022] DELETE /identity/v3/users/17be916ab96645349a7afd6860ff16e3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:07.425025 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f0113-4bb6-4b4e-b823-d6e0ed83a263 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:07.425997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f0113-4bb6-4b4e-b823-d6e0ed83a263 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:07.426277 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f0113-4bb6-4b4e-b823-d6e0ed83a263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:07.458208 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-0a4f0113-4bb6-4b4e-b823-d6e0ed83a263 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:07.460066 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-0a4f0113-4bb6-4b4e-b823-d6e0ed83a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:07.533977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1399/2823] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:07.548519 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9e0c5-6bda-4af3-a735-a6ac4bb18aaa admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:07.557698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f4a9e0c5-6bda-4af3-a735-a6ac4bb18aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:07.630606 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9e0c5-6bda-4af3-a735-a6ac4bb18aaa admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:07.634327 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf077e-be83-4a9c-b460-503ac95734f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:07.635163 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf077e-be83-4a9c-b460-503ac95734f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:07.635452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf077e-be83-4a9c-b460-503ac95734f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:07.635726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf077e-be83-4a9c-b460-503ac95734f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:07.649706 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf077e-be83-4a9c-b460-503ac95734f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:07.651171 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf077e-be83-4a9c-b460-503ac95734f0 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:07.662558 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1425/2824] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:08.062640 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f0113-4bb6-4b4e-b823-d6e0ed83a263 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:08.064224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-0a4f0113-4bb6-4b4e-b823-d6e0ed83a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:08.081618 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f0113-4bb6-4b4e-b823-d6e0ed83a263 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:08.087396 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:08.088977 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:08.089318 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:08.089635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] PATH_INFO: `/v3/projects/b23c2e474bf148c28292556737330c97` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:08.091325 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23c2e474bf148c28292556737330c97)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:08.093743 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:08.152124 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23c2e474bf148c28292556737330c97', 'request_id': 'req-f75e15fe-ba1f-401c-b487-f5da0ca844fa'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:08.158369 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23c2e474bf148c28292556737330c97', 'request_id': 'req-f75e15fe-ba1f-401c-b487-f5da0ca844fa'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:08.167262 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23c2e474bf148c28292556737330c97', 'request_id': 'req-f75e15fe-ba1f-401c-b487-f5da0ca844fa'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:08.189631 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] The token cache is being invalidate because project b23c2e474bf148c28292556737330c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:27:08.189926 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:08.193251 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:08.195907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1400/2825] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:27:08 2022] DELETE /identity/v3/projects/b23c2e474bf148c28292556737330c97 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:08.403998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf077e-be83-4a9c-b460-503ac95734f0 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:08.415547 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf077e-be83-4a9c-b460-503ac95734f0 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:08.473632 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d435683-5ce1-4db2-840f-f1530756cda8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:08.475382 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435683-5ce1-4db2-840f-f1530756cda8 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:08.475947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435683-5ce1-4db2-840f-f1530756cda8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:08.476563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435683-5ce1-4db2-840f-f1530756cda8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:08.479292 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5d435683-5ce1-4db2-840f-f1530756cda8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:08.549061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d435683-5ce1-4db2-840f-f1530756cda8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:08.550546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d435683-5ce1-4db2-840f-f1530756cda8 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:08.561464 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1426/2826] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:12.149794 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:12.151245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:12.223078 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d435683-5ce1-4db2-840f-f1530756cda8 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:12.224627 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5d435683-5ce1-4db2-840f-f1530756cda8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:12.241240 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d435683-5ce1-4db2-840f-f1530756cda8 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:12.244625 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e15fe-ba1f-401c-b487-f5da0ca844fa admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:12.246250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09994b0-4e56-429b-97ac-5ae72f300592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:12.247139 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09994b0-4e56-429b-97ac-5ae72f300592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:12.247533 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09994b0-4e56-429b-97ac-5ae72f300592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:12.247806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09994b0-4e56-429b-97ac-5ae72f300592 admin admin] PATH_INFO: `/v3/users/ad1057ac8f4c471bb9ffdb8a8f1fe61c` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:12.248989 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09994b0-4e56-429b-97ac-5ae72f300592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1057ac8f4c471bb9ffdb8a8f1fe61c)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:12.249927 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b169b-7f92-47d5-bdbf-7fab151b9be5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:12.250582 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b169b-7f92-47d5-bdbf-7fab151b9be5 service placement] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:12.250895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b169b-7f92-47d5-bdbf-7fab151b9be5 service placement] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:12.250998 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09994b0-4e56-429b-97ac-5ae72f300592 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:12.251174 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b169b-7f92-47d5-bdbf-7fab151b9be5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:12.253142 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-056b169b-7f92-47d5-bdbf-7fab151b9be5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:12.265343 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b169b-7f92-47d5-bdbf-7fab151b9be5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:12.266991 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b169b-7f92-47d5-bdbf-7fab151b9be5 service placement] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:12.277512 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1401/2827] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:12.297306 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:12.313800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d09994b0-4e56-429b-97ac-5ae72f300592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:12.322961 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d09994b0-4e56-429b-97ac-5ae72f300592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:12.323796 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d09994b0-4e56-429b-97ac-5ae72f300592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:12.324492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d09994b0-4e56-429b-97ac-5ae72f300592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:12.332574 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d09994b0-4e56-429b-97ac-5ae72f300592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1057ac8f4c471bb9ffdb8a8f1fe61c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:12.351730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1427/2828] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:27:12 2022] DELETE /identity/v3/users/ad1057ac8f4c471bb9ffdb8a8f1fe61c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:27:12.528860 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b169b-7f92-47d5-bdbf-7fab151b9be5 service placement] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:12.540791 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b169b-7f92-47d5-bdbf-7fab151b9be5 service placement] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:12.551330 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:12.601016 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1b538-6b3f-418d-8a22-98f1f0156af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:12.601895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1b538-6b3f-418d-8a22-98f1f0156af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:12.602178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1b538-6b3f-418d-8a22-98f1f0156af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:12.602455 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1b538-6b3f-418d-8a22-98f1f0156af6 admin admin] PATH_INFO: `/v3/projects/f8ad959b0413410ab06c7ff793b7801b` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:12.603647 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1b538-6b3f-418d-8a22-98f1f0156af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ad959b0413410ab06c7ff793b7801b)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:12.605589 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1b538-6b3f-418d-8a22-98f1f0156af6 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:12.664144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8ad1b538-6b3f-418d-8a22-98f1f0156af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ad959b0413410ab06c7ff793b7801b', 'request_id': 'req-8ad1b538-6b3f-418d-8a22-98f1f0156af6'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:12.670480 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8ad1b538-6b3f-418d-8a22-98f1f0156af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ad959b0413410ab06c7ff793b7801b', 'request_id': 'req-8ad1b538-6b3f-418d-8a22-98f1f0156af6'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:12.676765 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8ad1b538-6b3f-418d-8a22-98f1f0156af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ad959b0413410ab06c7ff793b7801b', 'request_id': 'req-8ad1b538-6b3f-418d-8a22-98f1f0156af6'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:12.691252 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8ad1b538-6b3f-418d-8a22-98f1f0156af6 admin admin] The token cache is being invalidate because project f8ad959b0413410ab06c7ff793b7801b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:27:12.691565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8ad1b538-6b3f-418d-8a22-98f1f0156af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:12.692213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8ad1b538-6b3f-418d-8a22-98f1f0156af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:12.693821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1402/2829] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:27:12 2022] DELETE /identity/v3/projects/f8ad959b0413410ab06c7ff793b7801b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:12.699594 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e5e8f-1cde-401c-a8ff-0e9477cafc95 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:12.699885 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e5e8f-1cde-401c-a8ff-0e9477cafc95 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:12.700160 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e5e8f-1cde-401c-a8ff-0e9477cafc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:12.721848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-022e5e8f-1cde-401c-a8ff-0e9477cafc95 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:12.723071 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-022e5e8f-1cde-401c-a8ff-0e9477cafc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:12.788410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1428/2830] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:12.797134 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d11cf8-a06d-4bf5-b514-e5783dfc4c57 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:12.797470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d11cf8-a06d-4bf5-b514-e5783dfc4c57 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:12.803720 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d11cf8-a06d-4bf5-b514-e5783dfc4c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:12.821160 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-15d11cf8-a06d-4bf5-b514-e5783dfc4c57 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:12.822383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-15d11cf8-a06d-4bf5-b514-e5783dfc4c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:12.830735 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1403/2831] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:27:12.835707 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e5e8f-1cde-401c-a8ff-0e9477cafc95 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:12.847817 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e5e8f-1cde-401c-a8ff-0e9477cafc95 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:12.853842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0ffe2-2c5a-41fe-995e-65a9c18d4be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:12.854563 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0ffe2-2c5a-41fe-995e-65a9c18d4be6 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:12.854856 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0ffe2-2c5a-41fe-995e-65a9c18d4be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:12.855132 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0ffe2-2c5a-41fe-995e-65a9c18d4be6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:12.856054 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0ffe2-2c5a-41fe-995e-65a9c18d4be6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:27:12.856416 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0ffe2-2c5a-41fe-995e-65a9c18d4be6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:12.858043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0ffe2-2c5a-41fe-995e-65a9c18d4be6 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:12.870596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1429/2832] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:27:12.876675 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d11cf8-a06d-4bf5-b514-e5783dfc4c57 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:12.886471 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d11cf8-a06d-4bf5-b514-e5783dfc4c57 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:12.891315 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3905562-c9dc-4df7-9101-a7dceb02a9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:12.891967 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3905562-c9dc-4df7-9101-a7dceb02a9bb admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:12.892254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3905562-c9dc-4df7-9101-a7dceb02a9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:12.892560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3905562-c9dc-4df7-9101-a7dceb02a9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:12.893256 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3905562-c9dc-4df7-9101-a7dceb02a9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:12.895149 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3905562-c9dc-4df7-9101-a7dceb02a9bb admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:12.926222 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1404/2833] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:27:12 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:12.930645 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0ffe2-2c5a-41fe-995e-65a9c18d4be6 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:12.945458 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0ffe2-2c5a-41fe-995e-65a9c18d4be6 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:13.002497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7c43-47fa-40d5-84cb-b1003cac2394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:13.003168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7c43-47fa-40d5-84cb-b1003cac2394 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:13.003454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7c43-47fa-40d5-84cb-b1003cac2394 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:13.003728 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7c43-47fa-40d5-84cb-b1003cac2394 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:13.004462 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7c43-47fa-40d5-84cb-b1003cac2394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:13.006398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7c43-47fa-40d5-84cb-b1003cac2394 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:13.027455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1430/2834] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:27:12 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:13.031879 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3905562-c9dc-4df7-9101-a7dceb02a9bb admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:13.042634 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3905562-c9dc-4df7-9101-a7dceb02a9bb admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:13.047702 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f94b52-c270-4bf7-887f-b488684e2e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:13.048387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f94b52-c270-4bf7-887f-b488684e2e35 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:13.048670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f94b52-c270-4bf7-887f-b488684e2e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:13.048940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f94b52-c270-4bf7-887f-b488684e2e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:13.049667 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f94b52-c270-4bf7-887f-b488684e2e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:13.051283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f94b52-c270-4bf7-887f-b488684e2e35 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:13.061756 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1405/2835] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:13.066291 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7c43-47fa-40d5-84cb-b1003cac2394 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:13.081974 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7c43-47fa-40d5-84cb-b1003cac2394 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:13.088113 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e37205-4fc4-48e4-bca3-f87518e5e927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:13.088809 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e37205-4fc4-48e4-bca3-f87518e5e927 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:13.089103 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e37205-4fc4-48e4-bca3-f87518e5e927 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:13.089380 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e37205-4fc4-48e4-bca3-f87518e5e927 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:13.090125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e37205-4fc4-48e4-bca3-f87518e5e927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:13.091788 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e37205-4fc4-48e4-bca3-f87518e5e927 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:13.102257 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1431/2836] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:13.106521 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f94b52-c270-4bf7-887f-b488684e2e35 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:13.117204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f94b52-c270-4bf7-887f-b488684e2e35 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:13.122885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4a47c-b049-4001-bafc-106261aec173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:13.123771 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4a47c-b049-4001-bafc-106261aec173 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:13.124050 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4a47c-b049-4001-bafc-106261aec173 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:13.124356 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4a47c-b049-4001-bafc-106261aec173 admin admin] PATH_INFO: `/v3/projects/25511594dba6472c8e4ad46c81dec998/users/783e563840c34802ac063440de81ef3e/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:13.140077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4a47c-b049-4001-bafc-106261aec173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25511594dba6472c8e4ad46c81dec998, user_id=783e563840c34802ac063440de81ef3e, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:13.142863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4a47c-b049-4001-bafc-106261aec173 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:13.158531 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1406/2837] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:27:13 2022] PUT /identity/v3/projects/25511594dba6472c8e4ad46c81dec998/users/783e563840c34802ac063440de81ef3e/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:13.169952 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb198c2-0455-46a4-94a0-ca73e8131327 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:13.170368 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb198c2-0455-46a4-94a0-ca73e8131327 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:13.170698 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb198c2-0455-46a4-94a0-ca73e8131327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:13.202894 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-5cb198c2-0455-46a4-94a0-ca73e8131327 None None] MFA Rules not processed for user `783e563840c34802ac063440de81ef3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:13.204518 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-5cb198c2-0455-46a4-94a0-ca73e8131327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:13.210500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:13.277546 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1432/2838] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:13.282128 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4a47c-b049-4001-bafc-106261aec173 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:13.326180 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:13.349853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4a47c-b049-4001-bafc-106261aec173 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:13.354745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42b413-3a0f-4bfd-acfc-1ef83b678ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:13.355413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42b413-3a0f-4bfd-acfc-1ef83b678ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:13.355693 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42b413-3a0f-4bfd-acfc-1ef83b678ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:13.355971 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42b413-3a0f-4bfd-acfc-1ef83b678ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:13.356696 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42b413-3a0f-4bfd-acfc-1ef83b678ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:13.358604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42b413-3a0f-4bfd-acfc-1ef83b678ee1 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:13.385762 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1407/2839] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:27:13 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:13.389898 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb198c2-0455-46a4-94a0-ca73e8131327 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:13.401161 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb198c2-0455-46a4-94a0-ca73e8131327 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:13.463140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f852c3-6d2e-4006-b8db-405baaf6bfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:13.463826 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f852c3-6d2e-4006-b8db-405baaf6bfc9 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:13.464108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f852c3-6d2e-4006-b8db-405baaf6bfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:13.464410 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f852c3-6d2e-4006-b8db-405baaf6bfc9 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:13.465140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f852c3-6d2e-4006-b8db-405baaf6bfc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:13.467209 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f852c3-6d2e-4006-b8db-405baaf6bfc9 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:13.490036 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1433/2840] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:27:13 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:13.491384 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42b413-3a0f-4bfd-acfc-1ef83b678ee1 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:13.502834 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42b413-3a0f-4bfd-acfc-1ef83b678ee1 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:13.508861 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92390847-8a28-4dfd-9f2c-e5c1e4070b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:13.509537 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92390847-8a28-4dfd-9f2c-e5c1e4070b0f admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:13.509815 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92390847-8a28-4dfd-9f2c-e5c1e4070b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:13.510101 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92390847-8a28-4dfd-9f2c-e5c1e4070b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:13.510821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92390847-8a28-4dfd-9f2c-e5c1e4070b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:13.512450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92390847-8a28-4dfd-9f2c-e5c1e4070b0f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:13.528358 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1408/2841] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:13.532581 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f852c3-6d2e-4006-b8db-405baaf6bfc9 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:13.543294 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f852c3-6d2e-4006-b8db-405baaf6bfc9 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:13.548188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1a42f-a44b-43ba-ba13-70c230dd7e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:13.549119 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1a42f-a44b-43ba-ba13-70c230dd7e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:13.549435 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1a42f-a44b-43ba-ba13-70c230dd7e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:13.549713 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1a42f-a44b-43ba-ba13-70c230dd7e59 admin admin] PATH_INFO: `/v3/projects/87d088cec5c0463085352736fd4cdd37/users/e88817ddc4ce4f37a002a279dd890266/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:13.565580 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1a42f-a44b-43ba-ba13-70c230dd7e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d088cec5c0463085352736fd4cdd37, user_id=e88817ddc4ce4f37a002a279dd890266, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:13.568434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1a42f-a44b-43ba-ba13-70c230dd7e59 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:13.583619 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1434/2842] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:27:13 2022] PUT /identity/v3/projects/87d088cec5c0463085352736fd4cdd37/users/e88817ddc4ce4f37a002a279dd890266/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:13.587622 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92390847-8a28-4dfd-9f2c-e5c1e4070b0f admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:13.598089 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92390847-8a28-4dfd-9f2c-e5c1e4070b0f admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:13.663480 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4f256-118b-44a3-99df-9c405beb999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:13.664242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4f256-118b-44a3-99df-9c405beb999c admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:13.664553 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4f256-118b-44a3-99df-9c405beb999c admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:13.664830 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4f256-118b-44a3-99df-9c405beb999c admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:13.665551 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4f256-118b-44a3-99df-9c405beb999c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:13.667164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4f256-118b-44a3-99df-9c405beb999c admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:13.677261 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1409/2843] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:13.681638 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1a42f-a44b-43ba-ba13-70c230dd7e59 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:13.692061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1a42f-a44b-43ba-ba13-70c230dd7e59 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:13.697184 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfc5a3-c9e0-4b09-9ee2-d42f2d198863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:13.698077 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfc5a3-c9e0-4b09-9ee2-d42f2d198863 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:13.698329 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfc5a3-c9e0-4b09-9ee2-d42f2d198863 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:13.698602 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfc5a3-c9e0-4b09-9ee2-d42f2d198863 admin admin] PATH_INFO: `/v3/projects/87d088cec5c0463085352736fd4cdd37/users/e88817ddc4ce4f37a002a279dd890266/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:13.700661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfc5a3-c9e0-4b09-9ee2-d42f2d198863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d088cec5c0463085352736fd4cdd37, user_id=e88817ddc4ce4f37a002a279dd890266, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:13.703674 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfc5a3-c9e0-4b09-9ee2-d42f2d198863 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:13.714107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1435/2844] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:27:13 2022] PUT /identity/v3/projects/87d088cec5c0463085352736fd4cdd37/users/e88817ddc4ce4f37a002a279dd890266/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:13.724121 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f403b-a695-42fa-8955-c8cc4c1d8099 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:13.724487 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f403b-a695-42fa-8955-c8cc4c1d8099 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:13.724760 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f403b-a695-42fa-8955-c8cc4c1d8099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:13.750413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-4f5f403b-a695-42fa-8955-c8cc4c1d8099 None None] MFA Rules not processed for user `e88817ddc4ce4f37a002a279dd890266`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:13.751600 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4f5f403b-a695-42fa-8955-c8cc4c1d8099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:13.819662 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1410/2845] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:13.830605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfc5a3-c9e0-4b09-9ee2-d42f2d198863 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:13.832354 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a5dfc5a3-c9e0-4b09-9ee2-d42f2d198863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:13.894890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfc5a3-c9e0-4b09-9ee2-d42f2d198863 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:13.900271 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd77dc2-4171-416b-bab1-27b660f946d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:13.900990 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd77dc2-4171-416b-bab1-27b660f946d0 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:13.901276 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd77dc2-4171-416b-bab1-27b660f946d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:13.901556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd77dc2-4171-416b-bab1-27b660f946d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:13.911488 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd77dc2-4171-416b-bab1-27b660f946d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:13.913001 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd77dc2-4171-416b-bab1-27b660f946d0 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:13.922881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1436/2846] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:14.735961 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f403b-a695-42fa-8955-c8cc4c1d8099 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:14.737427 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4f5f403b-a695-42fa-8955-c8cc4c1d8099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:14.780386 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:14.831433 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f403b-a695-42fa-8955-c8cc4c1d8099 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:14.837470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb585e70-d515-44c3-9e94-1ef17c0ab35e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:14.838204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb585e70-d515-44c3-9e94-1ef17c0ab35e service nova] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:14.838554 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb585e70-d515-44c3-9e94-1ef17c0ab35e service nova] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:14.839009 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb585e70-d515-44c3-9e94-1ef17c0ab35e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:14.841840 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fb585e70-d515-44c3-9e94-1ef17c0ab35e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:14.857561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb585e70-d515-44c3-9e94-1ef17c0ab35e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:14.859535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb585e70-d515-44c3-9e94-1ef17c0ab35e service nova] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:14.873825 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1411/2847] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:15.420971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd77dc2-4171-416b-bab1-27b660f946d0 service cinder] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:15.425642 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:15.494009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd77dc2-4171-416b-bab1-27b660f946d0 service cinder] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:15.501408 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e62eb-dc19-461f-8267-5a642a9ef53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:15.502699 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e62eb-dc19-461f-8267-5a642a9ef53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:15.503057 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e62eb-dc19-461f-8267-5a642a9ef53d admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:15.503405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e62eb-dc19-461f-8267-5a642a9ef53d admin admin] PATH_INFO: `/v3/users/783e563840c34802ac063440de81ef3e` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:15.505298 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e62eb-dc19-461f-8267-5a642a9ef53d admin admin] RBAC: Authorizing `identity:delete_user(user_id=783e563840c34802ac063440de81ef3e)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:15.508357 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e62eb-dc19-461f-8267-5a642a9ef53d admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:15.562737 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4b4e62eb-dc19-461f-8267-5a642a9ef53d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783e563840c34802ac063440de81ef3e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:15.570895 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4b4e62eb-dc19-461f-8267-5a642a9ef53d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783e563840c34802ac063440de81ef3e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:15.571456 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4b4e62eb-dc19-461f-8267-5a642a9ef53d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783e563840c34802ac063440de81ef3e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:15.572154 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4b4e62eb-dc19-461f-8267-5a642a9ef53d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783e563840c34802ac063440de81ef3e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:15.580643 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4b4e62eb-dc19-461f-8267-5a642a9ef53d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783e563840c34802ac063440de81ef3e'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:15.599082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1437/2848] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:27:15 2022] DELETE /identity/v3/users/783e563840c34802ac063440de81ef3e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:15.603700 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1764d4-1986-4c4a-94ee-63b82bd2e02d None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:15.604073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1764d4-1986-4c4a-94ee-63b82bd2e02d None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:15.604483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1764d4-1986-4c4a-94ee-63b82bd2e02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:15.624510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-bd1764d4-1986-4c4a-94ee-63b82bd2e02d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:15.625908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-bd1764d4-1986-4c4a-94ee-63b82bd2e02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:15.689625 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1412/2849] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:27:15.699442 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e62eb-dc19-461f-8267-5a642a9ef53d admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:15.700927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4b4e62eb-dc19-461f-8267-5a642a9ef53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:15.762047 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e62eb-dc19-461f-8267-5a642a9ef53d admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:15.768507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b6161-9b0c-470b-9246-489f3646ef2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:15.769356 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b6161-9b0c-470b-9246-489f3646ef2e service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:15.769711 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b6161-9b0c-470b-9246-489f3646ef2e service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:15.770009 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b6161-9b0c-470b-9246-489f3646ef2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:15.780757 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b6161-9b0c-470b-9246-489f3646ef2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:15.782250 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b6161-9b0c-470b-9246-489f3646ef2e service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:15.792455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1438/2850] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:16.082266 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1764d4-1986-4c4a-94ee-63b82bd2e02d None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:16.083850 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-bd1764d4-1986-4c4a-94ee-63b82bd2e02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:16.103657 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1764d4-1986-4c4a-94ee-63b82bd2e02d None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:16.108708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:16.110602 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:16.110892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:16.111169 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] PATH_INFO: `/v3/projects/25511594dba6472c8e4ad46c81dec998` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:16.112676 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25511594dba6472c8e4ad46c81dec998)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:16.115483 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:16.169605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25511594dba6472c8e4ad46c81dec998', 'request_id': 'req-79ce2c9c-94de-49d7-955e-a498db819ef3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.175486 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25511594dba6472c8e4ad46c81dec998', 'request_id': 'req-79ce2c9c-94de-49d7-955e-a498db819ef3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.181883 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25511594dba6472c8e4ad46c81dec998', 'request_id': 'req-79ce2c9c-94de-49d7-955e-a498db819ef3'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.197199 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] The token cache is being invalidate because project 25511594dba6472c8e4ad46c81dec998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:27:16.197495 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.198145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.199934 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1413/2851] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:27:16 2022] DELETE /identity/v3/projects/25511594dba6472c8e4ad46c81dec998 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:16.204050 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b6161-9b0c-470b-9246-489f3646ef2e service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:16.213614 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b6161-9b0c-470b-9246-489f3646ef2e service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:16.233216 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:16.276446 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651b6c5-8fb8-48d9-be16-215c80c95caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:16.277332 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651b6c5-8fb8-48d9-be16-215c80c95caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:16.277609 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651b6c5-8fb8-48d9-be16-215c80c95caf admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:16.277881 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651b6c5-8fb8-48d9-be16-215c80c95caf admin admin] PATH_INFO: `/v3/users/e88817ddc4ce4f37a002a279dd890266` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:16.279082 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651b6c5-8fb8-48d9-be16-215c80c95caf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88817ddc4ce4f37a002a279dd890266)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:16.281075 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651b6c5-8fb8-48d9-be16-215c80c95caf admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:16.331906 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2651b6c5-8fb8-48d9-be16-215c80c95caf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88817ddc4ce4f37a002a279dd890266'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.342349 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2651b6c5-8fb8-48d9-be16-215c80c95caf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88817ddc4ce4f37a002a279dd890266'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.343224 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2651b6c5-8fb8-48d9-be16-215c80c95caf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88817ddc4ce4f37a002a279dd890266'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.344170 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2651b6c5-8fb8-48d9-be16-215c80c95caf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88817ddc4ce4f37a002a279dd890266'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.362764 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-2651b6c5-8fb8-48d9-be16-215c80c95caf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88817ddc4ce4f37a002a279dd890266'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.384336 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1439/2852] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:27:16 2022] DELETE /identity/v3/users/e88817ddc4ce4f37a002a279dd890266 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:16.685812 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:16.687292 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:16.701794 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce2c9c-94de-49d7-955e-a498db819ef3 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:16.754347 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:16.788920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb77917-53f8-4b49-ba81-abe7b42f6083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:16.789800 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb77917-53f8-4b49-ba81-abe7b42f6083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:16.790081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb77917-53f8-4b49-ba81-abe7b42f6083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:16.790350 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb77917-53f8-4b49-ba81-abe7b42f6083 admin admin] PATH_INFO: `/v3/projects/87d088cec5c0463085352736fd4cdd37` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:16.791736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb77917-53f8-4b49-ba81-abe7b42f6083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d088cec5c0463085352736fd4cdd37)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:16.793678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb77917-53f8-4b49-ba81-abe7b42f6083 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:16.851670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6eb77917-53f8-4b49-ba81-abe7b42f6083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d088cec5c0463085352736fd4cdd37', 'request_id': 'req-6eb77917-53f8-4b49-ba81-abe7b42f6083'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.858493 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6eb77917-53f8-4b49-ba81-abe7b42f6083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d088cec5c0463085352736fd4cdd37', 'request_id': 'req-6eb77917-53f8-4b49-ba81-abe7b42f6083'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.865304 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6eb77917-53f8-4b49-ba81-abe7b42f6083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d088cec5c0463085352736fd4cdd37', 'request_id': 'req-6eb77917-53f8-4b49-ba81-abe7b42f6083'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.881388 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6eb77917-53f8-4b49-ba81-abe7b42f6083 admin admin] The token cache is being invalidate because project 87d088cec5c0463085352736fd4cdd37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:27:16.882135 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6eb77917-53f8-4b49-ba81-abe7b42f6083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.883708 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-6eb77917-53f8-4b49-ba81-abe7b42f6083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:16.885527 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1414/2853] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:27:16 2022] DELETE /identity/v3/projects/87d088cec5c0463085352736fd4cdd37 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:16.890655 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b688f0-62d8-4a86-a6f8-a848b625959f None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:16.891537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b688f0-62d8-4a86-a6f8-a848b625959f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:16.891830 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b688f0-62d8-4a86-a6f8-a848b625959f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:16.933879 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-f9b688f0-62d8-4a86-a6f8-a848b625959f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:16.935096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f9b688f0-62d8-4a86-a6f8-a848b625959f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:17.003117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1440/2854] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:17.012654 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899019f-fcbc-4727-a17d-1429c11264d7 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.012943 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899019f-fcbc-4727-a17d-1429c11264d7 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.013223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899019f-fcbc-4727-a17d-1429c11264d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.031492 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-b899019f-fcbc-4727-a17d-1429c11264d7 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:17.032736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-b899019f-fcbc-4727-a17d-1429c11264d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:17.040944 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1415/2855] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:17.045391 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b688f0-62d8-4a86-a6f8-a848b625959f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:17.055455 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b688f0-62d8-4a86-a6f8-a848b625959f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:17.060439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc3094-9881-443e-80cf-8044c949c85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:17.061117 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc3094-9881-443e-80cf-8044c949c85c admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.061403 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc3094-9881-443e-80cf-8044c949c85c admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.061681 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc3094-9881-443e-80cf-8044c949c85c admin admin] PATH_INFO: `/v3/domains` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.062443 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc3094-9881-443e-80cf-8044c949c85c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86735) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:27:17.062751 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc3094-9881-443e-80cf-8044c949c85c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:17.064401 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc3094-9881-443e-80cf-8044c949c85c admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:17.076805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1441/2856] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:27:17.081620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899019f-fcbc-4727-a17d-1429c11264d7 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:17.091479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899019f-fcbc-4727-a17d-1429c11264d7 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:17.096620 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5e97c-380d-42f8-9d7b-97a9ac0c06f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:17.097286 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e97c-380d-42f8-9d7b-97a9ac0c06f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.097573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e97c-380d-42f8-9d7b-97a9ac0c06f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.097848 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e97c-380d-42f8-9d7b-97a9ac0c06f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.098560 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5e97c-380d-42f8-9d7b-97a9ac0c06f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:17.100587 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5e97c-380d-42f8-9d7b-97a9ac0c06f0 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:17.129181 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1416/2857] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:27:17 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:17.133702 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc3094-9881-443e-80cf-8044c949c85c admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:17.144272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc3094-9881-443e-80cf-8044c949c85c admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:17.173373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:17.204484 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b379a6-71ce-4370-9a2b-8ef1c80b6f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:17.205168 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b379a6-71ce-4370-9a2b-8ef1c80b6f34 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.205450 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b379a6-71ce-4370-9a2b-8ef1c80b6f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.205724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b379a6-71ce-4370-9a2b-8ef1c80b6f34 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.206421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b379a6-71ce-4370-9a2b-8ef1c80b6f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:17.208387 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b379a6-71ce-4370-9a2b-8ef1c80b6f34 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:17.228699 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1442/2858] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:27:17 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:17.232922 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5e97c-380d-42f8-9d7b-97a9ac0c06f0 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:17.243305 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5e97c-380d-42f8-9d7b-97a9ac0c06f0 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:17.247999 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6c9e9-fd81-4957-ba63-50eb57be6766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:17.248692 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c9e9-fd81-4957-ba63-50eb57be6766 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.248941 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c9e9-fd81-4957-ba63-50eb57be6766 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.249213 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c9e9-fd81-4957-ba63-50eb57be6766 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.249945 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6c9e9-fd81-4957-ba63-50eb57be6766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:17.251550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6c9e9-fd81-4957-ba63-50eb57be6766 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:17.263211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1417/2859] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 16:27:17.267134 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b379a6-71ce-4370-9a2b-8ef1c80b6f34 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:17.277325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b379a6-71ce-4370-9a2b-8ef1c80b6f34 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:17.282034 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efad75c-2583-4078-8308-6536f819887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:17.282691 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad75c-2583-4078-8308-6536f819887b admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.282970 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad75c-2583-4078-8308-6536f819887b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.283244 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad75c-2583-4078-8308-6536f819887b admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.283993 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efad75c-2583-4078-8308-6536f819887b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:17.285619 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efad75c-2583-4078-8308-6536f819887b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:17.297400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1443/2860] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:17.303887 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6c9e9-fd81-4957-ba63-50eb57be6766 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:17.321520 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6c9e9-fd81-4957-ba63-50eb57be6766 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:17.327283 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ba0f4-d996-4659-a391-841aa59355cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:17.328562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ba0f4-d996-4659-a391-841aa59355cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.328842 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ba0f4-d996-4659-a391-841aa59355cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.329117 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ba0f4-d996-4659-a391-841aa59355cf admin admin] PATH_INFO: `/v3/projects/2e1b8fb44bf24044867863c48673f3bc/users/633db108205c4c149a40e7224ee3440d/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.346170 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ba0f4-d996-4659-a391-841aa59355cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1b8fb44bf24044867863c48673f3bc, user_id=633db108205c4c149a40e7224ee3440d, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:17.348915 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ba0f4-d996-4659-a391-841aa59355cf admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:17.368155 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1418/2861] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:27:17 2022] PUT /identity/v3/projects/2e1b8fb44bf24044867863c48673f3bc/users/633db108205c4c149a40e7224ee3440d/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:17.378808 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d8f5-2a55-4b9a-b916-68e473637b33 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.379097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d8f5-2a55-4b9a-b916-68e473637b33 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.379372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d8f5-2a55-4b9a-b916-68e473637b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.408153 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-a795d8f5-2a55-4b9a-b916-68e473637b33 None None] MFA Rules not processed for user `633db108205c4c149a40e7224ee3440d`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:17.409372 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a795d8f5-2a55-4b9a-b916-68e473637b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:17.481098 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1444/2862] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:17.486248 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ba0f4-d996-4659-a391-841aa59355cf admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:17.565627 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ba0f4-d996-4659-a391-841aa59355cf admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:17.571348 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da14ef-e2a9-461b-aadf-a13035825688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:17.572019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da14ef-e2a9-461b-aadf-a13035825688 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.572322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da14ef-e2a9-461b-aadf-a13035825688 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.572607 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da14ef-e2a9-461b-aadf-a13035825688 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.573309 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da14ef-e2a9-461b-aadf-a13035825688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:17.575235 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da14ef-e2a9-461b-aadf-a13035825688 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:17.589920 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:17.606365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1419/2863] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:27:17 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:17.610507 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d8f5-2a55-4b9a-b916-68e473637b33 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:17.621405 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d8f5-2a55-4b9a-b916-68e473637b33 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:17.680948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d22b8-436e-4fe9-9c0b-7dd72a7cc373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:17.681635 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d22b8-436e-4fe9-9c0b-7dd72a7cc373 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.681921 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d22b8-436e-4fe9-9c0b-7dd72a7cc373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.682201 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d22b8-436e-4fe9-9c0b-7dd72a7cc373 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.682899 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d22b8-436e-4fe9-9c0b-7dd72a7cc373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:17.684940 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d22b8-436e-4fe9-9c0b-7dd72a7cc373 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:17.706069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1445/2864] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:27:17 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:17.710214 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da14ef-e2a9-461b-aadf-a13035825688 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:17.720832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da14ef-e2a9-461b-aadf-a13035825688 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:17.726585 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacd91e-face-474e-af7c-f19b39496c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:17.727249 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacd91e-face-474e-af7c-f19b39496c65 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.727510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacd91e-face-474e-af7c-f19b39496c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.727776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacd91e-face-474e-af7c-f19b39496c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.728550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacd91e-face-474e-af7c-f19b39496c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:17.730159 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacd91e-face-474e-af7c-f19b39496c65 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:17.741321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1420/2865] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:17.745726 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d22b8-436e-4fe9-9c0b-7dd72a7cc373 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:17.756748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d22b8-436e-4fe9-9c0b-7dd72a7cc373 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:17.762142 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bc465-b6d5-49f1-95ee-54706c9af208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:17.763041 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bc465-b6d5-49f1-95ee-54706c9af208 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.763326 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bc465-b6d5-49f1-95ee-54706c9af208 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.763603 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bc465-b6d5-49f1-95ee-54706c9af208 admin admin] PATH_INFO: `/v3/projects/7a8f3c73de0a4a369a7342f8e11b03f6/users/5ce3b249b5714e44af551821329cbee2/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.780052 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bc465-b6d5-49f1-95ee-54706c9af208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8f3c73de0a4a369a7342f8e11b03f6, user_id=5ce3b249b5714e44af551821329cbee2, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:17.782871 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bc465-b6d5-49f1-95ee-54706c9af208 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:17.797890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1446/2866] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:27:17 2022] PUT /identity/v3/projects/7a8f3c73de0a4a369a7342f8e11b03f6/users/5ce3b249b5714e44af551821329cbee2/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:17.801885 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacd91e-face-474e-af7c-f19b39496c65 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:17.812335 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacd91e-face-474e-af7c-f19b39496c65 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:17.874405 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3c670-1d55-4d44-a020-3402a94a2796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:17.875077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3c670-1d55-4d44-a020-3402a94a2796 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.875372 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3c670-1d55-4d44-a020-3402a94a2796 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.875648 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3c670-1d55-4d44-a020-3402a94a2796 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.876424 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3c670-1d55-4d44-a020-3402a94a2796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:17.878055 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3c670-1d55-4d44-a020-3402a94a2796 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:17.889133 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1421/2867] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:17.893583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bc465-b6d5-49f1-95ee-54706c9af208 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:17.900369 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:17.904692 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bc465-b6d5-49f1-95ee-54706c9af208 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:17.910865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b89cdb-8bb6-4448-b276-408c5021c455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:17.912076 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b89cdb-8bb6-4448-b276-408c5021c455 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.912396 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b89cdb-8bb6-4448-b276-408c5021c455 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.912669 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b89cdb-8bb6-4448-b276-408c5021c455 admin admin] PATH_INFO: `/v3/projects/7a8f3c73de0a4a369a7342f8e11b03f6/users/5ce3b249b5714e44af551821329cbee2/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.915605 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b89cdb-8bb6-4448-b276-408c5021c455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8f3c73de0a4a369a7342f8e11b03f6, user_id=5ce3b249b5714e44af551821329cbee2, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:17.918498 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b89cdb-8bb6-4448-b276-408c5021c455 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:17.929628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1447/2868] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:27:17 2022] PUT /identity/v3/projects/7a8f3c73de0a4a369a7342f8e11b03f6/users/5ce3b249b5714e44af551821329cbee2/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:17.940036 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68e46c-21bb-45a1-917b-a40f713a186a None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:17.940036 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68e46c-21bb-45a1-917b-a40f713a186a None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:17.940416 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68e46c-21bb-45a1-917b-a40f713a186a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:17.968722 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-3b68e46c-21bb-45a1-917b-a40f713a186a None None] MFA Rules not processed for user `5ce3b249b5714e44af551821329cbee2`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:17.970029 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-3b68e46c-21bb-45a1-917b-a40f713a186a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:18.051446 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1422/2869] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:18.060332 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b89cdb-8bb6-4448-b276-408c5021c455 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:18.062492 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b8b89cdb-8bb6-4448-b276-408c5021c455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:18.152536 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b89cdb-8bb6-4448-b276-408c5021c455 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:18.153840 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a15382-88d5-45b7-86b6-4150a9e018b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:18.154589 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15382-88d5-45b7-86b6-4150a9e018b2 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:18.154946 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15382-88d5-45b7-86b6-4150a9e018b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:18.155363 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15382-88d5-45b7-86b6-4150a9e018b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:18.167525 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a15382-88d5-45b7-86b6-4150a9e018b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:18.167525 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a15382-88d5-45b7-86b6-4150a9e018b2 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:18.178915 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1448/2870] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:18.325988 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68e46c-21bb-45a1-917b-a40f713a186a None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:18.401320 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68e46c-21bb-45a1-917b-a40f713a186a None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:18.408984 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b23ce-4755-4e75-b0e7-253bb9858d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:18.410316 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b23ce-4755-4e75-b0e7-253bb9858d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:18.410667 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b23ce-4755-4e75-b0e7-253bb9858d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:18.410987 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b23ce-4755-4e75-b0e7-253bb9858d07 admin admin] PATH_INFO: `/v3/users/633db108205c4c149a40e7224ee3440d` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:18.412893 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b23ce-4755-4e75-b0e7-253bb9858d07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=633db108205c4c149a40e7224ee3440d)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:18.416939 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b23ce-4755-4e75-b0e7-253bb9858d07 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:18.424964 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:18.484562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-867b23ce-4755-4e75-b0e7-253bb9858d07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633db108205c4c149a40e7224ee3440d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:18.498028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-867b23ce-4755-4e75-b0e7-253bb9858d07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633db108205c4c149a40e7224ee3440d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:18.499217 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-867b23ce-4755-4e75-b0e7-253bb9858d07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633db108205c4c149a40e7224ee3440d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:18.499940 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-867b23ce-4755-4e75-b0e7-253bb9858d07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633db108205c4c149a40e7224ee3440d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:18.512049 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-867b23ce-4755-4e75-b0e7-253bb9858d07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633db108205c4c149a40e7224ee3440d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:18.544105 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1423/2871] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:27:18 2022] DELETE /identity/v3/users/633db108205c4c149a40e7224ee3440d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:18.550434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62b539-6d0a-4f8c-8b5a-90339a032194 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:18.550805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62b539-6d0a-4f8c-8b5a-90339a032194 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:18.554011 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62b539-6d0a-4f8c-8b5a-90339a032194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:18.592545 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-fd62b539-6d0a-4f8c-8b5a-90339a032194 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:18.594135 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-fd62b539-6d0a-4f8c-8b5a-90339a032194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:18.691383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1449/2872] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:27:18.709214 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b23ce-4755-4e75-b0e7-253bb9858d07 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:18.711337 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-867b23ce-4755-4e75-b0e7-253bb9858d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:18.796046 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b23ce-4755-4e75-b0e7-253bb9858d07 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:18.800655 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ad479-a993-44ee-bc32-ef1034b13a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:18.802247 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ad479-a993-44ee-bc32-ef1034b13a6e service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:18.802532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ad479-a993-44ee-bc32-ef1034b13a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:18.802806 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ad479-a993-44ee-bc32-ef1034b13a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:18.814681 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ad479-a993-44ee-bc32-ef1034b13a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:18.816744 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ad479-a993-44ee-bc32-ef1034b13a6e service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:18.830381 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1424/2873] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:19.202086 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62b539-6d0a-4f8c-8b5a-90339a032194 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:19.207000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-fd62b539-6d0a-4f8c-8b5a-90339a032194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:19.232090 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62b539-6d0a-4f8c-8b5a-90339a032194 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:19.239046 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:19.239942 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:19.240227 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:19.240552 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] PATH_INFO: `/v3/projects/2e1b8fb44bf24044867863c48673f3bc` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:19.241869 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1b8fb44bf24044867863c48673f3bc)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:19.244075 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:19.300755 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1b8fb44bf24044867863c48673f3bc', 'request_id': 'req-34d1a592-d22f-426a-b0b6-110b8caaa462'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.307084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1b8fb44bf24044867863c48673f3bc', 'request_id': 'req-34d1a592-d22f-426a-b0b6-110b8caaa462'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.312690 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1b8fb44bf24044867863c48673f3bc', 'request_id': 'req-34d1a592-d22f-426a-b0b6-110b8caaa462'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.330270 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] The token cache is being invalidate because project 2e1b8fb44bf24044867863c48673f3bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:27:19.330510 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.331146 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.335865 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1450/2874] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:27:19 2022] DELETE /identity/v3/projects/2e1b8fb44bf24044867863c48673f3bc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:19.337404 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ad479-a993-44ee-bc32-ef1034b13a6e service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:19.347218 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ad479-a993-44ee-bc32-ef1034b13a6e service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:19.405937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ca2b0-1a65-47bf-9077-ef44b5ee11b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:19.406853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ca2b0-1a65-47bf-9077-ef44b5ee11b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:19.407121 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ca2b0-1a65-47bf-9077-ef44b5ee11b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:19.407400 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ca2b0-1a65-47bf-9077-ef44b5ee11b0 admin admin] PATH_INFO: `/v3/users/5ce3b249b5714e44af551821329cbee2` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:19.408721 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ca2b0-1a65-47bf-9077-ef44b5ee11b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce3b249b5714e44af551821329cbee2)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:19.410705 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ca2b0-1a65-47bf-9077-ef44b5ee11b0 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:19.445204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:19.466513 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f50ca2b0-1a65-47bf-9077-ef44b5ee11b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce3b249b5714e44af551821329cbee2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.473510 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f50ca2b0-1a65-47bf-9077-ef44b5ee11b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce3b249b5714e44af551821329cbee2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.474220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f50ca2b0-1a65-47bf-9077-ef44b5ee11b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce3b249b5714e44af551821329cbee2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.474975 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f50ca2b0-1a65-47bf-9077-ef44b5ee11b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce3b249b5714e44af551821329cbee2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.483935 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-f50ca2b0-1a65-47bf-9077-ef44b5ee11b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce3b249b5714e44af551821329cbee2'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.507997 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1425/2875] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:27:19 2022] DELETE /identity/v3/users/5ce3b249b5714e44af551821329cbee2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:19.801275 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:19.802754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:19.818340 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1a592-d22f-426a-b0b6-110b8caaa462 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:19.832529 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:19.883149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:19.884011 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:19.884305 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:19.884596 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a admin admin] PATH_INFO: `/v3/projects/7a8f3c73de0a4a369a7342f8e11b03f6` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:19.885928 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8f3c73de0a4a369a7342f8e11b03f6)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:19.887890 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:19.947574 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8f3c73de0a4a369a7342f8e11b03f6', 'request_id': 'req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.954366 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8f3c73de0a4a369a7342f8e11b03f6', 'request_id': 'req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.960081 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8f3c73de0a4a369a7342f8e11b03f6', 'request_id': 'req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.973379 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a admin admin] The token cache is being invalidate because project 7a8f3c73de0a4a369a7342f8e11b03f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:27:19.973668 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.974280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-59e3b93e-f94f-47c4-9dbb-d509c6f85d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:19.976149 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1451/2876] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:27:19 2022] DELETE /identity/v3/projects/7a8f3c73de0a4a369a7342f8e11b03f6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:19.981196 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6396aa-d097-45af-8649-204afc075e2f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:19.981485 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6396aa-d097-45af-8649-204afc075e2f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:19.981771 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6396aa-d097-45af-8649-204afc075e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.001439 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-dd6396aa-d097-45af-8649-204afc075e2f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:20.002666 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-dd6396aa-d097-45af-8649-204afc075e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:20.067536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1426/2877] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:20.076650 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350b629-d2a2-4c60-b272-77db989acd5f None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.076913 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350b629-d2a2-4c60-b272-77db989acd5f None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.077220 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350b629-d2a2-4c60-b272-77db989acd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.097444 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-3350b629-d2a2-4c60-b272-77db989acd5f None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:20.098667 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-3350b629-d2a2-4c60-b272-77db989acd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:20.108794 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1452/2878] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:20.113198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6396aa-d097-45af-8649-204afc075e2f None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:20.123536 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6396aa-d097-45af-8649-204afc075e2f None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:20.129328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244c2b4-92e8-495c-8828-5965a04b462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:20.129989 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244c2b4-92e8-495c-8828-5965a04b462a admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.130271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244c2b4-92e8-495c-8828-5965a04b462a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.130546 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244c2b4-92e8-495c-8828-5965a04b462a admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.131276 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244c2b4-92e8-495c-8828-5965a04b462a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:27:20.131685 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244c2b4-92e8-495c-8828-5965a04b462a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:20.133545 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244c2b4-92e8-495c-8828-5965a04b462a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:20.145923 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1427/2879] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:27:20.150485 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350b629-d2a2-4c60-b272-77db989acd5f None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:20.160598 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350b629-d2a2-4c60-b272-77db989acd5f None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:20.166188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b97221-4cff-45fa-a89e-3b68250712e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:20.166912 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b97221-4cff-45fa-a89e-3b68250712e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.167198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b97221-4cff-45fa-a89e-3b68250712e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.167461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b97221-4cff-45fa-a89e-3b68250712e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.168176 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b97221-4cff-45fa-a89e-3b68250712e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:20.170140 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b97221-4cff-45fa-a89e-3b68250712e7 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:20.199777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1453/2880] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:27:20 2022] POST /identity/v3/projects => generated 407 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:20.205678 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244c2b4-92e8-495c-8828-5965a04b462a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:20.215759 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244c2b4-92e8-495c-8828-5965a04b462a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:20.273886 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c96976-5385-40c5-9084-7480733f59c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:20.275832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c96976-5385-40c5-9084-7480733f59c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.275832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c96976-5385-40c5-9084-7480733f59c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.275832 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c96976-5385-40c5-9084-7480733f59c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.276171 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c96976-5385-40c5-9084-7480733f59c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:20.278263 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c96976-5385-40c5-9084-7480733f59c1 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:20.301838 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1428/2881] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:27:20 2022] POST /identity/v3/users => generated 304 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:20.306218 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b97221-4cff-45fa-a89e-3b68250712e7 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:20.322128 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b97221-4cff-45fa-a89e-3b68250712e7 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:20.327847 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde99cd-2567-403e-828b-d2361461f581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:20.328945 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde99cd-2567-403e-828b-d2361461f581 admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.329238 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde99cd-2567-403e-828b-d2361461f581 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.329521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde99cd-2567-403e-828b-d2361461f581 admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.330728 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde99cd-2567-403e-828b-d2361461f581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:20.332000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde99cd-2567-403e-828b-d2361461f581 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:20.346265 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1454/2882] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:20.348022 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c96976-5385-40c5-9084-7480733f59c1 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:20.360057 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c96976-5385-40c5-9084-7480733f59c1 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:20.364301 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075b915-89a2-4773-8998-605e00f82901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:20.364985 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075b915-89a2-4773-8998-605e00f82901 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.365269 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075b915-89a2-4773-8998-605e00f82901 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.365548 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075b915-89a2-4773-8998-605e00f82901 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.366895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075b915-89a2-4773-8998-605e00f82901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:20.368529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075b915-89a2-4773-8998-605e00f82901 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:20.379351 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1429/2883] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:20.384269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde99cd-2567-403e-828b-d2361461f581 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:20.394316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde99cd-2567-403e-828b-d2361461f581 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:20.399268 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61a713-6969-4a53-937d-05da93d81ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:20.400156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61a713-6969-4a53-937d-05da93d81ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.400475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61a713-6969-4a53-937d-05da93d81ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.400754 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61a713-6969-4a53-937d-05da93d81ec4 admin admin] PATH_INFO: `/v3/projects/4b0737da9444408fa13bf9d9f29784a0/users/99242c166b5c4e289881b4c8045b2949/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.416761 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61a713-6969-4a53-937d-05da93d81ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0737da9444408fa13bf9d9f29784a0, user_id=99242c166b5c4e289881b4c8045b2949, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:20.419714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61a713-6969-4a53-937d-05da93d81ec4 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:20.434907 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1455/2884] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:27:20 2022] PUT /identity/v3/projects/4b0737da9444408fa13bf9d9f29784a0/users/99242c166b5c4e289881b4c8045b2949/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:20.445482 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8f93c-2757-497c-aacc-260f0347768f None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.445772 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8f93c-2757-497c-aacc-260f0347768f None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.446052 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8f93c-2757-497c-aacc-260f0347768f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.469098 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:20.486512 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-8cc8f93c-2757-497c-aacc-260f0347768f None None] MFA Rules not processed for user `99242c166b5c4e289881b4c8045b2949`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:20.487790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8cc8f93c-2757-497c-aacc-260f0347768f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:20.488641 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84171b8c-1371-4114-9911-3c0af92d589e None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.488991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84171b8c-1371-4114-9911-3c0af92d589e None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.489280 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84171b8c-1371-4114-9911-3c0af92d589e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.509311 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-84171b8c-1371-4114-9911-3c0af92d589e None None] MFA Rules not processed for user `b701c953ae4f485ba6cefed3178f9951`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:20.510617 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-84171b8c-1371-4114-9911-3c0af92d589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:20.556108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:20.573479 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1430/2885] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:20.578040 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8f93c-2757-497c-aacc-260f0347768f None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:20.579454 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1456/2886] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:20.646254 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8f93c-2757-497c-aacc-260f0347768f None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:20.651236 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79888261-ea99-4764-bf78-d875cf5d04e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:20.651899 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79888261-ea99-4764-bf78-d875cf5d04e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.652178 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79888261-ea99-4764-bf78-d875cf5d04e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.652595 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79888261-ea99-4764-bf78-d875cf5d04e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.653293 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79888261-ea99-4764-bf78-d875cf5d04e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:20.655250 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79888261-ea99-4764-bf78-d875cf5d04e3 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:20.683242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1431/2887] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:27:20 2022] POST /identity/v3/projects => generated 409 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 16:27:20.687515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84171b8c-1371-4114-9911-3c0af92d589e None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:20.698400 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84171b8c-1371-4114-9911-3c0af92d589e None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:20.755675 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b85bc2-c385-4dd7-b8fa-93dfa48ada63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:20.756790 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b85bc2-c385-4dd7-b8fa-93dfa48ada63 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.757081 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b85bc2-c385-4dd7-b8fa-93dfa48ada63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.757272 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b85bc2-c385-4dd7-b8fa-93dfa48ada63 admin admin] PATH_INFO: `/v3/users` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.757976 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b85bc2-c385-4dd7-b8fa-93dfa48ada63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:20.759958 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b85bc2-c385-4dd7-b8fa-93dfa48ada63 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:20.781394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1457/2888] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:27:20 2022] POST /identity/v3/users => generated 311 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:20.785604 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79888261-ea99-4764-bf78-d875cf5d04e3 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:20.797826 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79888261-ea99-4764-bf78-d875cf5d04e3 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:20.803803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27370573-8ce4-4363-9af5-65ae5bcaec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:20.804643 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27370573-8ce4-4363-9af5-65ae5bcaec4d admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.805102 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27370573-8ce4-4363-9af5-65ae5bcaec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.805478 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27370573-8ce4-4363-9af5-65ae5bcaec4d admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.806437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27370573-8ce4-4363-9af5-65ae5bcaec4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:20.808159 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27370573-8ce4-4363-9af5-65ae5bcaec4d admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:20.815608 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b85bc2-c385-4dd7-b8fa-93dfa48ada63 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:20.817648 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-35b85bc2-c385-4dd7-b8fa-93dfa48ada63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:20.823741 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1432/2889] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:20.824918 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27370573-8ce4-4363-9af5-65ae5bcaec4d admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:20.835395 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27370573-8ce4-4363-9af5-65ae5bcaec4d admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:20.840071 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14beecd-bbd8-4db2-9dc0-6301f12dfd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:20.841010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14beecd-bbd8-4db2-9dc0-6301f12dfd39 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.841292 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14beecd-bbd8-4db2-9dc0-6301f12dfd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.841565 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14beecd-bbd8-4db2-9dc0-6301f12dfd39 admin admin] PATH_INFO: `/v3/projects/a8d6284e1c4d4485a1a8ee2bff825f06/users/323e0f96fea6428fb869d625a76340a6/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.857219 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14beecd-bbd8-4db2-9dc0-6301f12dfd39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d6284e1c4d4485a1a8ee2bff825f06, user_id=323e0f96fea6428fb869d625a76340a6, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:20.859955 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14beecd-bbd8-4db2-9dc0-6301f12dfd39 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:20.875489 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1433/2890] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:27:20 2022] PUT /identity/v3/projects/a8d6284e1c4d4485a1a8ee2bff825f06/users/323e0f96fea6428fb869d625a76340a6/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:20.879533 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14beecd-bbd8-4db2-9dc0-6301f12dfd39 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:20.887100 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b85bc2-c385-4dd7-b8fa-93dfa48ada63 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:20.929841 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:20.935297 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d58162-dfe7-4c1f-9ba5-c1e472a48d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:20.935954 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d58162-dfe7-4c1f-9ba5-c1e472a48d00 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.936240 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d58162-dfe7-4c1f-9ba5-c1e472a48d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.936542 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d58162-dfe7-4c1f-9ba5-c1e472a48d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.938391 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f3d58162-dfe7-4c1f-9ba5-c1e472a48d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:20.942006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14beecd-bbd8-4db2-9dc0-6301f12dfd39 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:20.947938 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267566f-fb4e-4ff6-a270-6644ad2df797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:20.948645 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267566f-fb4e-4ff6-a270-6644ad2df797 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.948960 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267566f-fb4e-4ff6-a270-6644ad2df797 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.949238 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267566f-fb4e-4ff6-a270-6644ad2df797 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.949979 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267566f-fb4e-4ff6-a270-6644ad2df797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:20.951593 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267566f-fb4e-4ff6-a270-6644ad2df797 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:20.965365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1434/2891] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:20.965365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267566f-fb4e-4ff6-a270-6644ad2df797 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:20.965365 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-7267566f-fb4e-4ff6-a270-6644ad2df797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:20.978200 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267566f-fb4e-4ff6-a270-6644ad2df797 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:20.982924 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaf1b4-d0fc-4d5c-ba98-ee6a13a0e5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:20.983847 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaf1b4-d0fc-4d5c-ba98-ee6a13a0e5db service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:20.984322 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaf1b4-d0fc-4d5c-ba98-ee6a13a0e5db service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:20.984615 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaf1b4-d0fc-4d5c-ba98-ee6a13a0e5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:20.986572 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5edaf1b4-d0fc-4d5c-ba98-ee6a13a0e5db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:20.989055 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:20.996968 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edaf1b4-d0fc-4d5c-ba98-ee6a13a0e5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:21.004980 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edaf1b4-d0fc-4d5c-ba98-ee6a13a0e5db service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:21.011010 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1435/2892] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:21.011851 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaf1b4-d0fc-4d5c-ba98-ee6a13a0e5db service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:21.013234 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d58162-dfe7-4c1f-9ba5-c1e472a48d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:21.014886 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d58162-dfe7-4c1f-9ba5-c1e472a48d00 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:21.023437 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edaf1b4-d0fc-4d5c-ba98-ee6a13a0e5db service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:21.028002 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d4ccf-6450-43eb-83ed-a33ae09783c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:21.028929 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d4ccf-6450-43eb-83ed-a33ae09783c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:21.029207 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d4ccf-6450-43eb-83ed-a33ae09783c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:21.029474 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d4ccf-6450-43eb-83ed-a33ae09783c8 admin admin] PATH_INFO: `/v3/projects/a8d6284e1c4d4485a1a8ee2bff825f06/users/323e0f96fea6428fb869d625a76340a6/roles/32f5ce5800cf40d99d894960288d0155` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:21.031467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d4ccf-6450-43eb-83ed-a33ae09783c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d6284e1c4d4485a1a8ee2bff825f06, user_id=323e0f96fea6428fb869d625a76340a6, role_id=32f5ce5800cf40d99d894960288d0155)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:21.032627 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1458/2893] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:20 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:21.034156 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d4ccf-6450-43eb-83ed-a33ae09783c8 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:21.047386 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1436/2894] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:27:21 2022] PUT /identity/v3/projects/a8d6284e1c4d4485a1a8ee2bff825f06/users/323e0f96fea6428fb869d625a76340a6/roles/32f5ce5800cf40d99d894960288d0155 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:21.058887 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f51065-4c7f-40a2-a50c-d4c858bff0cb None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:21.060070 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f51065-4c7f-40a2-a50c-d4c858bff0cb None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:21.060070 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f51065-4c7f-40a2-a50c-d4c858bff0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:21.090811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-79f51065-4c7f-40a2-a50c-d4c858bff0cb None None] MFA Rules not processed for user `323e0f96fea6428fb869d625a76340a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:21.092156 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-79f51065-4c7f-40a2-a50c-d4c858bff0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:21.177583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1459/2895] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:21 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:21.197747 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d4ccf-6450-43eb-83ed-a33ae09783c8 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:21.200118 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-386d4ccf-6450-43eb-83ed-a33ae09783c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:21.266837 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d4ccf-6450-43eb-83ed-a33ae09783c8 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:21.270703 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b92819-b2e5-4a81-9d5c-bf2f3dd3ffb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:21.271383 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b92819-b2e5-4a81-9d5c-bf2f3dd3ffb3 service cinder] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:21.271670 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b92819-b2e5-4a81-9d5c-bf2f3dd3ffb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:21.271962 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b92819-b2e5-4a81-9d5c-bf2f3dd3ffb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:21.283494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b92819-b2e5-4a81-9d5c-bf2f3dd3ffb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:21.285021 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b92819-b2e5-4a81-9d5c-bf2f3dd3ffb3 service cinder] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:21.297470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1437/2896] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:21 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:21.492313 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f51065-4c7f-40a2-a50c-d4c858bff0cb None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:21.511108 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f51065-4c7f-40a2-a50c-d4c858bff0cb None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:21.514864 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57533c80-7b9c-4ba6-b41e-d3316df8ddb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:21.515538 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57533c80-7b9c-4ba6-b41e-d3316df8ddb4 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:21.515827 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57533c80-7b9c-4ba6-b41e-d3316df8ddb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:21.516123 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57533c80-7b9c-4ba6-b41e-d3316df8ddb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:21.583515 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57533c80-7b9c-4ba6-b41e-d3316df8ddb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:21.585586 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57533c80-7b9c-4ba6-b41e-d3316df8ddb4 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:21.595483 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1460/2897] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:21 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:30.090562 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b92819-b2e5-4a81-9d5c-bf2f3dd3ffb3 service cinder] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:30.157086 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b92819-b2e5-4a81-9d5c-bf2f3dd3ffb3 service cinder] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:30.161717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314f2ed-ef94-41e5-b1ed-c7916bd0a14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:30.162628 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314f2ed-ef94-41e5-b1ed-c7916bd0a14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:30.162907 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314f2ed-ef94-41e5-b1ed-c7916bd0a14a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:30.163184 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314f2ed-ef94-41e5-b1ed-c7916bd0a14a admin admin] PATH_INFO: `/v3/users/99242c166b5c4e289881b4c8045b2949` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:30.164466 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314f2ed-ef94-41e5-b1ed-c7916bd0a14a admin admin] RBAC: Authorizing `identity:delete_user(user_id=99242c166b5c4e289881b4c8045b2949)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:30.166638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314f2ed-ef94-41e5-b1ed-c7916bd0a14a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:30.223106 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1314f2ed-ef94-41e5-b1ed-c7916bd0a14a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99242c166b5c4e289881b4c8045b2949'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:30.231119 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1314f2ed-ef94-41e5-b1ed-c7916bd0a14a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99242c166b5c4e289881b4c8045b2949'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:30.231926 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1314f2ed-ef94-41e5-b1ed-c7916bd0a14a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99242c166b5c4e289881b4c8045b2949'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:30.232561 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1314f2ed-ef94-41e5-b1ed-c7916bd0a14a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99242c166b5c4e289881b4c8045b2949'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:30.241897 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1314f2ed-ef94-41e5-b1ed-c7916bd0a14a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99242c166b5c4e289881b4c8045b2949'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:30.244344 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:30.262637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1438/2898] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:27:30 2022] DELETE /identity/v3/users/99242c166b5c4e289881b4c8045b2949 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:30.267332 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30b09-70d1-4a09-ac5b-485fd9f42491 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:30.267848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30b09-70d1-4a09-ac5b-485fd9f42491 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:30.267932 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30b09-70d1-4a09-ac5b-485fd9f42491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:30.286821 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-67b30b09-70d1-4a09-ac5b-485fd9f42491 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:30.288043 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-67b30b09-70d1-4a09-ac5b-485fd9f42491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:30.362276 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1461/2899] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:30.374019 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314f2ed-ef94-41e5-b1ed-c7916bd0a14a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:30.375497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1314f2ed-ef94-41e5-b1ed-c7916bd0a14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:30.445164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314f2ed-ef94-41e5-b1ed-c7916bd0a14a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:30.450790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a477a17-5c7d-46e4-b860-293b075a8453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:30.451908 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a477a17-5c7d-46e4-b860-293b075a8453 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:30.452449 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a477a17-5c7d-46e4-b860-293b075a8453 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:30.452873 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a477a17-5c7d-46e4-b860-293b075a8453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:30.464742 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a477a17-5c7d-46e4-b860-293b075a8453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:30.466467 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a477a17-5c7d-46e4-b860-293b075a8453 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:30.476875 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1439/2900] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:30.824321 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b30b09-70d1-4a09-ac5b-485fd9f42491 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:30.825863 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-67b30b09-70d1-4a09-ac5b-485fd9f42491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:30.841971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b30b09-70d1-4a09-ac5b-485fd9f42491 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:30.848070 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:30.848903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:30.849147 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:30.849577 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] PATH_INFO: `/v3/projects/4b0737da9444408fa13bf9d9f29784a0` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:30.850748 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0737da9444408fa13bf9d9f29784a0)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:30.853048 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:30.855639 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=100 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:30.904434 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0737da9444408fa13bf9d9f29784a0', 'request_id': 'req-6b761f19-74e9-444e-b556-6f11955ceec0'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:30.910547 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0737da9444408fa13bf9d9f29784a0', 'request_id': 'req-6b761f19-74e9-444e-b556-6f11955ceec0'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:30.918135 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0737da9444408fa13bf9d9f29784a0', 'request_id': 'req-6b761f19-74e9-444e-b556-6f11955ceec0'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:30.934583 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] The token cache is being invalidate because project 4b0737da9444408fa13bf9d9f29784a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:27:30.934880 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:30.935488 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:30.937101 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1462/2901] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:27:30 2022] DELETE /identity/v3/projects/4b0737da9444408fa13bf9d9f29784a0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:30.941476 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a477a17-5c7d-46e4-b860-293b075a8453 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:30.951617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a477a17-5c7d-46e4-b860-293b075a8453 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:31.014432 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad7e07-073b-4115-bfee-f2954acefc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:31.015332 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7e07-073b-4115-bfee-f2954acefc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:31.015617 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7e07-073b-4115-bfee-f2954acefc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:31.015895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7e07-073b-4115-bfee-f2954acefc40 admin admin] PATH_INFO: `/v3/users/323e0f96fea6428fb869d625a76340a6` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:31.020378 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad7e07-073b-4115-bfee-f2954acefc40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=323e0f96fea6428fb869d625a76340a6)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:31.022456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad7e07-073b-4115-bfee-f2954acefc40 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:31.073706 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-91ad7e07-073b-4115-bfee-f2954acefc40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323e0f96fea6428fb869d625a76340a6'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:31.081876 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-91ad7e07-073b-4115-bfee-f2954acefc40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323e0f96fea6428fb869d625a76340a6'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:31.082640 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-91ad7e07-073b-4115-bfee-f2954acefc40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323e0f96fea6428fb869d625a76340a6'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:31.083341 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-91ad7e07-073b-4115-bfee-f2954acefc40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323e0f96fea6428fb869d625a76340a6'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:31.093132 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-91ad7e07-073b-4115-bfee-f2954acefc40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323e0f96fea6428fb869d625a76340a6'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:31.114224 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1440/2902] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:27:30 2022] DELETE /identity/v3/users/323e0f96fea6428fb869d625a76340a6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:27:31.390686 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:31.392247 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:31.406649 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b761f19-74e9-444e-b556-6f11955ceec0 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:31.474857 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c52fe-8744-47e3-8cc6-8b0e25f5a712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:31.475661 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c52fe-8744-47e3-8cc6-8b0e25f5a712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:31.475941 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c52fe-8744-47e3-8cc6-8b0e25f5a712 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:31.476212 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c52fe-8744-47e3-8cc6-8b0e25f5a712 admin admin] PATH_INFO: `/v3/projects/a8d6284e1c4d4485a1a8ee2bff825f06` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:31.477610 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c52fe-8744-47e3-8cc6-8b0e25f5a712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d6284e1c4d4485a1a8ee2bff825f06)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:31.479550 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c52fe-8744-47e3-8cc6-8b0e25f5a712 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:31.529517 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-185c52fe-8744-47e3-8cc6-8b0e25f5a712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d6284e1c4d4485a1a8ee2bff825f06', 'request_id': 'req-185c52fe-8744-47e3-8cc6-8b0e25f5a712'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:31.537588 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-185c52fe-8744-47e3-8cc6-8b0e25f5a712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d6284e1c4d4485a1a8ee2bff825f06', 'request_id': 'req-185c52fe-8744-47e3-8cc6-8b0e25f5a712'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:31.544556 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-185c52fe-8744-47e3-8cc6-8b0e25f5a712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d6284e1c4d4485a1a8ee2bff825f06', 'request_id': 'req-185c52fe-8744-47e3-8cc6-8b0e25f5a712'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:31.559319 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-185c52fe-8744-47e3-8cc6-8b0e25f5a712 admin admin] The token cache is being invalidate because project a8d6284e1c4d4485a1a8ee2bff825f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:27:31.559604 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-185c52fe-8744-47e3-8cc6-8b0e25f5a712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:31.560226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-185c52fe-8744-47e3-8cc6-8b0e25f5a712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:31.561822 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1463/2903] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:27:31 2022] DELETE /identity/v3/projects/a8d6284e1c4d4485a1a8ee2bff825f06 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:31.567613 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270e5cc-5b9e-4974-ac0e-30260b89c1c1 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:31.567902 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270e5cc-5b9e-4974-ac0e-30260b89c1c1 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:31.568244 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270e5cc-5b9e-4974-ac0e-30260b89c1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:31.576321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:31.589321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-1270e5cc-5b9e-4974-ac0e-30260b89c1c1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:31.591201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1270e5cc-5b9e-4974-ac0e-30260b89c1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:31.649515 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1441/2904] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:31.657521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24b410-3c67-4b21-8a83-627978950cf0 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:31.657840 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24b410-3c67-4b21-8a83-627978950cf0 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:31.658096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24b410-3c67-4b21-8a83-627978950cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:31.676982 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-cf24b410-3c67-4b21-8a83-627978950cf0 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:31.678198 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-cf24b410-3c67-4b21-8a83-627978950cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:31.686778 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1464/2905] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:27:31.691164 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270e5cc-5b9e-4974-ac0e-30260b89c1c1 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:31.701429 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270e5cc-5b9e-4974-ac0e-30260b89c1c1 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:31.707112 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09682c-0a73-4eb0-b6db-2744aaae0cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:31.707784 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09682c-0a73-4eb0-b6db-2744aaae0cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:31.708052 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09682c-0a73-4eb0-b6db-2744aaae0cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:31.708321 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09682c-0a73-4eb0-b6db-2744aaae0cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:31.709081 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09682c-0a73-4eb0-b6db-2744aaae0cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:27:31.709396 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09682c-0a73-4eb0-b6db-2744aaae0cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:31.711006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09682c-0a73-4eb0-b6db-2744aaae0cb8 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:31.723524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1442/2906] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 16:27:31.728109 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24b410-3c67-4b21-8a83-627978950cf0 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:31.737811 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24b410-3c67-4b21-8a83-627978950cf0 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:31.743957 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55d3c6-2411-4dc0-a324-ba7daf60000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:31.744663 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d3c6-2411-4dc0-a324-ba7daf60000f admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:31.744947 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d3c6-2411-4dc0-a324-ba7daf60000f admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:31.745219 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d3c6-2411-4dc0-a324-ba7daf60000f admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:31.745917 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55d3c6-2411-4dc0-a324-ba7daf60000f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:31.747866 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55d3c6-2411-4dc0-a324-ba7daf60000f admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:31.761535 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:31.778651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1465/2907] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:27:31 2022] POST /identity/v3/projects => generated 359 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:31.784981 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09682c-0a73-4eb0-b6db-2744aaae0cb8 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:31.798821 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09682c-0a73-4eb0-b6db-2744aaae0cb8 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:31.860228 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da5bff-316b-4a80-861d-f376f0ef9d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:31.860936 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da5bff-316b-4a80-861d-f376f0ef9d52 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:31.861222 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da5bff-316b-4a80-861d-f376f0ef9d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:31.861502 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da5bff-316b-4a80-861d-f376f0ef9d52 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:31.862177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da5bff-316b-4a80-861d-f376f0ef9d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:31.864141 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da5bff-316b-4a80-861d-f376f0ef9d52 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:31.887047 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1443/2908] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:27:31 2022] POST /identity/v3/users => generated 280 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:31.891378 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55d3c6-2411-4dc0-a324-ba7daf60000f admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:31.902687 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55d3c6-2411-4dc0-a324-ba7daf60000f admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:31.907939 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad92b67-6060-409f-92fb-8de7a21e5acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:31.908662 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad92b67-6060-409f-92fb-8de7a21e5acc admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:31.908956 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad92b67-6060-409f-92fb-8de7a21e5acc admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:31.909236 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad92b67-6060-409f-92fb-8de7a21e5acc admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:31.910000 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad92b67-6060-409f-92fb-8de7a21e5acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:31.911637 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad92b67-6060-409f-92fb-8de7a21e5acc admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:31.924744 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1466/2909] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:31.930233 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da5bff-316b-4a80-861d-f376f0ef9d52 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:31.946783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da5bff-316b-4a80-861d-f376f0ef9d52 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:31.952937 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1087d-d268-4abb-97a9-16cb22ca6098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:31.953980 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1087d-d268-4abb-97a9-16cb22ca6098 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:31.954259 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1087d-d268-4abb-97a9-16cb22ca6098 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:31.954505 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1087d-d268-4abb-97a9-16cb22ca6098 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:31.955268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1087d-d268-4abb-97a9-16cb22ca6098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:31.956933 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1087d-d268-4abb-97a9-16cb22ca6098 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:31.967717 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1444/2910] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:31.972469 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad92b67-6060-409f-92fb-8de7a21e5acc admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:31.983582 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad92b67-6060-409f-92fb-8de7a21e5acc admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:31.990423 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b141b-408e-4a12-8b42-809df5b6ee16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:31.991347 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b141b-408e-4a12-8b42-809df5b6ee16 admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:31.991628 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b141b-408e-4a12-8b42-809df5b6ee16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:31.991903 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b141b-408e-4a12-8b42-809df5b6ee16 admin admin] PATH_INFO: `/v3/projects/db1791c04f9c4f52833dc3ef0d684297/users/1d8ee4748de04b69be71aabb9182e96d/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:32.008422 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b141b-408e-4a12-8b42-809df5b6ee16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db1791c04f9c4f52833dc3ef0d684297, user_id=1d8ee4748de04b69be71aabb9182e96d, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:32.011264 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b141b-408e-4a12-8b42-809df5b6ee16 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:32.027219 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1467/2911] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:27:31 2022] PUT /identity/v3/projects/db1791c04f9c4f52833dc3ef0d684297/users/1d8ee4748de04b69be71aabb9182e96d/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 16:27:32.038281 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e02274-4366-4726-af3c-0c2d0fd4bc91 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:32.038573 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e02274-4366-4726-af3c-0c2d0fd4bc91 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:32.038868 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e02274-4366-4726-af3c-0c2d0fd4bc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:32.066736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-e7e02274-4366-4726-af3c-0c2d0fd4bc91 None None] MFA Rules not processed for user `1d8ee4748de04b69be71aabb9182e96d`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:32.067934 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e7e02274-4366-4726-af3c-0c2d0fd4bc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:32.133107 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:32.142494 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1445/2912] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:32.171025 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b141b-408e-4a12-8b42-809df5b6ee16 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:32.172800 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f37b141b-408e-4a12-8b42-809df5b6ee16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:32.237181 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b141b-408e-4a12-8b42-809df5b6ee16 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:32.240842 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312a67c-7fc8-431f-b370-ec55cff0c51d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:32.241497 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312a67c-7fc8-431f-b370-ec55cff0c51d service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:32.241777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312a67c-7fc8-431f-b370-ec55cff0c51d service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:32.242049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312a67c-7fc8-431f-b370-ec55cff0c51d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:32.250869 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312a67c-7fc8-431f-b370-ec55cff0c51d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:32.252329 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312a67c-7fc8-431f-b370-ec55cff0c51d service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:32.261900 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1468/2913] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:32 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:32.276863 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e02274-4366-4726-af3c-0c2d0fd4bc91 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:32.348151 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e02274-4366-4726-af3c-0c2d0fd4bc91 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:32.353062 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b0b59-0bb0-4060-8c25-0c7bd5a4fe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:32.353933 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b0b59-0bb0-4060-8c25-0c7bd5a4fe82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:32.354243 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b0b59-0bb0-4060-8c25-0c7bd5a4fe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:32.354520 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b0b59-0bb0-4060-8c25-0c7bd5a4fe82 admin admin] PATH_INFO: `/v3/users/1d8ee4748de04b69be71aabb9182e96d` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:32.355745 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b0b59-0bb0-4060-8c25-0c7bd5a4fe82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d8ee4748de04b69be71aabb9182e96d)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:32.357704 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b0b59-0bb0-4060-8c25-0c7bd5a4fe82 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:32.413204 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1b6b0b59-0bb0-4060-8c25-0c7bd5a4fe82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d8ee4748de04b69be71aabb9182e96d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:32.420827 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1b6b0b59-0bb0-4060-8c25-0c7bd5a4fe82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d8ee4748de04b69be71aabb9182e96d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:32.421481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1b6b0b59-0bb0-4060-8c25-0c7bd5a4fe82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d8ee4748de04b69be71aabb9182e96d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:32.422199 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1b6b0b59-0bb0-4060-8c25-0c7bd5a4fe82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d8ee4748de04b69be71aabb9182e96d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:32.430271 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-1b6b0b59-0bb0-4060-8c25-0c7bd5a4fe82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d8ee4748de04b69be71aabb9182e96d'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:32.448869 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1446/2914] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:27:32 2022] DELETE /identity/v3/users/1d8ee4748de04b69be71aabb9182e96d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:32.454061 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed961ec-63f5-4fa3-b73a-5797c422dc98 None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:32.454551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed961ec-63f5-4fa3-b73a-5797c422dc98 None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:32.454651 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed961ec-63f5-4fa3-b73a-5797c422dc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:32.474348 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-eed961ec-63f5-4fa3-b73a-5797c422dc98 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:32.475551 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-eed961ec-63f5-4fa3-b73a-5797c422dc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:32.538473 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1469/2915] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:32.548245 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b0b59-0bb0-4060-8c25-0c7bd5a4fe82 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:32.549808 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-1b6b0b59-0bb0-4060-8c25-0c7bd5a4fe82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:32.609606 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b0b59-0bb0-4060-8c25-0c7bd5a4fe82 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:32.613529 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f700c4-ccc6-4ad7-a437-b3a3e44abbb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:32.614179 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f700c4-ccc6-4ad7-a437-b3a3e44abbb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:32.614581 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f700c4-ccc6-4ad7-a437-b3a3e44abbb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:32.614865 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f700c4-ccc6-4ad7-a437-b3a3e44abbb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:32.625454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f700c4-ccc6-4ad7-a437-b3a3e44abbb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:32.626975 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f700c4-ccc6-4ad7-a437-b3a3e44abbb3 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:32.636387 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1447/2916] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:32.920783 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed961ec-63f5-4fa3-b73a-5797c422dc98 None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:32.922318 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-eed961ec-63f5-4fa3-b73a-5797c422dc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:32.936991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed961ec-63f5-4fa3-b73a-5797c422dc98 None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:32.942314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:32.943281 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:32.943629 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:32.944006 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b admin admin] PATH_INFO: `/v3/projects/db1791c04f9c4f52833dc3ef0d684297` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:32.945317 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b admin admin] RBAC: Authorizing `identity:delete_project(project_id=db1791c04f9c4f52833dc3ef0d684297)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:32.947407 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:33.005509 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db1791c04f9c4f52833dc3ef0d684297', 'request_id': 'req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:33.012724 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db1791c04f9c4f52833dc3ef0d684297', 'request_id': 'req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:33.014789 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:DELETE=5 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:33.019852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db1791c04f9c4f52833dc3ef0d684297', 'request_id': 'req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:33.035972 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b admin admin] The token cache is being invalidate because project db1791c04f9c4f52833dc3ef0d684297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:27:33.036279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:33.036929 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-d91fccf0-4a7e-4e31-89d8-88fd7cbda02b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:33.038490 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1470/2917] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:27:32 2022] DELETE /identity/v3/projects/db1791c04f9c4f52833dc3ef0d684297 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:33.043630 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a17c13-9d9d-4295-8686-5a342c8ac7f1 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:33.044113 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a17c13-9d9d-4295-8686-5a342c8ac7f1 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:33.044522 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a17c13-9d9d-4295-8686-5a342c8ac7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:33.062636 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-07a17c13-9d9d-4295-8686-5a342c8ac7f1 None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:33.063852 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-07a17c13-9d9d-4295-8686-5a342c8ac7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:33.084757 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:33.130041 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1448/2918] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:27:33.139185 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60af876-1128-4c0b-8561-ff01e830ce7d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:33.139475 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60af876-1128-4c0b-8561-ff01e830ce7d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:33.139752 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60af876-1128-4c0b-8561-ff01e830ce7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:33.159383 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-f60af876-1128-4c0b-8561-ff01e830ce7d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:33.160643 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-f60af876-1128-4c0b-8561-ff01e830ce7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:33.172971 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1471/2919] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:33.177962 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a17c13-9d9d-4295-8686-5a342c8ac7f1 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:33.190394 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a17c13-9d9d-4295-8686-5a342c8ac7f1 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:33.196143 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b79f07-ee2f-47a0-9ca1-d5b5a2a95d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:33.196864 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79f07-ee2f-47a0-9ca1-d5b5a2a95d56 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:33.197143 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79f07-ee2f-47a0-9ca1-d5b5a2a95d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:33.197413 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79f07-ee2f-47a0-9ca1-d5b5a2a95d56 admin admin] PATH_INFO: `/v3/domains` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:33.198153 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b79f07-ee2f-47a0-9ca1-d5b5a2a95d56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86734) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 16:27:33.198454 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b79f07-ee2f-47a0-9ca1-d5b5a2a95d56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:33.200064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b79f07-ee2f-47a0-9ca1-d5b5a2a95d56 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:33.213268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1449/2920] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Jul 11 16:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 16:27:33.217920 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60af876-1128-4c0b-8561-ff01e830ce7d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:33.227684 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60af876-1128-4c0b-8561-ff01e830ce7d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:33.233071 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60281c84-8ff8-4c1f-876b-595d51944989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:33.233730 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60281c84-8ff8-4c1f-876b-595d51944989 admin admin] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:33.234017 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60281c84-8ff8-4c1f-876b-595d51944989 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:33.234289 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60281c84-8ff8-4c1f-876b-595d51944989 admin admin] PATH_INFO: `/v3/projects` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:33.235004 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60281c84-8ff8-4c1f-876b-595d51944989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:33.237014 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60281c84-8ff8-4c1f-876b-595d51944989 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:33.267940 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1472/2921] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Jul 11 16:27:33 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:33.272198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b79f07-ee2f-47a0-9ca1-d5b5a2a95d56 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:33.283338 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b79f07-ee2f-47a0-9ca1-d5b5a2a95d56 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:33.342242 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f745b-0e9b-402b-8795-9617e37ba520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:33.342905 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f745b-0e9b-402b-8795-9617e37ba520 admin admin] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:33.343186 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f745b-0e9b-402b-8795-9617e37ba520 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:33.343456 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f745b-0e9b-402b-8795-9617e37ba520 admin admin] PATH_INFO: `/v3/users` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:33.344145 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f745b-0e9b-402b-8795-9617e37ba520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:33.346140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f745b-0e9b-402b-8795-9617e37ba520 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:33.370569 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1450/2922] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Jul 11 16:27:33 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 16:27:33.372394 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60281c84-8ff8-4c1f-876b-595d51944989 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:33.383269 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60281c84-8ff8-4c1f-876b-595d51944989 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:33.388848 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b4f79-1e1a-4e26-9a0b-99c08d727f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:33.389526 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b4f79-1e1a-4e26-9a0b-99c08d727f1e admin admin] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:33.389808 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b4f79-1e1a-4e26-9a0b-99c08d727f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:33.390084 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b4f79-1e1a-4e26-9a0b-99c08d727f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:33.390823 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b4f79-1e1a-4e26-9a0b-99c08d727f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:33.392495 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b4f79-1e1a-4e26-9a0b-99c08d727f1e admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:33.404040 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1473/2923] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:33.408853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f745b-0e9b-402b-8795-9617e37ba520 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:33.419540 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f745b-0e9b-402b-8795-9617e37ba520 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:33.424445 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f103a6-0531-49bf-a3b4-a01676d6a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:33.425130 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f103a6-0531-49bf-a3b4-a01676d6a0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:33.425418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f103a6-0531-49bf-a3b4-a01676d6a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:33.425698 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f103a6-0531-49bf-a3b4-a01676d6a0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:33.426447 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f103a6-0531-49bf-a3b4-a01676d6a0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:33.428078 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f103a6-0531-49bf-a3b4-a01676d6a0e1 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:33.438901 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1451/2924] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Jul 11 16:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 16:27:33.443303 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b4f79-1e1a-4e26-9a0b-99c08d727f1e admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:33.454102 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b4f79-1e1a-4e26-9a0b-99c08d727f1e admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:33.459334 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09572c-9bfa-4f73-baf7-a0b8080a0c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:33.460226 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09572c-9bfa-4f73-baf7-a0b8080a0c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:33.460549 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09572c-9bfa-4f73-baf7-a0b8080a0c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:33.460829 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09572c-9bfa-4f73-baf7-a0b8080a0c6e admin admin] PATH_INFO: `/v3/projects/038c696f85a443e287784f5f48c95a9f/users/7ca53460048543b79b2b70c1873074c7/roles/7df8c80cd6f643d6aa8ecd8281781a3f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:33.477897 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09572c-9bfa-4f73-baf7-a0b8080a0c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=038c696f85a443e287784f5f48c95a9f, user_id=7ca53460048543b79b2b70c1873074c7, role_id=7df8c80cd6f643d6aa8ecd8281781a3f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:33.480823 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09572c-9bfa-4f73-baf7-a0b8080a0c6e admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:33.496774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1474/2925] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Jul 11 16:27:33 2022] PUT /identity/v3/projects/038c696f85a443e287784f5f48c95a9f/users/7ca53460048543b79b2b70c1873074c7/roles/7df8c80cd6f643d6aa8ecd8281781a3f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:33.507450 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855ac8c-7393-4a4f-b038-faeaf66166d3 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:33.507741 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855ac8c-7393-4a4f-b038-faeaf66166d3 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:33.508077 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855ac8c-7393-4a4f-b038-faeaf66166d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:33.537280 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-4855ac8c-7393-4a4f-b038-faeaf66166d3 None None] MFA Rules not processed for user `7ca53460048543b79b2b70c1873074c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:33.538481 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-4855ac8c-7393-4a4f-b038-faeaf66166d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:33.615411 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1452/2926] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:27:33.626831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09572c-9bfa-4f73-baf7-a0b8080a0c6e admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:33.628725 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-ec09572c-9bfa-4f73-baf7-a0b8080a0c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:33.687593 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09572c-9bfa-4f73-baf7-a0b8080a0c6e admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:33.692113 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1027207-0f42-4598-ac80-2d8fdb423816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73732594dbee480e9e5d153ca1382494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:33.692805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027207-0f42-4598-ac80-2d8fdb423816 service cinder] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:33.693053 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027207-0f42-4598-ac80-2d8fdb423816 service cinder] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:33.693364 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027207-0f42-4598-ac80-2d8fdb423816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:33.702500 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1027207-0f42-4598-ac80-2d8fdb423816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:33.704314 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1027207-0f42-4598-ac80-2d8fdb423816 service cinder] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:33.713584 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1475/2927] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:33.738802 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855ac8c-7393-4a4f-b038-faeaf66166d3 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:33.759386 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:33.804584 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855ac8c-7393-4a4f-b038-faeaf66166d3 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:33.809637 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb161a-6859-4d72-abaa-1c4004db9a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:33.810522 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb161a-6859-4d72-abaa-1c4004db9a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:33.810799 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb161a-6859-4d72-abaa-1c4004db9a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:33.811073 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb161a-6859-4d72-abaa-1c4004db9a0f admin admin] PATH_INFO: `/v3/users/7ca53460048543b79b2b70c1873074c7` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:33.812319 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb161a-6859-4d72-abaa-1c4004db9a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca53460048543b79b2b70c1873074c7)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:33.814311 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb161a-6859-4d72-abaa-1c4004db9a0f admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:33.867995 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8fbb161a-6859-4d72-abaa-1c4004db9a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca53460048543b79b2b70c1873074c7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:33.875461 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8fbb161a-6859-4d72-abaa-1c4004db9a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca53460048543b79b2b70c1873074c7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:33.876144 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8fbb161a-6859-4d72-abaa-1c4004db9a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca53460048543b79b2b70c1873074c7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:33.876816 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8fbb161a-6859-4d72-abaa-1c4004db9a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca53460048543b79b2b70c1873074c7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:33.886550 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-8fbb161a-6859-4d72-abaa-1c4004db9a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca53460048543b79b2b70c1873074c7'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:33.903803 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1453/2928] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:27:33 2022] DELETE /identity/v3/users/7ca53460048543b79b2b70c1873074c7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:33.908508 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4db8d7-3aa9-45ab-a050-8e63ebacca0d None None] REQUEST_METHOD: `POST` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:33.908799 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4db8d7-3aa9-45ab-a050-8e63ebacca0d None None] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:33.909094 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4db8d7-3aa9-45ab-a050-8e63ebacca0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:33.927802 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.auth.core [None req-9c4db8d7-3aa9-45ab-a050-8e63ebacca0d None None] MFA Rules not processed for user `db61f34a47204afa92fb860bcaecb5da`. Rule list: `[]` (Enabled: `True`). {{(pid=86735) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:33.929058 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9c4db8d7-3aa9-45ab-a050-8e63ebacca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:33.989981 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1476/2929] 10.222.0.26 () {58 vars in 957 bytes} [Mon Jul 11 16:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:34.000232 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb161a-6859-4d72-abaa-1c4004db9a0f admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:34.001873 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-8fbb161a-6859-4d72-abaa-1c4004db9a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:34.059639 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb161a-6859-4d72-abaa-1c4004db9a0f admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:34.063418 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd3224-8e4b-4d44-b41f-d1e4c3bf364a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:34.064064 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd3224-8e4b-4d44-b41f-d1e4c3bf364a service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:34.064367 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd3224-8e4b-4d44-b41f-d1e4c3bf364a service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:34.064644 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd3224-8e4b-4d44-b41f-d1e4c3bf364a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:34.074193 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd3224-8e4b-4d44-b41f-d1e4c3bf364a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:34.075635 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd3224-8e4b-4d44-b41f-d1e4c3bf364a service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:34.085444 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1454/2930] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:27:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:27:34.529114 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4db8d7-3aa9-45ab-a050-8e63ebacca0d None None] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:34.530813 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9c4db8d7-3aa9-45ab-a050-8e63ebacca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:34.543806 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4db8d7-3aa9-45ab-a050-8e63ebacca0d None None] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:34.551125 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:34.552022 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:34.552313 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:34.552613 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] PATH_INFO: `/v3/projects/038c696f85a443e287784f5f48c95a9f` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:34.553831 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=038c696f85a443e287784f5f48c95a9f)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:34.555814 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:34.582032 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:34.611868 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038c696f85a443e287784f5f48c95a9f', 'request_id': 'req-4057a2dd-4240-473a-babd-ce47853b2431'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:34.621774 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038c696f85a443e287784f5f48c95a9f', 'request_id': 'req-4057a2dd-4240-473a-babd-ce47853b2431'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:34.627426 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038c696f85a443e287784f5f48c95a9f', 'request_id': 'req-4057a2dd-4240-473a-babd-ce47853b2431'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:34.642373 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] The token cache is being invalidate because project 038c696f85a443e287784f5f48c95a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:27:34.642553 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:34.643165 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:34.644767 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1477/2931] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:27:34 2022] DELETE /identity/v3/projects/038c696f85a443e287784f5f48c95a9f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:41.215268 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039735b-97cc-4cf5-8a12-68a8ebc9062b None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:41.215776 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039735b-97cc-4cf5-8a12-68a8ebc9062b None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:41.215895 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039735b-97cc-4cf5-8a12-68a8ebc9062b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:41.274853 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:41.279442 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-5039735b-97cc-4cf5-8a12-68a8ebc9062b None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:41.281341 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-5039735b-97cc-4cf5-8a12-68a8ebc9062b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:41.359880 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1455/2932] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Jul 11 16:27:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 16:27:41.414537 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:41.416056 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:41.518703 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057a2dd-4240-473a-babd-ce47853b2431 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:41.524962 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807caea4-c386-427e-9f3d-a46795d286bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:41.525616 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807caea4-c386-427e-9f3d-a46795d286bf service swift] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:41.525902 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807caea4-c386-427e-9f3d-a46795d286bf service swift] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:41.526179 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807caea4-c386-427e-9f3d-a46795d286bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:41.535679 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807caea4-c386-427e-9f3d-a46795d286bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:41.537346 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807caea4-c386-427e-9f3d-a46795d286bf service swift] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:41.546139 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1478/2933] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 16:27:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:27:51.354702 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=26 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:51.542639 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:27:55.822125 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dcc25-d676-46fb-b0f0-df9464067302 None None] REQUEST_METHOD: `POST` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:55.822579 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dcc25-d676-46fb-b0f0-df9464067302 None None] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:55.822658 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dcc25-d676-46fb-b0f0-df9464067302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:55.841524 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.auth.core [None req-fe0dcc25-d676-46fb-b0f0-df9464067302 None None] MFA Rules not processed for user `8c910084851040cf817aa92ede9d0d97`. Rule list: `[]` (Enabled: `True`). {{(pid=86734) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 16:27:55.842712 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fe0dcc25-d676-46fb-b0f0-df9464067302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:55.860342 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1456/2934] 10.222.0.26 () {58 vars in 967 bytes} [Mon Jul 11 16:27:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 16:27:55.876029 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807caea4-c386-427e-9f3d-a46795d286bf service swift] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:55.890786 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807caea4-c386-427e-9f3d-a46795d286bf service swift] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:55.897264 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cea536-e762-4d65-8bed-dc1595bd859e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eaff8748f8b47e088e0cb7875992a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:55.897908 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea536-e762-4d65-8bed-dc1595bd859e service swift] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:55.898188 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea536-e762-4d65-8bed-dc1595bd859e service swift] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:55.898452 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea536-e762-4d65-8bed-dc1595bd859e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:55.907160 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cea536-e762-4d65-8bed-dc1595bd859e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:55.908793 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cea536-e762-4d65-8bed-dc1595bd859e service swift] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:55.916874 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1479/2935] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Jul 11 16:27:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 16:27:57.900674 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0dcc25-d676-46fb-b0f0-df9464067302 None None] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:57.902298 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-fe0dcc25-d676-46fb-b0f0-df9464067302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:27:57.976820 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0dcc25-d676-46fb-b0f0-df9464067302 None None] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:57.981535 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02b58f-98b3-41b1-aa9e-efe7b0a186b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:57.982500 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02b58f-98b3-41b1-aa9e-efe7b0a186b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:57.982783 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02b58f-98b3-41b1-aa9e-efe7b0a186b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:57.983068 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02b58f-98b3-41b1-aa9e-efe7b0a186b5 admin admin] PATH_INFO: `/v3/users/b701c953ae4f485ba6cefed3178f9951` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:57.984323 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02b58f-98b3-41b1-aa9e-efe7b0a186b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b701c953ae4f485ba6cefed3178f9951)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:57.986290 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02b58f-98b3-41b1-aa9e-efe7b0a186b5 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:58.037319 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-ad02b58f-98b3-41b1-aa9e-efe7b0a186b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b701c953ae4f485ba6cefed3178f9951'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:58.044030 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-ad02b58f-98b3-41b1-aa9e-efe7b0a186b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b701c953ae4f485ba6cefed3178f9951'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:58.044697 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-ad02b58f-98b3-41b1-aa9e-efe7b0a186b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b701c953ae4f485ba6cefed3178f9951'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:58.045285 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-ad02b58f-98b3-41b1-aa9e-efe7b0a186b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b701c953ae4f485ba6cefed3178f9951'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:58.054605 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-ad02b58f-98b3-41b1-aa9e-efe7b0a186b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b701c953ae4f485ba6cefed3178f9951'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:58.073484 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1457/2936] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:27:57 2022] DELETE /identity/v3/users/b701c953ae4f485ba6cefed3178f9951 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:27:58.266517 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cea536-e762-4d65-8bed-dc1595bd859e service swift] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:27:58.277836 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cea536-e762-4d65-8bed-dc1595bd859e service swift] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:27:58.336624 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:27:58.337489 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:27:58.337767 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:27:58.338035 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] PATH_INFO: `/v3/projects/ce9d90202a824e3689fc7a2538407fd0` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:27:58.339252 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9d90202a824e3689fc7a2538407fd0)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:27:58.341409 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:27:58.395309 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9d90202a824e3689fc7a2538407fd0', 'request_id': 'req-eacd8e97-c84d-414a-b034-356789bccfc6'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:58.401359 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9d90202a824e3689fc7a2538407fd0', 'request_id': 'req-eacd8e97-c84d-414a-b034-356789bccfc6'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:58.406942 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9d90202a824e3689fc7a2538407fd0', 'request_id': 'req-eacd8e97-c84d-414a-b034-356789bccfc6'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:58.421237 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] The token cache is being invalidate because project ce9d90202a824e3689fc7a2538407fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86735) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:27:58.421530 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:58.422177 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:27:58.424100 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1480/2937] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:27:58 2022] DELETE /identity/v3/projects/ce9d90202a824e3689fc7a2538407fd0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:28:08.069888 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=60,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:28:08.418217 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:29:19.897547 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02b58f-98b3-41b1-aa9e-efe7b0a186b5 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:29:19.899210 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-ad02b58f-98b3-41b1-aa9e-efe7b0a186b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:29:20.021033 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02b58f-98b3-41b1-aa9e-efe7b0a186b5 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:29:20.090844 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a2f43-bc2e-4cff-9084-575f078c3479 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:29:20.091497 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a2f43-bc2e-4cff-9084-575f078c3479 service placement] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:29:20.091785 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a2f43-bc2e-4cff-9084-575f078c3479 service placement] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:29:20.092059 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a2f43-bc2e-4cff-9084-575f078c3479 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:29:20.094140 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-2a5a2f43-bc2e-4cff-9084-575f078c3479 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:29:20.105736 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a2f43-bc2e-4cff-9084-575f078c3479 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:29:20.107328 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a2f43-bc2e-4cff-9084-575f078c3479 service placement] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:29:20.117714 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1458/2938] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:29:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:29:30.113534 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=76 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:29:35.442279 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:29:35.443805 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:29:35.504509 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd8e97-c84d-414a-b034-356789bccfc6 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:29:35.508211 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416aa59f-de8f-4382-9a50-f1bd90c5f1e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:29:35.508919 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416aa59f-de8f-4382-9a50-f1bd90c5f1e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:29:35.509189 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416aa59f-de8f-4382-9a50-f1bd90c5f1e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:29:35.509468 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416aa59f-de8f-4382-9a50-f1bd90c5f1e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:29:35.511287 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-416aa59f-de8f-4382-9a50-f1bd90c5f1e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:29:35.521619 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416aa59f-de8f-4382-9a50-f1bd90c5f1e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:29:35.523097 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416aa59f-de8f-4382-9a50-f1bd90c5f1e3 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:29:35.532251 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1481/2939] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:29:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:29:35.641858 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a2f43-bc2e-4cff-9084-575f078c3479 service placement] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:29:35.656691 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a2f43-bc2e-4cff-9084-575f078c3479 service placement] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:29:35.664147 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409c36e-c4bf-407e-b11b-062761c1eb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:29:35.665012 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409c36e-c4bf-407e-b11b-062761c1eb53 service neutron] REQUEST_METHOD: `GET` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:29:35.665386 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409c36e-c4bf-407e-b11b-062761c1eb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:29:35.665739 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409c36e-c4bf-407e-b11b-062761c1eb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:29:35.668992 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e409c36e-c4bf-407e-b11b-062761c1eb53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:29:35.753709 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409c36e-c4bf-407e-b11b-062761c1eb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:29:35.755211 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409c36e-c4bf-407e-b11b-062761c1eb53 service neutron] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:29:35.767042 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1459/2940] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:29:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:29:45.528389 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=26 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:29:45.761811 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=34 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:31:05.769192 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416aa59f-de8f-4382-9a50-f1bd90c5f1e3 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:31:05.770968 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-416aa59f-de8f-4382-9a50-f1bd90c5f1e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:31:05.811248 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416aa59f-de8f-4382-9a50-f1bd90c5f1e3 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:31:05.817749 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed66f17-953e-45a3-b9ef-19736c0bb034 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa038a2e30f544aaa609d32e0e1ceaa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:31:05.818419 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed66f17-953e-45a3-b9ef-19736c0bb034 service nova] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:31:05.818708 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed66f17-953e-45a3-b9ef-19736c0bb034 service nova] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:31:05.818991 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed66f17-953e-45a3-b9ef-19736c0bb034 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:31:05.821107 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9ed66f17-953e-45a3-b9ef-19736c0bb034 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:31:05.835946 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed66f17-953e-45a3-b9ef-19736c0bb034 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:31:05.837639 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed66f17-953e-45a3-b9ef-19736c0bb034 service nova] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:31:05.848948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1482/2941] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:31:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:31:13.978042 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409c36e-c4bf-407e-b11b-062761c1eb53 service neutron] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:31:13.979866 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-e409c36e-c4bf-407e-b11b-062761c1eb53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:31:14.068165 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409c36e-c4bf-407e-b11b-062761c1eb53 service neutron] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:31:14.073740 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48e5fb-d62b-4192-a5ab-3852cd1a520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:31:14.074638 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48e5fb-d62b-4192-a5ab-3852cd1a520a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:31:14.074919 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48e5fb-d62b-4192-a5ab-3852cd1a520a admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:31:14.075198 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48e5fb-d62b-4192-a5ab-3852cd1a520a admin admin] PATH_INFO: `/v3/users/46b01ee6b70b4da38f9735df5ecc0d1c` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:31:14.076470 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48e5fb-d62b-4192-a5ab-3852cd1a520a admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b01ee6b70b4da38f9735df5ecc0d1c)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:31:14.078748 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48e5fb-d62b-4192-a5ab-3852cd1a520a admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:31:14.135025 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-da48e5fb-d62b-4192-a5ab-3852cd1a520a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b01ee6b70b4da38f9735df5ecc0d1c'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.143006 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-da48e5fb-d62b-4192-a5ab-3852cd1a520a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b01ee6b70b4da38f9735df5ecc0d1c'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.143789 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-da48e5fb-d62b-4192-a5ab-3852cd1a520a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b01ee6b70b4da38f9735df5ecc0d1c'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.144790 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-da48e5fb-d62b-4192-a5ab-3852cd1a520a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b01ee6b70b4da38f9735df5ecc0d1c'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.155075 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-da48e5fb-d62b-4192-a5ab-3852cd1a520a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b01ee6b70b4da38f9735df5ecc0d1c'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.178028 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1460/2942] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:31:13 2022] DELETE /identity/v3/users/46b01ee6b70b4da38f9735df5ecc0d1c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:31:14.188033 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed66f17-953e-45a3-b9ef-19736c0bb034 service nova] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:31:14.189714 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-9ed66f17-953e-45a3-b9ef-19736c0bb034 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:31:14.202765 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed66f17-953e-45a3-b9ef-19736c0bb034 service nova] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:31:14.252069 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2b69b-7b10-4077-9598-f54bc9076005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44a4d0441d4a423884d7adef45e2641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:31:14.252761 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2b69b-7b10-4077-9598-f54bc9076005 service neutron] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:31:14.253045 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2b69b-7b10-4077-9598-f54bc9076005 service neutron] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:31:14.253325 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2b69b-7b10-4077-9598-f54bc9076005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:31:14.255461 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-b4a2b69b-7b10-4077-9598-f54bc9076005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:31:14.322986 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2b69b-7b10-4077-9598-f54bc9076005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:31:14.324398 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2b69b-7b10-4077-9598-f54bc9076005 service neutron] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:31:14.334836 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1483/2943] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:31:14.530136 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48e5fb-d62b-4192-a5ab-3852cd1a520a admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:31:14.531876 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-da48e5fb-d62b-4192-a5ab-3852cd1a520a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:31:14.546193 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48e5fb-d62b-4192-a5ab-3852cd1a520a admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:31:14.551223 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:31:14.552104 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:31:14.552831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:31:14.552831 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] PATH_INFO: `/v3/projects/15f80256e12d4678ac08717e16368e64` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:31:14.553986 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f80256e12d4678ac08717e16368e64)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:31:14.555913 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:31:14.604373 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f80256e12d4678ac08717e16368e64', 'request_id': 'req-53ffdb83-8c28-472f-82e4-eba86327cf11'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.609726 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f80256e12d4678ac08717e16368e64', 'request_id': 'req-53ffdb83-8c28-472f-82e4-eba86327cf11'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.611532 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:31:14.616297 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f80256e12d4678ac08717e16368e64', 'request_id': 'req-53ffdb83-8c28-472f-82e4-eba86327cf11'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.630402 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] The token cache is being invalidate because project 15f80256e12d4678ac08717e16368e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:31:14.631053 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.631412 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.633865 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1461/2944] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:31:14 2022] DELETE /identity/v3/projects/15f80256e12d4678ac08717e16368e64 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:31:14.639421 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2b69b-7b10-4077-9598-f54bc9076005 service neutron] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:31:14.650222 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2b69b-7b10-4077-9598-f54bc9076005 service neutron] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:31:14.719927 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1575dba-2d30-4451-b802-9d1cf2eee164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:31:14.720836 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1575dba-2d30-4451-b802-9d1cf2eee164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:31:14.721119 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1575dba-2d30-4451-b802-9d1cf2eee164 admin admin] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:31:14.721391 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1575dba-2d30-4451-b802-9d1cf2eee164 admin admin] PATH_INFO: `/v3/users/830e759bd74347028ffb2b5290e25d8c` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:31:14.722594 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1575dba-2d30-4451-b802-9d1cf2eee164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=830e759bd74347028ffb2b5290e25d8c)` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:31:14.724634 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1575dba-2d30-4451-b802-9d1cf2eee164 admin admin] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:31:14.745180 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:31:14.772049 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a1575dba-2d30-4451-b802-9d1cf2eee164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830e759bd74347028ffb2b5290e25d8c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.778852 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a1575dba-2d30-4451-b802-9d1cf2eee164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830e759bd74347028ffb2b5290e25d8c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.779503 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a1575dba-2d30-4451-b802-9d1cf2eee164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830e759bd74347028ffb2b5290e25d8c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.780096 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a1575dba-2d30-4451-b802-9d1cf2eee164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830e759bd74347028ffb2b5290e25d8c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.790339 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.notifications [None req-a1575dba-2d30-4451-b802-9d1cf2eee164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830e759bd74347028ffb2b5290e25d8c'} {{(pid=86735) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:14.814316 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1484/2945] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Jul 11 16:31:14 2022] DELETE /identity/v3/users/830e759bd74347028ffb2b5290e25d8c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:31:15.002917 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] Authenticating user token {{(pid=86734) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:31:15.007368 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.fernet_utils [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86734) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:31:15.029623 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffdb83-8c28-472f-82e4-eba86327cf11 admin admin] Validating token access rules against request {{(pid=86734) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:31:15.089520 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ea609-6ae7-4ce1-9d98-84a348088cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db61f34a47204afa92fb860bcaecb5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74c7f2a67041fea527ddf55a3384ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86734) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:31:15.090397 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ea609-6ae7-4ce1-9d98-84a348088cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:31:15.090677 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ea609-6ae7-4ce1-9d98-84a348088cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:31:15.090954 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ea609-6ae7-4ce1-9d98-84a348088cd8 admin admin] PATH_INFO: `/v3/projects/41a6bc6457624bdaaa525dcbc7a170b0` {{(pid=86734) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:31:15.092214 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ea609-6ae7-4ce1-9d98-84a348088cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a6bc6457624bdaaa525dcbc7a170b0)` {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:31:15.094201 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ea609-6ae7-4ce1-9d98-84a348088cd8 admin admin] RBAC: Authorization granted {{(pid=86734) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:31:15.144778 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-163ea609-6ae7-4ce1-9d98-84a348088cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a6bc6457624bdaaa525dcbc7a170b0', 'request_id': 'req-163ea609-6ae7-4ce1-9d98-84a348088cd8'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:15.150378 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-163ea609-6ae7-4ce1-9d98-84a348088cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a6bc6457624bdaaa525dcbc7a170b0', 'request_id': 'req-163ea609-6ae7-4ce1-9d98-84a348088cd8'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:15.156517 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-163ea609-6ae7-4ce1-9d98-84a348088cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a6bc6457624bdaaa525dcbc7a170b0', 'request_id': 'req-163ea609-6ae7-4ce1-9d98-84a348088cd8'} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:15.171942 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-163ea609-6ae7-4ce1-9d98-84a348088cd8 admin admin] The token cache is being invalidate because project 41a6bc6457624bdaaa525dcbc7a170b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86734) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 16:31:15.172220 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-163ea609-6ae7-4ce1-9d98-84a348088cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:15.172892 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG keystone.notifications [None req-163ea609-6ae7-4ce1-9d98-84a348088cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86734) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 16:31:15.174472 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: [pid: 86734|app: 0|req: 1462/2946] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Jul 11 16:31:15 2022] DELETE /identity/v3/projects/41a6bc6457624bdaaa525dcbc7a170b0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 16:31:24.810777 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:DELETE=8,keystone:SELECT=20,keystone:INSERT=1 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:31:25.169177 dv-cinder-797608-53-iscsi devstack@keystone.service[86734]: DEBUG dbcounter [-] [86734] Writing DB stats keystone:SELECT=54,keystone:INSERT=2,keystone:DELETE=8 {{(pid=86734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 16:34:24.213870 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1575dba-2d30-4451-b802-9d1cf2eee164 admin admin] Authenticating user token {{(pid=86735) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 16:34:24.216413 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-a1575dba-2d30-4451-b802-9d1cf2eee164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:34:24.290468 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1575dba-2d30-4451-b802-9d1cf2eee164 admin admin] Validating token access rules against request {{(pid=86735) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 16:34:24.360254 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d1ebd-986d-4712-9d6d-87e115469967 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5484ecb194023aa8415cb8b52ca5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe17aeb94ad42dc990c9d963dac9af6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86735) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 16:34:24.360948 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d1ebd-986d-4712-9d6d-87e115469967 service placement] REQUEST_METHOD: `GET` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 16:34:24.361225 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d1ebd-986d-4712-9d6d-87e115469967 service placement] SCRIPT_NAME: `/identity` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 16:34:24.361521 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d1ebd-986d-4712-9d6d-87e115469967 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86735) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 16:34:24.363463 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.fernet_utils [None req-888d1ebd-986d-4712-9d6d-87e115469967 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86735) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 16:34:24.375756 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d1ebd-986d-4712-9d6d-87e115469967 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 16:34:24.377439 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d1ebd-986d-4712-9d6d-87e115469967 service placement] RBAC: Authorization granted {{(pid=86735) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 16:34:24.387693 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: [pid: 86735|app: 0|req: 1485/2947] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Jul 11 16:34:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 16:34:34.383321 dv-cinder-797608-53-iscsi devstack@keystone.service[86735]: DEBUG dbcounter [-] [86735] Writing DB stats keystone:SELECT=58 {{(pid=86735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}